00010000:00010000:3.0:1788390822.752878:0:25343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34008 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2f7 expref: 33 pid: 25357 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.752929:0:25343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34008 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2f7 expref: 33 pid: 25357 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.752946:0:25343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390822.752950:0:25343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.752989:0:25343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.752997:0:25343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.753113:0:25343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390822.753165:0:25343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+32:2357:x1875263093932928:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 336us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390822.753172:0:25343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390822.804311:0:25359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093933312 00000100:00100000:3.0:1788390822.804322:0:25359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093933312 00000100:00100000:3.0:1788390822.804382:0:25359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390822.804394:0:25359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+33:19493:x1875263093933312:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788390822.804492:0:25359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.804514:0:25359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.804529:0:25359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.804561:0:25359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.804566:0:25359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.804571:0:25359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805162:0:25359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805174:0:25359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805182:0:25359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390822.805235:0:25359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805248:0:25359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805255:0:25359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805262:0:25359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805269:0:25359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390822.805273:0:25359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805288:0:25359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805303:0:25359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff95d6a35e8c00) 00010000:00010000:3.0:1788390822.805306:0:25359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390822.805312:0:25359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805318:0:25359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34032 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805344:0:25359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805351:0:25359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805357:0:25359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805360:0:25359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390822.805362:0:25359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805366:0:25359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805371:0:25359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff95d6a704cd00) 00010000:00010000:3.0:1788390822.805373:0:25359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390822.805375:0:25359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805385:0:25359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd34039 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805399:0:25359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805402:0:25359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805406:0:25359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805409:0:25359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390822.805411:0:25359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805414:0:25359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805418:0:25359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390822.805419:0:25359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390822.805420:0:25359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.805423:0:25359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34040 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390822.805507:0:25359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+33:19493:x1875263093933312:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1113us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390822.805516:0:25359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390822.835286:0:25357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093933696 00000100:00100000:3.0:1788390822.835298:0:25357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093933696 00000100:00100000:3.0:1788390822.835358:0:25357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788390822.835369:0:25357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+34:19496:x1875263093933696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390822.835403:0:25357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390822.835428:0:25357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34047 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff30c expref: -99 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835511:0:25357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd3404e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835528:0:25357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd3404e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835541:0:25357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0800/0x9aafc5f04cd3404e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835558:0:25357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34055 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835565:0:25357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34055 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.835571:0:25357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd34055 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.836382:0:25357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.836397:0:25357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 35 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.836413:0:25357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.836449:0:25357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 35 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.836462:0:25357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 35 pid: 27233 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390822.836478:0:25357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:25357:1875263103339264:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390822.836588:0:25357:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390822.839520:0:25357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:25357:1875263103339264:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390822.839560:0:25357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390822.840473:0:25360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093933952 00000100:00100000:3.0:1788390822.840482:0:25360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093933952 00000100:00100000:3.0:1788390822.840608:0:25360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390822.840620:0:25360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b55ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:18625:x1875263093933952:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788390822.841463:0:25360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b55ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:18625:x1875263093933952:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 841us (1043us total) trans 12884901954 rc 0/0 00000100:00100000:3.0:1788390822.841474:0:25360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390822.843736:0:25344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093934080 00000100:00100000:3.0:1788390822.843749:0:25344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093934080 00010000:00010000:3.0:1788390822.843801:0:25344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 37 pid: 27233 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390822.843879:0:25344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390822.843898:0:25344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:2356:x1875263093934080:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390822.843918:0:25344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390822.843927:0:25344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 37 pid: 27233 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.843943:0:25344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 37 pid: 27233 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.844000:0:25344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34016 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2fe expref: 37 pid: 27233 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.844025:0:25344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390822.844031:0:25344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.844042:0:25344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.844050:0:25344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390822.844087:0:25344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390822.844145:0:25344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:2356:x1875263093934080:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 255us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390822.844152:0:25344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390823.100303:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093934336 00000100:00100000:3.0:1788390823.100400:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093934336 00000100:00100000:3.0:1788390823.100502:0:27233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390823.100514:0:27233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+35:19537:x1875263093934336:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788390823.100546:0:27233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390823.100574:0:27233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34063 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff313 expref: -99 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.100888:0:27233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.100908:0:27233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff30c expref: 36 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.100918:0:27233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.100987:0:27233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff30c expref: 36 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.101003:0:27233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3405c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff30c expref: 36 pid: 25357 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390823.101019:0:27233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27233:1875263103339392:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390823.101168:0:27233:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390823.104045:0:27233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27233:1875263103339392:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390823.104080:0:27233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.104337:0:27233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.104356:0:27233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390823.104380:0:27233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 0 00010000:00010000:3.0:1788390823.104575:0:27233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34063 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff313 expref: 37 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.104599:0:27233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3406a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff313 expref: 36 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.104609:0:27233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390823.104612:0:27233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390823.104614:0:27233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390823.104643:0:27233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:19537:x1875263093934336:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 4132us (8237us total) trans 12884901955 rc 0/0 00000100:00100000:3.0:1788390823.104651:0:27233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390823.117481:0:25344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093934976 00000100:00100000:3.0:1788390823.117495:0:25344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093934976 00000100:00100000:3.0:1788390823.117584:0:25344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390823.117598:0:25344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:19537:x1875263093934976:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788390823.117621:0:25344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390823.117659:0:25344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd33f1a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2c6 expref: 37 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390823.117683:0:25344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:3.0:1788390823.117689:0:25344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390823.117773:0:25344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:19537:x1875263093934976:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 178us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390823.117781:0:25344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390823.379753:0:26047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103339520 00000100:00100000:3.0:1788390823.379776:0:26047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103339520 00000100:00100000:3.0:1788390823.379875:0:26047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390823.379889:0:26047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103339520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390823.379927:0:26047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390823.382205:0:26047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2304us (7975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390823.382224:0:26047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390824.110037:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093936128 00000100:00100000:3.0:1788390824.110053:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093936128 00000100:00100000:3.0:1788390824.110139:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788390824.110153:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+38:19538:x1875263093936128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390824.110182:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390824.110186:0:25358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390824.110223:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd33fec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff2f0 expref: 38 pid: 25359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.110249:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff95d6a35e8c00) 00010000:00010000:3.0:1788390824.110256:0:25358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390824.110273:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd340c5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff32f expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390824.111206:0:25358:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43:0x0], index 0: 0 00010000:00010000:3.0:1788390824.111506:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd340cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.111533:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd340cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.111548:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd340cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.111626:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd340c5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff32f expref: 40 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.111645:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd340cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff32f expref: 39 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.111654:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:3.0:1788390824.111658:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390824.111661:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788390824.111739:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+39:19538:x1875263093936128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1589us (2897us total) trans 12884901958 rc 0/0 00000100:00100000:3.0:1788390824.111749:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788390824.129875:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390824.150017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390824.166203:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390824.173661:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390824.176562:0:26045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:26045:1875263103340416:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390824.176610:0:26045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd34119 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff352 expref: 8 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.176636:0:26045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:3.0:1788390824.176737:0:26045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+8:19538:x1875263093938176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2819us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.176747:0:26045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390824.179290:0:25343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093938304 00000100:00100000:3.0:1788390824.179303:0:25343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093938304 00010000:00010000:3.0:1788390824.179360:0:25343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff34b expref: 8 pid: 26226 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.179469:0:25343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390824.179481:0:25343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+8:2357:x1875263093938304:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390824.179499:0:25343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390824.179528:0:25343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff34b expref: 8 pid: 26226 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.179546:0:25343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff34b expref: 8 pid: 26226 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.179576:0:25343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff34b expref: 8 pid: 26226 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.179595:0:25343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390824.179601:0:25343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390824.179610:0:25343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd34119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff352 expref: 7 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.179621:0:25343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd34119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff352 expref: 7 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.179688:0:25343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd34119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff352 expref: 7 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.179721:0:25343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:25343:1875263103340544:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390824.179842:0:25343:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6921c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788390824.182311:0:25343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:25343:1875263103340544:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788390824.182342:0:25343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390824.182442:0:25343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2357:x1875263093938304:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2962us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.182455:0:25343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390824.184273:0:27491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093938432 00000100:00100000:3.0:1788390824.184284:0:27491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093938432 00002000:00100000:3.0:1788390824.184352:0:27491:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x43:0x0] (0->1023) req@ffff95d68f5de300 x1875263093938432/t0(0) o4->fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf@192.168.202.1@tcp:440/0 lens 1512/0 e 0 to 0 dl 1788390835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390824.184364:0:27491:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5de300 with x1875263093938432 ext(0->1023) 00002000:00010000:3.0:1788390824.184371:0:27491:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5de300 00000100:00100000:3.0:1788390824.184408:0:27491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788390824.184420:0:27491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2356:x1875263093938432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788390824.185346:0:27491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+9:2356:x1875263093938432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 919us (1129us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788390824.185358:0:27491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00002000:00100000:3.0:1788390824.185368:0:27491:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x43:0x0] (0->1023) req@ffff95d68f5de300 x1875263093938432/t12884901903(0) o4->fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf@192.168.202.1@tcp:440/0 lens 1512/448 e 0 to 0 dl 1788390835 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390824.185391:0:27491:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f5de300 with x1875263093938432 ext(0->1023) 00002000:00010000:3.0:1788390824.185396:0:27491:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f5de300 00000100:00100000:3.0:1788390824.190734:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093938560 00000100:00100000:3.0:1788390824.190748:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093938560 00000100:00100000:3.0:1788390824.190838:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788390824.190850:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+43:19538:x1875263093938560:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788390824.220429:0:26043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103340672 00000100:00100000:3.0:1788390824.220437:0:26043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103340672 00000100:00100000:3.0:1788390824.220509:0:26043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788390824.220523:0:26043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103340672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788390824.220681:0:26043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788390824.220684:0:26043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1788390824 00002000:00010000:3.0:1788390824.220686:0:26043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788390824.220687:0:26043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 1788390824 -> 1788390824 00002000:00010000:3.0:1788390824.220689:0:26043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788390824.220726:0:26043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103340672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (375us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788390824.220731:0:26043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1788390824.220777:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68a7e7800/2, rc 0, transno 12884901904 00000100:00100000:3.0:1788390824.220783:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103340672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788390824.223084:0:26044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093938688 00000100:00100000:3.0:1788390824.223094:0:26044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093938688 00000100:00100000:3.0:1788390824.223148:0:26044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390824.223155:0:26044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+9:2356:x1875263093938688:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788390824.238313:0:26044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2356:x1875263093938688:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 15149us (15345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.238327:0:26044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390824.243786:0:26043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093939072 00000100:00100000:3.0:1788390824.243800:0:26043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093939072 00000100:00100000:3.0:1788390824.243879:0:26043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788390824.243891:0:26043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2357:x1875263093939072:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788390824.244238:0:26043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1788390824.244242:0:26043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 1788390824 -> 1788390822 00002000:00010000:3.0:1788390824.244245:0:26043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb atime from disk: 0 -> 1788390822 00002000:00010000:3.0:1788390824.244248:0:26043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 1788390824 -> 1788390822 00002000:00010000:3.0:1788390824.244251:0:26043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788390824.244319:0:26043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2357:x1875263093939072:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 430us (953us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1788390824.244327:0:26043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788390824.250510:0:25344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093939456 00000100:00100000:3.0:1788390824.250520:0:25344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093939456 00010000:00010000:3.0:1788390824.250564:0:25344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd340ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff336 expref: 19 pid: 25359 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.250604:0:25344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1788390824.250613:0:25344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+19:2356:x1875263093939456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390824.250629:0:25344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390824.250637:0:25344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd340ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff336 expref: 19 pid: 25359 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250671:0:25344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd340ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff336 expref: 19 pid: 25359 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250697:0:25344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd340ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff336 expref: 19 pid: 25359 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250834:0:25344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff95d6a35e8100) 00010000:00010000:3.0:1788390824.250840:0:25344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34127 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250850:0:25344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34127 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250868:0:25344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34127 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.250934:0:25344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390824.251033:0:25344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+18:2356:x1875263093939456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 418us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.251042:0:25344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00010000:00010000:3.0:1788390824.259406:0:26045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259415:0:26045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259442:0:26045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259459:0:26045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259468:0:26045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259475:0:26045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390824.259480:0:26045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259490:0:26045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259502:0:26045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.259511:0:26045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd3412e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.259562:0:26045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2356:x1875263093939584:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5051us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.259571:0:26045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788390824.284568:0:26043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093940352 00000100:00100000:3.0:1788390824.284582:0:26043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093940352 00000100:00100000:3.0:1788390824.284703:0:26043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390824.284721:0:26043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:19537:x1875263093940352:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390824.284735:0:26043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390824.284828:0:26043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff359 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390824.284889:0:26043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43:0x0] initial LVB size: 1024, mtime: 0x6a98ada6, atime: 0x6a98ada6, ctime: 0x6a98ada6, blocks: 0xb 00010000:00010000:3.0:1788390824.284913:0:26043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=641s v=(0 0) 00010000:00010000:3.0:1788390824.284919:0:26043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390824.284930:0:26043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff359 expref: 7 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.284951:0:26043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff359 expref: 7 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.285545:0:26043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00010000:00010000:3.0:1788390824.286790:0:25346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390824.286799:0:25346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd34151 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 25360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.286808:0:25346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390824.286813:0:25346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd34151 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 25360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.286823:0:25346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd34151 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 25360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.286840:0:25346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x8:0x0].0x0 (ffff95d6a0d59200) 00010000:00010000:3.0:1788390824.286843:0:25346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390824.286868:0:25346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd34151 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 25360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.286882:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd34151 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 25360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.286905:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390824.286907:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390824.286909:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390824.296245:0:26044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093940864 00000100:00100000:3.0:1788390824.296258:0:26044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093940864 00000100:00100000:3.0:1788390824.296446:0:26044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390824.296459:0:26044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2358:x1875263093940864:12345-192.168.202.1@tcp:1:lfs.500 00010000:00010000:3.0:1788390824.296519:0:26044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.296539:0:26044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff359 expref: 7 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.296546:0:26044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390824.296550:0:26044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390824.296554:0:26044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.296589:0:26044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff359 expref: 7 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.296601:0:26044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3414a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff359 expref: 7 pid: 26043 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.296633:0:26044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:26044:1875263103341568:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390824.296843:0:26044:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390824.299805:0:26044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:26044:1875263103341568:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390824.299834:0:26044:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300100:0:26044:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300111:0:26044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300144:0:26044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300154:0:26044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300165:0:26044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300181:0:26044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390824.300187:0:26044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300886:0:26044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300908:0:26044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.300917:0:26044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd34158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390824.321360:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093941504 00000100:00100000:3.0:1788390824.321372:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093941504 00000100:00100000:3.0:1788390824.321443:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390824.321456:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+29:19537:x1875263093941504:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390824.321487:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390824.321525:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34166 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff360 expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.321603:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34166 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff360 expref: 30 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.321622:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34166 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff360 expref: 30 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.321645:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390824.321649:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390824.321672:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1e00, rc 0) 00000100:00100000:3.0:1788390824.321753:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+30:19537:x1875263093941504:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.321871:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390824.469321:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093942656 00000100:00100000:3.0:1788390824.469334:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093942656 00000100:00100000:3.0:1788390824.469425:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788390824.469439:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+34:19554:x1875263093942656:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788390824.469467:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390824.469494:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3419e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff375 expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469585:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469602:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469617:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469636:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469643:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.469649:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470525:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470550:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470560:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390824.470604:0:25358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1788390824.470610:0:25358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390824.470632:0:25358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470646:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470708:0:25358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470716:0:25358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470723:0:25358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470730:0:25358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390824.470736:0:25358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470744:0:25358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470759:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff95d6a35e8c00) 00010000:00010000:3.0:1788390824.470768:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390824.470775:0:25358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470782:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd341a5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470805:0:25358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470812:0:25358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470818:0:25358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470824:0:25358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390824.470827:0:25358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470833:0:25358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470840:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff95d6a704cb00) 00010000:00010000:3.0:1788390824.470843:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390824.470846:0:25358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470863:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341ac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470910:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3419e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff375 expref: 36 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470936:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd341b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff375 expref: 35 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390824.470944:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390824.470947:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390824.470950:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788390824.471619:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+35:19554:x1875263093942656:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 2177us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390824.471631:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788390825.310723:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093943680 00000100:00100000:3.0:1788390825.310732:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093943680 00000100:00100000:3.0:1788390825.310798:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390825.310807:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:19555:x1875263093943680:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390825.310835:0:25358:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390825.310997:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:19555:x1875263093943680:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 190us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.311005:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788390825.320208:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093944064 00000100:00100000:3.0:1788390825.320218:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093944064 00000100:00100000:3.0:1788390825.320569:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1788390825.320581:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+36:19555:x1875263093944064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390825.320603:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390825.320622:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd341f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff38a expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320760:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320776:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320787:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390825.320798:0:25358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788390825.320914:0:25358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320923:0:25358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320929:0:25358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320935:0:25358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390825.320940:0:25358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320946:0:25358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.320958:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390825.320995:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390825.321000:0:25358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.321016:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd341f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.321062:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd341f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff38a expref: 38 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.321071:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6a704c100) 00010000:00010000:3.0:1788390825.321074:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390825.321077:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd341f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff38a expref: 38 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.321087:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00100000:3.0:1788390825.321145:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:19555:x1875263093944064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 567us (1043us total) trans 12884901981 rc 301/301 00000100:00100000:3.0:1788390825.321153:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1788390825.325145:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093944192 00000100:00100000:3.0:1788390825.325155:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093944192 00000100:00100000:3.0:1788390825.325248:0:27233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1788390825.325260:0:27233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:19555:x1875263093944192:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390825.325323:0:27233:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390825.325432:0:27233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:19555:x1875263093944192:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 174us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.325441:0:27233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1788390825.338658:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093944832 00000100:00100000:3.0:1788390825.338667:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093944832 00000100:00100000:3.0:1788390825.338718:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788390825.338740:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+37:19555:x1875263093944832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390825.338755:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390825.338776:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3422a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff398 expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338805:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338816:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338827:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338917:0:25358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3422a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 39 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338931:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 38 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.338936:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788390825.338938:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788390825.338941:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390825.339026:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+38:19555:x1875263093944832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 288us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.339032:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788390825.341090:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093945088 00000100:00100000:3.0:1788390825.341099:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093945088 00000100:00100000:3.0:1788390825.345459:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093945216 00000100:00100000:3.0:1788390825.345475:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093945216 00000100:00100000:3.0:1788390825.345517:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1788390825.345524:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+39:19555:x1875263093945216:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390825.345546:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390825.345564:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3423f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff39f expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.345613:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3423f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff39f expref: 40 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.345623:0:25358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd3423f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff39f expref: 40 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.345635:0:25358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788390825.345637:0:25358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390825.345639:0:25358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00100000:3.0:1788390825.345685:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+40:19555:x1875263093945216:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.345690:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1788390825.348118:0:26226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093945344 00000100:00100000:3.0:1788390825.348128:0:26226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093945344 00000100:00100000:3.0:1788390825.348199:0:26226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788390825.348210:0:26226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2356:x1875263093945344:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788390825.348628:0:26226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2356:x1875263093945344:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 419us (719us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788390825.348637:0:26226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788390825.357856:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390825.365516:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093945984 00000100:00100000:3.0:1788390825.365525:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093945984 00000100:00100000:3.0:1788390825.365577:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1788390825.365584:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+41:19555:x1875263093945984:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390825.365601:0:25358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390825.365617:0:25358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34246 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff3a6 expref: -99 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.365674:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3424d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.365685:0:25358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3424d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.365825:0:25358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3424d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390825.369041:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390825.371448:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390825.374239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390825.376653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000020:00080000:3.0:1788390825.409551:0:25397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934679 committed batchid 8589934677 00000020:00080000:3.0:1788390825.409732:0:25397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934677 00000100:00100000:3.0:1788390825.414324:0:26226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093947008 00000100:00100000:3.0:1788390825.414335:0:26226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093947008 00000100:00100000:3.0:1788390825.414439:0:26226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390825.414450:0:26226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+9:2356:x1875263093947008:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788390825.441617:0:26226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2356:x1875263093947008:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 27165us (27433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.441639:0:26226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390825.445810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.447220:0:27233:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390825.447581:0:27233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+19:19555:x1875263093947264:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 851us (1780us total) trans 12884901985 rc 0/0 00000100:00100000:0.0:1788390825.447589:0:27233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1788390825.449362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.449605:0:26044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093947392 00000100:00100000:0.0:1788390825.449615:0:26044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093947392 00000100:00100000:0.0:1788390825.449700:0:26044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788390825.449710:0:26044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2357:x1875263093947392:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788390825.449948:0:26044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:0.0:1788390825.449953:0:26044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 1788390825 -> 1788390822 00002000:00010000:0.0:1788390825.449956:0:26044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 1788390824 00002000:00010000:0.0:1788390825.449996:0:26044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1788390825 -> 1788390822 00002000:00010000:0.0:1788390825.449999:0:26044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788390825.450045:0:26044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+7:2357:x1875263093947392:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 336us (687us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788390825.450052:0:26044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788390825.451679:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093947648 00000100:00100000:0.0:1788390825.451687:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093947648 00000100:00100000:0.0:1788390825.451738:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1788390825.451748:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+18:19555:x1875263093947648:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788390825.451810:0:25358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.451827:0:25358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 18 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.451835:0:25358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.451898:0:25358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 18 pid: 25358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.451912:0:25358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 18 pid: 25358 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390825.451926:0:25358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:25358:1875263103342720:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390825.452033:0:25358:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390825.454359:0:25358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:25358:1875263103342720:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390825.454387:0:25358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390825.456853:0:25344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093947776 00000100:00100000:0.0:1788390825.456863:0:25344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093947776 00010000:00010000:0.0:1788390825.456906:0:25344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 19 pid: 25358 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390825.457082:0:25344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390825.457090:0:25344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+19:2357:x1875263093947776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390825.457104:0:25344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390825.457110:0:25344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 19 pid: 25358 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457121:0:25344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 19 pid: 25358 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457152:0:25344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34231 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff398 expref: 19 pid: 25358 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457168:0:25344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:0.0:1788390825.457171:0:25344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457179:0:25344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457183:0:25344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34269 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 25358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.457201:0:25344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390825.457245:0:25344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+18:2357:x1875263093947776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 156us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390825.457250:0:25344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00010000:00010000:0.0:1788390825.464181:0:26043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464188:0:26043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464206:0:26043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464211:0:26043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464222:0:26043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464226:0:26043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390825.464229:0:26043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464234:0:26043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464242:0:26043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.464247:0:26043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd34270 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390825.464282:0:26043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+6:2356:x1875263093947904:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 3764us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390825.464286:0:26043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788390825.466396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390825.470383:0:25357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f5df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:25357:1875263103342976:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390825.470414:0:25357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390825.471279:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390825.475124:0:25357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.475138:0:25357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390825.475349:0:25357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901986 00000001:00080000:3.0:1788390825.475519:0:25357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901987 00000001:00080000:3.0:1788390825.475562:0:25357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901988 00000100:00100000:3.0:1788390825.475653:0:25357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:25357:1875263103343104:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788390825.475717:0:25357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390825.475774:0:25363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103343104 00000100:00100000:0.0:1788390825.475783:0:25363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103343104 00000100:00100000:0.0:1788390825.475831:0:25363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390825.475840:0:25363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:25357:x1875263103343104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788390825.475891:0:25357:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390825.475938:0:25363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:25357:x1875263103343104:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390825.475955:0:25357:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901895 gen 2 00000004:00080000:3.0:1788390825.475997:0:25357:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68f55ea00, transno 12884901895 00000100:00100000:0.0:1788390825.476000:0:25363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390825.476013:0:25357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:25357:1875263103343104:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788390825.476455:0:25357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901989 00000100:00100000:3.0:1788390825.476499:0:25357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:25357:1875263103343232:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788390825.476527:0:25357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390825.476555:0:25357:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390825.476805:0:25357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:25357:1875263103343232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788390825.476866:0:25357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901990 00010000:00010000:3.0:1788390825.476885:0:25357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476892:0:25357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476898:0:25357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476901:0:25357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390825.476905:0:25357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476909:0:25357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476921:0:25357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788390825.476923:0:25357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390825.476926:0:25357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476930:0:25357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd3427e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476951:0:25357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd341cf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.476955:0:25357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd341cf lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477118:0:25357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd341cf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477121:0:25357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390825.477123:0:25357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd341cf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477127:0:25357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd341cf lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477133:0:25357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704ce00) 00010000:00010000:3.0:1788390825.477135:0:25357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390825.477139:0:25357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd341d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff383 expref: 22 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477147:0:25357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd341d6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff383 expref: 22 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477152:0:25357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd341d6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff383 expref: 22 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390825.477169:0:25357:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd341d6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff383 expref: 22 pid: 25357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390825.477175:0:25357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:25357:1875263103343360:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390825.477224:0:25357:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390825.479595:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.479950:0:25361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093948544 00000100:00100000:0.0:1788390825.479988:0:25361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093948544 00000100:00100000:0.0:1788390825.480054:0:25361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390825.480067:0:25361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+23:19554:x1875263093948544:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:0.0:1788390825.480177:0:25361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+22:19554:x1875263093948544:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 113us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390825.480186:0:25361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390825.484231:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.485512:0:25361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093948800 00000100:00100000:0.0:1788390825.485519:0:25361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093948800 00000100:00100000:0.0:1788390825.485556:0:25361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390825.485565:0:25361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+22:19555:x1875263093948800:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788390825.486556:0:25361:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788390825.486687:0:25361:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901992 00010000:00010000:0.0:1788390825.486735:0:25361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486751:0:25361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486763:0:25361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486771:0:25361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486778:0:25361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486799:0:25361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3428c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 25361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.486879:0:25361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788390825.487057:0:25361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+24:19555:x1875263093948800:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1490us (4655us total) trans 12884901993 rc 0/0 00000100:00100000:0.0:1788390825.487066:0:25361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000020:00080000:0.0:1788390825.487071:0:25361:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788390825.513679:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.513787:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093949184 00000100:00100000:0.0:1788390825.513797:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093949184 00000100:00100000:0.0:1788390825.513870:0:27233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:0.0:1788390825.513881:0:27233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+24:19557:x1875263093949184:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390825.513910:0:27233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390825.513932:0:27233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34293 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff3bb expref: -99 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514036:0:27233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514051:0:27233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514064:0:27233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514079:0:27233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514087:0:27233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514109:0:27233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514346:0:27233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514357:0:27233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd341c1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff37c expref: 25 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514366:0:27233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514402:0:27233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd341c1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff37c expref: 25 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.514418:0:27233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd341c1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff37c expref: 25 pid: 27233 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390825.514435:0:27233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27233:1875263103343488:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390825.514538:0:27233:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390825.517260:0:27233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:27233:1875263103343488:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390825.517290:0:27233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390825.518599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390825.518690:0:28218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093949440 00000100:00100000:0.0:1788390825.518700:0:28218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093949440 00000100:00100000:0.0:1788390825.518863:0:28218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788390825.518874:0:28218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+26:17943:x1875263093949440:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788390825.519138:0:28218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+27:17943:x1875263093949440:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 265us (544us total) trans 12884901994 rc 0/0 00000100:00100000:0.0:1788390825.519146:0:28218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788390825.525065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390825.525774:0:27233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525783:0:27233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390825.525883:0:27233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x5:0x0]: returning size 1024 00000004:00200000:0.0:1788390825.525889:0:27233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390825.525907:0:27233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525919:0:27233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525929:0:27233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525936:0:27233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525943:0:27233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525948:0:27233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390825.525952:0:27233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.525996:0:27233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526013:0:27233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff95d6a35e8c00) 00010000:00010000:0.0:1788390825.526016:0:27233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390825.526020:0:27233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526026:0:27233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd3429a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526036:0:27233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526042:0:27233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526047:0:27233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526052:0:27233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390825.526055:0:27233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526060:0:27233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526065:0:27233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff95d684d23e00) 00010000:00010000:0.0:1788390825.526067:0:27233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390825.526070:0:27233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526076:0:27233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd342a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526117:0:27233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34293 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff3bb expref: 26 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526129:0:27233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd342a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff3bb expref: 25 pid: 27233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390825.526136:0:27233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff95d6a704ce00) 00010000:00010000:0.0:1788390825.526139:0:27233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390825.526141:0:27233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788390825.526177:0:27233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+25:19557:x1875263093949184:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 12298us (12507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390825.526183:0:27233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00010000:00010000:3.0:1788390825.741050:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390826.106773:0:25352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093949696 00000100:00100000:3.0:1788390826.106784:0:25352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093949696 00000100:00100000:3.0:1788390826.106808:0:25352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788390826.106813:0:25352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f014977-8ca7-4b01-b9ef-a08c737bca9d+13:2359:x1875263093949696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390826.106832:0:25352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683f71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f014977-8ca7-4b01-b9ef-a08c737bca9d+13:2359:x1875263093949696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390826.106845:0:25352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390826.112691:0:26044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093950208 00000100:00100000:0.0:1788390826.112703:0:26044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093950208 00000100:00100000:0.0:1788390826.112860:0:26044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093950336 00000100:00100000:0.0:1788390826.112865:0:26044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093950336 00000100:00100000:0.0:1788390826.112904:0:26044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390826.112915:0:26044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e579c24c-cd45-40ac-8da7-a67725133f41+5:2355:x1875263093950208:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1788390826.112944:0:26044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b3f 00000100:00080000:0.0:1788390826.112985:0:26044:0:(import.c:65:import_set_state_nolock()) ffff95d6910f3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390826.113035:0:26044:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901907 00000100:00100000:0.0:1788390826.113264:0:26044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e579c24c-cd45-40ac-8da7-a67725133f41+2:2355:x1875263093950208:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 350us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390826.113272:0:26044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390826.113288:0:26044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788390826.113296:0:26044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e579c24c-cd45-40ac-8da7-a67725133f41+5:2355:x1875263093950336:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1788390826.113318:0:26044:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b46 00000100:00080000:0.0:1788390826.113325:0:26044:0:(import.c:65:import_set_state_nolock()) ffff95d6910f6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390826.113344:0:26044:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:0.0:1788390826.113442:0:26044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e579c24c-cd45-40ac-8da7-a67725133f41+2:2355:x1875263093950336:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 147us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390826.113448:0:26044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788390826.516992:0:25357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093950464 00000100:00100000:3.0:1788390826.517003:0:25357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093950464 00000100:00100000:3.0:1788390826.517079:0:25357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1788390826.517089:0:25357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+26:19570:x1875263093950464:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390826.517125:0:25357:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390826.517223:0:25357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+26:19570:x1875263093950464:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390826.517231:0:25357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1788390826.518396:0:25391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:25391:1875263103343616:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390826.520213:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390826.527084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390826.527127:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000040:00080000:0.0:1788390826.528512:0:25391:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788390826.528516:0:25391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390826.529187:0:25391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 5 00000040:00080000:0.0:1788390826.529196:0:25391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788390826.531418:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390826.531533:0:25361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093951360 00000100:00100000:0.0:1788390826.531543:0:25361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093951360 00000100:00100000:0.0:1788390826.531593:0:25361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788390826.531602:0:25361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b55edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+27:19570:x1875263093951360:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390826.531955:0:25361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b55edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+28:19570:x1875263093951360:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 352us (543us total) trans 12884901997 rc 0/0 00000100:00100000:0.0:1788390826.531988:0:25361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00010000:00010000:3.0:1788390826.765139:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390827.476772:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390827.476793:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103343744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390827.476867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390827.477887:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788390827.665176:0:28307:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788390827.665185:0:28307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390827.665262:0:28307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:3.0:1788390827.665274:0:28307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788390827.805293:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390828.500104:0:26047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103343872 00000100:00100000:0.0:1788390828.500122:0:26047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103343872 00000100:00100000:0.0:1788390828.500214:0:26047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390828.500224:0:26047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103343872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390828.500273:0:26047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390828.500358:0:26047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103343872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (5422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390828.500365:0:26047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00100000:3.0:1788390829.563129:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e579c24c-cd45-40ac-8da7-a67725133f41 00000020:00000080:3.0:1788390829.563135:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6910f2800/e579c24c-cd45-40ac-8da7-a67725133f41 00000001:00080000:3.0:1788390829.563151:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901906 is committed 00000001:00080000:3.0:1788390829.563157:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901907 is committed 00000001:00080000:3.0:1788390829.563161:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901905 is committed 00000020:00000080:3.0:1788390829.563170:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6910f2800/e579c24c-cd45-40ac-8da7-a67725133f41 for lustre-OST0000 00000020:00000080:3.0:1788390829.563202:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6910f3800 for lustre-OST0000 00010000:00010000:3.0:1788390829.837359:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788390830.585177:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d683727540 refcount 2 committed 0 result 0 batchid 8589934680 00000020:00080000:3.0:1788390830.585183:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d683727600 00000020:00080000:3.0:1788390830.585186:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585152c00 00000020:00080000:3.0:1788390830.585208:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934679 batchid updated 00000020:00080000:3.0:1788390830.585222:0:25397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934680 committed batchid 8589934679 00000020:00080000:3.0:1788390830.585471:0:25397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934679 00000100:00100000:3.0:1788390830.587458:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901907 gen 2 00000004:00080000:3.0:1788390830.587465:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901906 committed transno 12884901907 00000004:00080000:3.0:1788390830.587489:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901907 committed transno 12884901907 00000100:00100000:3.0:1788390830.587511:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d6bc68d500 x1875263103344768/t12884901908(12884901908) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788390846 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788390830.587526:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68d500/2, rc 0, transno 12884901908 00000100:00100000:3.0:1788390830.587533:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103344768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788390830.662456:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390830.663124:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390830.665746:0:28218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093952000 00000100:00100000:3.0:1788390830.665755:0:28218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093952000 00000100:00100000:3.0:1788390830.665869:0:28218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390830.665880:0:28218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+16:19410:x1875263093952000:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788390830.666447:0:28218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+17:19410:x1875263093952000:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 567us (796us total) trans 12884901999 rc 0/0 00000100:00100000:3.0:1788390830.666457:0:28218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788390831.222226:0:25350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093952128 00000100:00100000:0.0:1788390831.222243:0:25350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093952128 00000100:00100000:0.0:1788390831.222341:0:25350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788390831.222356:0:25350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f014977-8ca7-4b01-b9ef-a08c737bca9d+13:2359:x1875263093952128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390831.222471:0:25350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683f70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f014977-8ca7-4b01-b9ef-a08c737bca9d+13:2359:x1875263093952128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 117us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390831.222481:0:25350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788390831.222695:0:26226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093952384 00000100:00100000:3.0:1788390831.222700:0:26226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093952384 00000100:00100000:3.0:1788390831.222802:0:26226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093952256 00000100:00100000:3.0:1788390831.222806:0:26226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093952256 00000100:00100000:0.0:1788390831.222836:0:26043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390831.222847:0:26043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2359:x1875263093952384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390831.222886:0:26043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2359:x1875263093952384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390831.222893:0:26043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390831.223197:0:26226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788390831.223207:0:26226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2359:x1875263093952256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390831.223264:0:26226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2359:x1875263093952256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390831.223271:0:26226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000001:02000400:0.0:1788390831.589822:0:28508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1f: Test auto RW-PCC cache with non-root user ========================================================== 19:13:51 (1788390831) 00010000:00010000:3.0:1788390831.885130:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390832.589338:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390832.589357:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103344896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390832.589411:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390832.589665:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103344896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390832.845088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390833.157761:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390833.158122:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390833.160845:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.160938:0:28218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093953152 00000100:00100000:3.0:1788390833.160947:0:28218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093953152 00000100:00100000:3.0:1788390833.161012:0:28218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390833.161021:0:28218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+20:20220:x1875263093953152:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:3.0:1788390833.161448:0:28218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+21:20220:x1875263093953152:12345-192.168.202.1@tcp:35:umount.0 Request processed in 426us (606us total) trans 12884902003 rc 0/0 00000100:00100000:3.0:1788390833.161457:0:28218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788390833.163668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390833.163706:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390833.163746:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390833.165557:0:26043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093953664 00000100:00100000:0.0:1788390833.165563:0:26043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093953664 00000100:00100000:0.0:1788390833.165623:0:26043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788390833.165632:0:26043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2355:x1875263093953664:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:0.0:1788390833.165664:0:26043:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b07 00000100:00080000:0.0:1788390833.165673:0:26043:0:(import.c:65:import_set_state_nolock()) ffff95d587044000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788390833.165798:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1788390833.165993:0:26043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:0.0:1788390833.166503:0:26043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+2:2355:x1875263093953664:12345-192.168.202.1@tcp:9:umount.0 Request processed in 872us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390833.166512:0:26043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788390833.172398:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.172980:0:26226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093953792 00000100:00100000:3.0:1788390833.172989:0:26226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093953792 00000100:00100000:3.0:1788390833.173059:0:26226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788390833.173079:0:26226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+5:2355:x1875263093953792:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:3.0:1788390833.173115:0:26226:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b0e 00000100:00080000:3.0:1788390833.173124:0:26226:0:(import.c:65:import_set_state_nolock()) ffff95d5862b2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390833.173165:0:26226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901908 00000100:00100000:3.0:1788390833.173373:0:26226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+2:2355:x1875263093953792:12345-192.168.202.1@tcp:9:umount.0 Request processed in 295us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390833.173379:0:26226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00010000:00010000:0.0:1788390833.173741:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390833.177438:0:25359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093954944 00000100:00100000:3.0:1788390833.177446:0:25359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093954944 00000100:00100000:3.0:1788390833.177508:0:25359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788390833.177516:0:25359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+21:2355:x1875263093954944:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1788390833.177543:0:25359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b00 00000020:00010000:3.0:1788390833.177554:0:25359:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d5871bb800: total 0 00000100:00080000:3.0:1788390833.177557:0:25359:0:(import.c:65:import_set_state_nolock()) ffff95d5859f7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390833.177580:0:25359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902003 00000100:00100000:3.0:1788390833.177940:0:25359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf+19:2355:x1875263093954944:12345-192.168.202.1@tcp:39:umount.0 Request processed in 423us (573us total) trans 12884902004 rc 0/0 00000100:00100000:3.0:1788390833.177948:0:25359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788390833.613201:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103345024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390833.613261:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103345152:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613276:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390833.613326:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390833.613351:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103345536:0@lo:400:kworker.0 00000100:00100000:0.0:1788390833.613372:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103345664:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390833.613411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390833.613427:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103345280:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613450:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390833.613460:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103345536 00000100:00100000:0.0:1788390833.613465:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103345536 00000100:00100000:3.0:1788390833.613469:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103345792:0@lo:400:kworker.0 00000100:00100000:0.0:1788390833.613502:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103345664 00000100:00100000:3.0:1788390833.613508:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390833.613509:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103345664 00000100:00100000:0.0:1788390833.613538:0:27233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103345792 00000100:00100000:0.0:1788390833.613543:0:27233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103345792 00000100:00100000:3.0:1788390833.613551:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788390833.613566:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390833.613576:0:27233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390833.613590:0:27233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613629:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103345536:12345-0@lo:400:kworker.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390833.613639:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390833.613653:0:27233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103345664:12345-0@lo:400:kworker.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390833.613677:0:27233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788390833.613694:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103345536:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613712:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901897 gen 2 00000004:00080000:3.0:1788390833.613718:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901897 committed transno 12884901897 00000100:00100000:0.0:1788390833.613721:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103345152:0@lo:400:kworker.0 00000100:00100000:0.0:1788390833.613741:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103345664:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613753:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103345024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788390833.613824:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390833.613825:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103345408:0@lo:400:kworker.0 00000100:00080000:3.0:1788390833.613831:0:25353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390833.613860:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103345280:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.613874:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103345792:0@lo:400:kworker.0 00000100:00100000:3.0:1788390833.667219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.667253:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.667421:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.667475:0:25343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390833.667492:0:25343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f014977-8ca7-4b01-b9ef-a08c737bca9d+12:2357:x1875263093955072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390833.667519:0:25343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390833.667546:0:25343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd33b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff161 expref: 12 pid: 25352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390833.667574:0:25343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390833.667719:0:25343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f014977-8ca7-4b01-b9ef-a08c737bca9d+8:2357:x1875263093955072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 231us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390833.667732:0:25343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390833.673724:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390833.673826:0:25358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093955584 00000100:00100000:3.0:1788390833.673836:0:25358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093955584 00000100:00100000:3.0:1788390833.674054:0:25358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:3.0:1788390833.674068:0:25358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e579c24c-cd45-40ac-8da7-a67725133f41+6:2355:x1875263093955584:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1788390833.674113:0:25358:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33b38 00000020:00010000:3.0:1788390833.674120:0:25358:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6910f1800: total 0 00000100:00080000:3.0:1788390833.674125:0:25358:0:(import.c:65:import_set_state_nolock()) ffff95d6910f6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390833.674173:0:25358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902004 00000100:00100000:3.0:1788390833.674424:0:25358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e579c24c-cd45-40ac-8da7-a67725133f41+3:2355:x1875263093955584:12345-192.168.202.1@tcp:39:umount.0 Request processed in 357us (708us total) trans 12884902005 rc 0/0 00000100:00100000:3.0:1788390833.674434:0:25358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000040:00080000:0.0:1788390833.678121:0:25391:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788390833.678130:0:25391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390833.678189:0:25391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:0.0:1788390833.678197:0:25391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788390833.684363:0:25350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093955840 00000100:00100000:0.0:1788390833.684373:0:25350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093955840 00000100:00100000:0.0:1788390833.684428:0:25350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1788390833.684438:0:25350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f014977-8ca7-4b01-b9ef-a08c737bca9d+7:2355:x1875263093955840:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:0.0:1788390833.684483:0:25350:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33add 00000020:00010000:0.0:1788390833.684490:0:25350:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d5862b1800: total 0 00000100:00080000:0.0:1788390833.684495:0:25350:0:(import.c:65:import_set_state_nolock()) ffff95d5862b6000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788390833.684545:0:25346:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d5862b1800: total 0 00010000:00010000:3.0:1788390833.684550:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390833.684566:0:25350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683f72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f014977-8ca7-4b01-b9ef-a08c737bca9d+3:2355:x1875263093955840:12345-192.168.202.1@tcp:251:umount.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390833.684579:0:25350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00010000:00010000:3.0:1788390833.684600:0:25346:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d5862b1800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788390833.684635:0:25346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b64fae00/0x9aafc5f04cd33ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff0f8 expref: 2 pid: 25351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390833.684652:0:25346:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d5862b1800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788390833.684664:0:25346:0:(genops.c:885:class_export_put()) final put ffff95d5862b1800/6f014977-8ca7-4b01-b9ef-a08c737bca9d 00010000:00010000:3.0:1788390833.684678:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390833.684680:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390833.684682:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390833.684688:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5862b1800/6f014977-8ca7-4b01-b9ef-a08c737bca9d for MGS 00000020:00000080:0.0:1788390833.684723:0:19520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5862b6000 for MGS 00010000:00010000:0.0:1788390833.933465:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390834.651405:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103345920:0@lo:39:umount.0 00000100:00100000:3.0:1788390834.651478:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390834.651637:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788390834.651660:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901908 is committed 00000001:00100000:3.0:1788390834.651675:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf 00000020:00000080:3.0:1788390834.651680:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d5862b2800/fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf 00000020:00000080:3.0:1788390834.651707:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5862b2800/fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf for lustre-OST0000 00000020:00000080:3.0:1788390834.651754:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5862b2000 for lustre-OST0000 00000020:00000080:3.0:1788390834.651772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d692dab000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788390834.651817:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d692daa000 for lustre-MDT0000 00000100:00080000:3.0:1788390834.651845:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6b6409800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788390834.651857:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103345920:0@lo:39:umount.0 00010000:00010000:0.0:1788390834.652631:0:25345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390834.652637:0:25345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652652:0:25345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680030000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390834.652656:0:25345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652663:0:25345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390834.652670:0:25345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390834.652675:0:25345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390834.652678:0:25345:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788390834.652693:0:25345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652701:0:25345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390834.652722:0:25345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652733:0:25345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680030000/0x9aafc5f04cd33741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33748 expref: -99 pid: 25339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390834.652735:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29551948-b300-4815-ab9b-c8297c72a286:3287:1875263103346176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390834.652757:0:25345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390834.652776:0:25345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652789:0:25345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc1d52c20) 00000100:00100000:3.0:1788390834.652790:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788390834.652795:0:25345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652824:0:25345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390834.652833:0:25345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390834.652834:0:25343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346176 00000100:00100000:3.0:1788390834.652840:0:25343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346176 10000000:01000000:0.0:1788390834.652842:0:25345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788390834.652845:0:25345:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788390834.652849:0:25345:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788390834.652869:0:25345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652874:0:25345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788390834.652877:0:25343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788390834.652884:0:25345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390834.652892:0:25343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29551948-b300-4815-ab9b-c8297c72a286+18:3287:x1875263103346176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390834.652915:0:25345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd33cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd33cb9 expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390834.652916:0:25343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390834.652930:0:25343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b64fbe00/0x9aafc5f04cd33748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd33741 expref: 18 pid: 25352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390834.652932:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390834.652935:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390834.652938:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390834.652951:0:25343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390834.652951:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103346304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390834.653007:0:25343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29551948-b300-4815-ab9b-c8297c72a286+17:3287:x1875263103346176:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390834.653018:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390834.653027:0:25343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390834.653056:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390834.653064:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103346432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390834.653074:0:25343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346304 00000100:00100000:3.0:1788390834.653078:0:25343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346304 00000100:00100000:0.0:1788390834.653095:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390834.653105:0:25343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346432 00000100:00100000:3.0:1788390834.653108:0:25343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346432 00000100:00100000:0.0:1788390834.653128:0:25342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390834.653139:0:25342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29551948-b300-4815-ab9b-c8297c72a286+18:3288:x1875263103346304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390834.653144:0:25343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788390834.653155:0:25342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788390834.653161:0:25343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29551948-b300-4815-ab9b-c8297c72a286+18:3288:x1875263103346432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390834.653167:0:25342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd339f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd339ef expref: 18 pid: 25351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390834.653171:0:25343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390834.653180:0:25342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390834.653185:0:25343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b64fb600/0x9aafc5f04cd33cb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd33cb2 expref: 17 pid: 25351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390834.653198:0:25343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390834.653217:0:25342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29551948-b300-4815-ab9b-c8297c72a286+16:3288:x1875263103346304:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390834.653225:0:25342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390834.653245:0:25343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29551948-b300-4815-ab9b-c8297c72a286+15:3288:x1875263103346432:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390834.653250:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29551948-b300-4815-ab9b-c8297c72a286:3286:1875263103346560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390834.653261:0:25343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390834.653279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390834.653293:0:25344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346560 00000100:00100000:3.0:1788390834.653298:0:25344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346560 00000100:00100000:0.0:1788390834.653323:0:26045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346688 00000100:00100000:3.0:1788390834.653329:0:25344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390834.653329:0:26045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346688 00000100:00100000:3.0:1788390834.653339:0:25344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29551948-b300-4815-ab9b-c8297c72a286+15:3286:x1875263103346560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390834.653351:0:25344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390834.653363:0:25344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc400/0x9aafc5f04cd3373a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd33733 expref: 15 pid: 25351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390834.653379:0:25344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390834.653379:0:26045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103346816 00000100:00100000:0.0:1788390834.653384:0:26045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103346816 00000100:00100000:3.0:1788390834.653408:0:25344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29551948-b300-4815-ab9b-c8297c72a286+14:3286:x1875263103346560:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390834.653417:0:25344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390834.653417:0:26045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788390834.653431:0:26045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103346688:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788390834.653448:0:26045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd338ad 00000100:00080000:0.0:1788390834.653455:0:26045:0:(import.c:65:import_set_state_nolock()) ffff95d691888800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788390834.653464:0:26226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788390834.653474:0:26226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103346816:12345-0@lo:9:umount.0 00000001:00000004:0.0:1788390834.653482:0:26045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901908 00000020:00000080:3.0:1788390834.653488:0:26226:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd339fd 00000100:00080000:3.0:1788390834.653496:0:26226:0:(import.c:65:import_set_state_nolock()) ffff95d5862b3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390834.653527:0:26226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:3.0:1788390834.653679:0:26226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103346816:12345-0@lo:9:umount.0 Request processed in 206us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390834.653691:0:26226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788390834.653718:0:25346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390834.653739:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:29551948-b300-4815-ab9b-c8297c72a286:3287:1875263103346176:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788390834.653774:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5859f6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1788390834.653779:0:26045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103346688:12345-0@lo:9:umount.0 Request processed in 349us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390834.653791:0:26045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000020:00000080:3.0:1788390834.653818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb30000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788390834.653831:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103346432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390834.653845:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:29551948-b300-4815-ab9b-c8297c72a286:3288:1875263103346304:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788390834.653852:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5859f1000 for lustre-MDT0000 00000020:00000080:3.0:1788390834.653859:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d691c5f000 for lustre-MDT0000 00010000:00010000:0.0:1788390834.653866:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390835.681446:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d587047800/fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf for lustre-OST0001 00000020:00000080:3.0:1788390835.681553:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5862b4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788390835.681859:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d587044000 for lustre-OST0001 00000020:00000080:3.0:1788390835.681865:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5862b3800 for lustre-OST0001 00000020:00080000:0.0:1788390835.687927:0:25397:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d683727540 refcount 1 committed 1 result 0 batchid 8589934680 00000020:00080000:0.0:1788390835.687943:0:25397:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d683727600 00000020:00080000:0.0:1788390835.687946:0:25397:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fc0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585152c00 00000020:00000080:3.0:1788390835.688172:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6910f1800/e579c24c-cd45-40ac-8da7-a67725133f41 for lustre-MDT0000 00000020:00000080:3.0:1788390835.688225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5871bb800/fc72cd4a-f2da-4b40-a5cd-d797cbb84ebf for lustre-MDT0000 00000020:00000080:3.0:1788390835.688257:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6910f6000 for lustre-MDT0000 00000020:00000080:3.0:1788390835.688262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5859f7800 for lustre-MDT0000 00000020:00000080:3.0:1788390835.728126:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69052d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:3.0:1788390835.782842:0:28703:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390835.782851:0:28703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901908 gen 4 00000004:00080000:3.0:1788390835.782874:0:28703:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390835.782877:0:28703:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788390835.783416:0:25379:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788390835.783421:0:25379:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 4 count 2 00000040:00080000:0.0:1788390835.783429:0:25379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 3 count 2 00000100:00080000:3.0:1788390835.783900:0:28703:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390835.783904:0:28703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901897 gen 4 00000004:00080000:3.0:1788390835.784107:0:28703:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390835.784110:0:28703:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788390835.784839:0:25381:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788390835.784843:0:25381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 1 00000040:00080000:0.0:1788390835.784854:0:25381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:3.0:1788390835.829153:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33756 00000020:00000080:3.0:1788390835.829176:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6b640b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390835.830019:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788390835.830455:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3376b 00000020:00000080:3.0:1788390835.830482:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6bcb36000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390835.830494:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788390835.830500:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.830510:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390835.830514:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff95d68a664d28) has no exports 00000020:00000080:0.0:1788390835.830676:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb36000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788390835.830698:0:28703:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788390835.830707:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd337b8 00000020:00000080:3.0:1788390835.830711:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d585123000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390835.830726:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788390835.830730:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.830734:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788390835.830737:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff95d68a8ecd28) has no exports 00000020:00000080:3.0:1788390835.830741:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd337b1 00000020:00000080:3.0:1788390835.830745:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6bc73d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390835.830768:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585123000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788390835.830849:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc73d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788390835.831265:0:28703:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788390835.831270:0:28703:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390835.831274:0:28703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901897 gen 5 00000004:00080000:3.0:1788390835.831280:0:28703:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390835.831282:0:28703:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390835.831322:0:19520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d684547800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788390835.831323:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.831331:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390835.831335:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6a078a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390835.831338:0:28703:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a078a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788390835.831346:0:28703:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390835.831412:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd337a3 00000020:00000080:3.0:1788390835.831417:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6a078b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788390835.831428:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788390835.831432:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.831435:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788390835.831437:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff95d68a8eb370) has no exports 00000020:00000080:3.0:1788390835.831441:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3379c 00000020:00000080:3.0:1788390835.831444:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6bc73b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390835.831492:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a078b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788390835.831503:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc73b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788390835.831793:0:28703:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788390835.831797:0:28703:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390835.831799:0:28703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901908 gen 5 00000004:00080000:3.0:1788390835.831803:0:28703:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390835.831805:0:28703:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390835.831841:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.831846:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390835.831871:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.831874:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390835.831878:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6b640c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390835.831880:0:28703:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788390835.831884:0:28703:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788390835.832187:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33772 00000020:00000080:3.0:1788390835.832192:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6bcb32800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788390835.832196:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788390835.832200:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.832203:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390835.832206:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff95d68a663370) has no exports 00000020:00000080:3.0:1788390835.832224:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.832228:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788390835.832231:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33779 00000020:00000080:3.0:1788390835.832234:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6bcb34800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788390835.832241:0:28703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d58718d800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788390835.832244:0:28703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58718d800 3 00000020:01000004:3.0:1788390835.832247:0:28703:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d58718d800 from lustre-MDT0000 00000020:00000080:3.0:1788390835.832263:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.832267:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788390835.832269:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6b640d800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788390835.832272:0:28703:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788390835.832277:0:28703:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788390835.832304:0:28703:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788390835.832307:0:28703:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788390835.832315:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788390835.832317:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.832320:0:28703:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390835.832326:0:28703:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff95d586ae9800 29551948-b300-4815-ab9b-c8297c72a286 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390835.832331:0:28703:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff95d6bc7599b8) has exports, disconnecting them 00000020:00080000:3.0:1788390835.832336:0:28703:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95d586ae9800), last request at 1788390781 00000020:00000080:3.0:1788390835.832348:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3371e 00000020:00010000:3.0:1788390835.832351:0:28703:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d586ae9800: total 2 00000100:00080000:3.0:1788390835.832355:0:28703:0:(import.c:65:import_set_state_nolock()) ffff95d586aeb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788390835.832375:0:28703:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d586ae9800): rc 0 00000020:00080000:3.0:1788390835.832378:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff95d6bc7599b8) has no exports 00000100:00100000:0.0:1788390835.832516:0:25350:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff95d682f05400:25350] 0 exiting: rc = 1 00000020:00000080:0.0:1788390835.832604:0:19520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f07c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788390835.832612:0:19520:0:(genops.c:885:class_export_put()) final put ffff95d6b640a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390835.832616:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788390835.832624:0:19520:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390835.833126:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb32800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788390835.833132:0:19520:0:(genops.c:885:class_export_put()) final put ffff95d6bcb34000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788390835.833135:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb34000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788390835.833139:0:19520:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788390835.833360:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390835.833365:0:19520:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586ae9800/29551948-b300-4815-ab9b-c8297c72a286 for MGS 00000020:00000080:0.0:1788390835.833396:0:19520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d586aeb000 for MGS 00000100:00100000:3.0:1788390835.833734:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833744:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833768:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833776:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833786:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833797:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833806:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833814:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833822:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833830:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833838:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833847:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833855:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833863:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833872:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833883:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833890:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833900:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833906:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833911:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833916:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833921:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833934:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833939:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833944:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833954:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833986:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833993:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.833999:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834004:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834009:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834016:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834023:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834029:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834035:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834041:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834046:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834051:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834056:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834062:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834068:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834074:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834080:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834086:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834091:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834096:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834101:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834107:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834112:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834118:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834123:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834129:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834134:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834139:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834144:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834150:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834156:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834174:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834181:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834190:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834197:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834205:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834212:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.834219:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788390835.835167:0:28703:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788390835.835172:0:28703:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788390835.835867:0:28703:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6b53e7540 - data ffff95d6b5e74438/ffff95d5871b6800 00000020:01000000:3.0:1788390835.836066:0:28703:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d68a778660 - data ffff95d6b5ee1510/ffff95d68f31a400 00000020:00000080:3.0:1788390835.837094:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33702 00000020:00000080:3.0:1788390835.837101:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d58718c800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788390835.837128:0:28703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d58718d800 from MGS, refs=2 00000020:01000004:3.0:1788390835.837132:0:28703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58718d800 2 00000020:01000004:3.0:1788390835.837135:0:28703:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d58718d800 from MGS 00000020:00000080:0.0:1788390835.837196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58718c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788390835.837716:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390835.837726:0:28703:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788390835.837729:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d58718e000/MGS 00000020:00000080:3.0:1788390835.837732:0:28703:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58718e000/MGS for MGS 00000020:01000000:3.0:1788390835.837739:0:28703:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788390835.837809:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788390835.837812:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390835.837819:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788390835.837825:0:28703:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95d6b640b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390835.837831:0:28703:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff95d5873e99b8) has exports, disconnecting them 00000020:00080000:3.0:1788390835.837837:0:28703:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95d6b640b800), last request at 1788390781 00000020:00000080:3.0:1788390835.837841:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd337f0 00000020:00080000:3.0:1788390835.837855:0:28703:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6b640b800): rc 0 00000020:00000080:3.0:1788390835.837859:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d6b640b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788390835.837922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788390835.842199:0:28703:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788390835.842208:0:28703:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390835.842213:0:28703:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390835.842220:0:28703:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390835.842516:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390835.842525:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788390835.842532:0:28703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58718d800 1 00000020:00000080:0.0:1788390835.842539:0:28703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd336f4 00000020:00000080:0.0:1788390835.842546:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d587188800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788390835.842691:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788390835.842696:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390835.842701:0:28703:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390835.842705:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff95d6bc758000) has no exports 00000020:00000080:0.0:1788390835.866135:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390835.866149:0:28703:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788390835.866154:0:28703:0:(genops.c:885:class_export_put()) final put ffff95d58718c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390835.866159:0:28703:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58718c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788390835.866170:0:28703:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788390835.866334:0:28703:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d58718b000 00000020:01000000:0.0:1788390835.867103:0:28703:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788390835.867108:0:28703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390835.867113:0:28703:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390835.867117:0:28703:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff95d5873ecd28) has no exports 00000100:00100000:3.0:1788390835.867213:0:27233:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff95d5876f6400:27233] 3 exiting: rc = 0 00000100:00100000:3.0:1788390835.867326:0:25358:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff95d584a8dc00:25358] 1 exiting: rc = 0 00000100:00100000:0.0:1788390835.868030:0:25357:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff95d584a8d600:25357] 0 exiting: rc = 1 00000100:00100000:0.0:1788390835.868084:0:25359:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff95d584a8d200:25359] 2 exiting: rc = 0 00000100:00100000:3.0:1788390835.868149:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868159:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868168:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868176:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868185:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868194:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868203:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868211:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868218:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868227:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868232:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868238:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868243:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868249:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868255:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868262:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868270:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868278:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868286:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868294:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868301:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868309:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868317:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868322:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868327:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868332:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868339:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868344:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868351:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868358:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868363:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868369:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868375:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868380:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868385:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868400:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868406:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868414:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868422:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868427:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868433:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868454:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868462:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868467:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868475:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868482:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868494:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868503:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868510:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868517:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868524:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868529:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868534:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868541:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868549:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868557:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868566:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868574:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868582:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868590:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868597:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868606:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868613:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.868621:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.872501:0:28218:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff95d681343e00:28218] 2 exiting: rc = 0 00000100:00100000:0.0:1788390835.872521:0:25361:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95d68a674400:25361] 1 exiting: rc = 0 00000100:00100000:3.0:1788390835.872977:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.872987:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.872993:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873106:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873116:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873132:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873138:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873144:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873149:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873154:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873159:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873164:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873169:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873174:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873180:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873186:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873191:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873195:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873200:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873205:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873211:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873215:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873221:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873226:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873231:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873237:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873243:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873248:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873253:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873258:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873263:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873268:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873273:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873278:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873283:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873288:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873293:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873297:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873302:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873306:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873318:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873323:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873329:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873334:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873339:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873344:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873349:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873354:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873359:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873364:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873368:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873373:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873377:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873382:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873390:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873395:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873400:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873405:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873410:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873415:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873420:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873425:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873429:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.873433:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390835.873868:0:25363:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff95d68a675400:25363] 1 exiting: rc = 0 00000100:00100000:3.0:1788390835.874095:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874104:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874113:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874120:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874130:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874137:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874145:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874153:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874162:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874185:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874193:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874208:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874228:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874236:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874245:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874252:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874260:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874268:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874278:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874290:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874300:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874319:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874326:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874332:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874338:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874368:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874379:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874387:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874396:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874404:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874412:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874421:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874439:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874473:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874483:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874493:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874501:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874511:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874519:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874529:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874543:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874552:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874557:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874563:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874569:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874596:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874611:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874618:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874625:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874633:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874641:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874650:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874671:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874679:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874687:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874695:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874704:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874737:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874757:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874767:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874779:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874791:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874798:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390835.874812:0:28703:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390835.882706:0:25365:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95d68a674a00:25365] 1 exiting: rc = 0 00000100:00100000:0.0:1788390835.883466:0:25366:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95d68a674000:25366] 0 exiting: rc = 1 00000100:00100000:3.0:1788390835.884736:0:25369:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff95d5852ffc00:25369] 1 exiting: rc = 0 00000100:00100000:3.0:1788390835.885521:0:25370:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff95d5852fe000:25370] 0 exiting: rc = 1 00010000:00010000:0.0:1788390835.982671:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390837.007998:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390837.670425:0:28857:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788390837.681225:0:28857:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788390837.681269:0:28857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cddc00/0x9aafc5f04cd33875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3387c expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390837.681281:0:28857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cddc00/0x9aafc5f04cd33875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3387c expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390837.681286:0:28857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cddc00/0x9aafc5f04cd33875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3387c expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390837.681290:0:28857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cddc00/0x9aafc5f04cd33875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3387c expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390837.681319:0:28857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390837.681324:0:28857:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788390837.681347:0:28857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390837.681351:0:28857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788390837.681398:0:28857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788390837.681419:0:28857:0:(import.c:65:import_set_state_nolock()) ffff95d68a92d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788390837.681770:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390837.681781:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:29551948-b300-4815-ab9b-c8297c72a286:3286:1875263103347072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390837.681823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390838.029204:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390838.737693:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103347328:0@lo:400:kworker.0 00000400:00000100:0.0:1788390838.737768:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103347328 offset 0 length 224: 4 00010000:00010000:0.0:1788390839.053191:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390841.101218:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390842.125405:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390842.765259:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390842.765281:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103347456:0@lo:400:kworker.0 00000400:00000100:0.0:1788390842.765347:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103347456 offset 0 length 224: 4 00010000:00010000:0.0:1788390844.173212:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390845.197157:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390847.245165:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788390847.952597:0:28857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390847.952602:0:28857:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390847.952608:0:28857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788390847.952785:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103347584:0@lo:400:kworker.0 00000400:00000100:0.0:1788390847.952831:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103347584 offset 0 length 224: 4 00010000:00010000:3.0:1788390847.953452:0:28857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d683d45600/0x9aafc5f04cd3384b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33852 expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953461:0:28857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d683d45600/0x9aafc5f04cd3384b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd33852 expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953466:0:28857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d683d45600/0x9aafc5f04cd3384b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33852 expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953470:0:28857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d683d45600/0x9aafc5f04cd3384b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33852 expref: -99 pid: 26041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953491:0:28857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390847.953498:0:28857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd33ca4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33cab expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953504:0:28857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd33ca4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd33cab expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953526:0:28857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd33ca4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33cab expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953533:0:28857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d680031000/0x9aafc5f04cd33ca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33cab expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390847.953549:0:28857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788390847.953553:0:28857:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788390847.953574:0:28857:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788390847.953578:0:28857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788390847.953582:0:28857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390847.953587:0:28857:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390847.953591:0:28857:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d5873eb370) has no exports 00000020:00080000:3.0:1788390847.953633:0:28857:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d5873eb370) has no exports 00010000:00010000:0.0:1788390847.955351:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788390847.955520:0:28857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6b53e7000 - data ffff95d6b8f06000/ffff95d683e4e800 00000020:01000000:3.0:1788390847.955735:0:28857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6851dbcc0 - data ffff95d68b06c798/ffff95d683e4fc00 00100000:10000000:3.0:1788390847.969451:0:28857:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788390847.987155:0:28857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd33860 00000020:00000080:0.0:1788390847.987164:0:28857:0:(genops.c:885:class_export_put()) final put ffff95d68a5f8800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788390847.987180:0:28857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d585120000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788390847.987184:0:28857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d585120000 2 00000020:01000004:0.0:1788390847.987187:0:28857:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d585120000 from lustre-OST0000 00000020:00000080:0.0:1788390847.987217:0:28857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390847.987229:0:28857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788390847.987233:0:28857:0:(genops.c:885:class_export_put()) final put ffff95d68a5ff800/lustre-OST0000_UUID 00000020:00000080:0.0:1788390847.987254:0:28857:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5ff800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788390847.987263:0:28857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788390847.987305:0:28857:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788390847.987310:0:28857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788390847.987314:0:28857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390847.987330:0:28857:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390847.987338:0:28857:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95d688579000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390847.987343:0:28857:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff95d68a8e8000) has exports, disconnecting them 00000020:00080000:0.0:1788390847.987349:0:28857:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95d688579000), last request at 1788390789 00000020:00000080:0.0:1788390847.987352:0:28857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3388a 00000020:00080000:0.0:1788390847.987362:0:28857:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d688579000): rc 0 00000020:00000080:0.0:1788390847.987367:0:28857:0:(genops.c:885:class_export_put()) final put ffff95d688579000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788390847.992709:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68a92d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788390847.992718:0:8:0:(genops.c:885:class_export_put()) final put ffff95d691889000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788390847.992722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d691889000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788390847.992734:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788390847.992792:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b640a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788390848.006888:0:28857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390848.006902:0:28857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788390848.007001:0:28857:0:(genops.c:885:class_export_put()) final put ffff95d585121000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788390848.007007:0:28857:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585121000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788390848.007018:0:28857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788390848.007183:0:28857:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d585124000 00000020:02000400:3.0:1788390848.007242:0:28857:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788390848.269101:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390849.470239:0:27172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390849.470247:0:27172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390849.470254:0:27172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d680030400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390849.470257:0:27172:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390849.470265:0:27172:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390849.470273:0:27172:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390849.470279:0:27172:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390849.470282:0:27172:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788390849.470284:0:27172:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788390849.470297:0:27172:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d587582000 00010000:00010000:0.0:1788390849.470306:0:27172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390849.470312:0:27172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d680030400/0x9aafc5f04cd339c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd339cc expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390849.470324:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390849.470326:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390849.470328:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390849.470351:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103347584:0@lo:400:kworker.0 00010000:00010000:3.0:1788390850.317104:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390852.365490:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390853.389455:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390855.438020:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390856.461120:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390858.509205:0:27172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390859.533090:0:25345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390859.661271:0:29009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390859.661277:0:29009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390859.661282:0:29009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788390859.662455:0:29009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd3399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd339a2 expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662471:0:29009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd3399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd339a2 expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662479:0:29009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd3399b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd339a2 expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662486:0:29009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd3399b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd339a2 expref: -99 pid: 26759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662515:0:29009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390859.662522:0:29009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030800/0x9aafc5f04cd33c96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd33c9d expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662557:0:29009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030800/0x9aafc5f04cd33c96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd33c9d expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662564:0:29009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d680030800/0x9aafc5f04cd33c96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33c9d expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662570:0:29009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d680030800/0x9aafc5f04cd33c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd33c9d expref: -99 pid: 25354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390859.662777:0:29009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788390859.662783:0:29009:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788390859.662806:0:29009:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788390859.662810:0:29009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788390859.662815:0:29009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390859.662821:0:29009:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390859.662825:0:29009:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d6913199b8) has no exports 00000020:00080000:0.0:1788390859.662866:0:29009:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d6913199b8) has no exports 00000020:01000000:0.0:1788390859.664514:0:29009:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d588024120 - data ffff95d692757ca8/ffff95d588097000 10000000:01000000:0.0:1788390859.706347:0:25354:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00010000:01000000:0.0:1788390859.710087:0:29009:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788390859.710096:0:29009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390859.710100:0:29009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390859.710132:0:29009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788390859.712296:0:25340:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95d68a657200:25340] 0 exiting: rc = 1 00000100:00100000:0.0:1788390859.712703:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390859.713256:0:27473:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95d584bbba00:27473] 3 exiting: rc = 0 00000100:00100000:0.0:1788390859.713367:0:25342:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95d6a0e07a00:25342] 0 exiting: rc = 1 00000100:00100000:0.0:1788390859.714051:0:25344:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95d6a6973200:25344] 2 exiting: rc = 0 00000020:00000080:0.0:1788390859.717514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584b3e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788390859.732905:0:29009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390859.732922:0:29009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788390859.732936:0:29009:0:(genops.c:885:class_export_put()) final put ffff95d584b3c000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788390859.732940:0:29009:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584b3c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788390859.732947:0:29009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788390859.733149:0:29009:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d584b3f800 00000020:01000000:0.0:1788390859.733169:0:29009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788390859.733172:0:29009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390859.733176:0:29009:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390859.733180:0:29009:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff95d6bc75b370) has no exports 00000020:00000080:0.0:1788390859.733201:0:29009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390859.733206:0:29009:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788390859.733208:0:29009:0:(genops.c:885:class_export_put()) final put ffff95d6b6531800/OSS_uuid 00000020:00000080:0.0:1788390859.733210:0:29009:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6531800/OSS_uuid for OSS 00000020:01000000:0.0:1788390859.733213:0:29009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788390859.733234:0:25353:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788390859.733370:0:26045:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff95d68a4e4e00:26045] 2 exiting: rc = 0 00000100:00100000:3.0:1788390859.734519:0:26226:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff95d6922a9800:26226] 3 exiting: rc = 0 00000100:00100000:3.0:1788390859.734606:0:26043:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff95d6b3364a00:26043] 0 exiting: rc = 1 00000100:00100000:0.0:1788390859.735388:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735396:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735402:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735407:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735412:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735417:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735422:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735426:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735430:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735520:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735526:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735539:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735544:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735549:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735554:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735558:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735563:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735569:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735573:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735586:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735591:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735596:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735600:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735605:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735609:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735614:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735618:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735623:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735627:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735632:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735636:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735643:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735648:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735652:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735656:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735660:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735665:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735669:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735673:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735677:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735682:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735686:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735691:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735695:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735701:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735706:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735710:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735717:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735721:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735726:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735731:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735736:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735741:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735745:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735753:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735758:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735763:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735768:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735773:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735777:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735781:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735786:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735792:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.735796:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738517:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738526:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738561:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738572:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738578:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738583:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738588:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738593:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738598:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738602:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738606:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738611:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738615:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738619:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738623:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738628:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738632:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738636:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738640:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738644:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738653:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738801:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738807:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738812:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738817:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738831:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738835:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738840:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738845:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738850:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738855:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738859:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738864:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738869:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738873:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738877:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738881:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738885:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738889:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738893:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738921:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738927:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738931:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738942:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738948:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738953:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.738958:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739226:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739230:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739234:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739237:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739240:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739244:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739247:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739250:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739253:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739256:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739260:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739262:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739265:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739273:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739276:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739280:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.739283:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390859.740451:0:27491:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff95d6a6b4d400:27491] 3 exiting: rc = 0 00000100:00100000:3.0:1788390859.740656:0:27493:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff95d586676800:27493] 5 exiting: rc = 0 00000100:00100000:0.0:1788390859.741655:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741689:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741697:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741706:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741712:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741719:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741725:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741732:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741761:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741767:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741777:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741783:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741788:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741794:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741846:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741854:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741860:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741866:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741871:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741902:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741907:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741912:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741918:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741924:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741929:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741935:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741941:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741947:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741952:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.741958:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742103:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742115:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742121:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742127:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742134:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742140:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742146:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742152:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742170:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742177:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742183:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742188:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742194:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742199:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742204:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742208:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742212:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742216:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742219:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742223:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742227:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742231:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742235:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742238:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742241:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742245:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742249:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742252:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742256:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742260:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742264:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742268:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742271:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.742275:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390859.749650:0:26051:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95d6af661c00:26051] 0 exiting: rc = 1 00000100:00100000:0.0:1788390859.749879:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749886:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749905:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749912:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749918:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749923:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749929:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749934:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749940:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749947:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.749953:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750155:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750165:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750172:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750177:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750182:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750187:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750192:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750197:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750202:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750208:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750213:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750218:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750226:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750232:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750237:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750242:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750246:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750251:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750257:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750262:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750267:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750272:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750278:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750283:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750288:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750294:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750306:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750311:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750317:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750322:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750327:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750332:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750347:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750353:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750358:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750364:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750368:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750372:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750385:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750391:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750397:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750402:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750407:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750412:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750417:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750422:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750428:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750540:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750549:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750555:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750560:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750564:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.750577:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752720:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752728:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752733:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752740:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752761:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752770:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752776:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752782:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752798:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752804:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752810:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752818:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752824:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752829:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752835:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752841:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752864:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752872:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752878:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752884:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752890:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752897:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752903:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752910:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752916:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752921:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752927:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752934:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.752955:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753041:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753054:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753060:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753067:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753073:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753079:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753086:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753092:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753098:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753105:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753112:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753135:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753147:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753153:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753166:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753171:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753177:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753183:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753189:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753195:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753200:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753206:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753212:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753235:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753243:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753249:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753256:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753262:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753268:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753274:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753280:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753285:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753290:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753296:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390859.753302:0:29009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000004:0.0:1788390874.025452:0:30089:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788390874.025457:0:30089:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788390874.025652:0:30089:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d587662000 00000020:01000004:0.0:1788390874.025669:0:30089:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788390874.025676:0:30089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788390874.025690:0:30089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95d69131cd28) 00000020:00000080:0.0:1788390874.025703:0:30089:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788390874.041344:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788390874.042626:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x37:0x0] (8/32) 00100000:10000000:0.0:1788390874.042948:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788390874.043104:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788390874.043234:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788390874.043286:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788390874.043393:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788390874.043532:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788390874.043618:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788390874.043800:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788390874.044712:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 68: rc = 0 00100000:10000000:0.0:1788390874.044805:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 68: rc = 0 00100000:10000000:0.0:1788390874.045311:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.045552:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:0.0:1788390874.045790:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1788390874.046046:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.046270:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:0.0:1788390874.046514:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.046754:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.047086:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1788390874.047325:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.047579:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1788390874.047821:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:0.0:1788390874.048243:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788390874.048690:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 95: rc = 0 00100000:10000000:0.0:1788390874.049189:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 95: rc = 0 00100000:10000000:0.0:1788390874.049623:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 95: rc = 0 00100000:10000000:0.0:1788390874.049855:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 95: rc = 0 00100000:10000000:0.0:1788390874.050247:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 95: rc = 0 00100000:10000000:0.0:1788390874.050769:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 95: rc = 0 00100000:10000000:0.0:1788390874.051028:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 95: rc = 0 00100000:10000000:0.0:1788390874.051261:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 95: rc = 0 00100000:10000000:0.0:1788390874.051517:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 95: rc = 0 00100000:10000000:0.0:1788390874.051761:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 95: rc = 0 00100000:10000000:0.0:1788390874.052145:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 95: rc = 0 00100000:10000000:0.0:1788390874.052390:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 95: rc = 0 00100000:10000000:0.0:1788390874.052645:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 95: rc = 0 00100000:10000000:0.0:1788390874.052897:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 95: rc = 0 00100000:10000000:0.0:1788390874.053202:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 95: rc = 0 00100000:10000000:0.0:1788390874.053447:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 95: rc = 0 00100000:10000000:0.0:1788390874.053684:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 95: rc = 0 00100000:10000000:0.0:1788390874.053930:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 95: rc = 0 00100000:10000000:0.0:1788390874.054238:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 95: rc = 0 00100000:10000000:0.0:1788390874.054547:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 95: rc = 0 00100000:10000000:0.0:1788390874.054753:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 95: rc = 0 00100000:10000000:0.0:1788390874.054931:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 95: rc = 0 00100000:10000000:0.0:1788390874.055158:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 95: rc = 0 00100000:10000000:0.0:1788390874.055361:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 95: rc = 0 00100000:10000000:0.0:1788390874.055609:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 95: rc = 0 00100000:10000000:0.0:1788390874.055845:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 95: rc = 0 00100000:10000000:0.0:1788390874.056123:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 95: rc = 0 00100000:10000000:0.0:1788390874.056363:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 95: rc = 0 00100000:10000000:0.0:1788390874.056690:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 95: rc = 0 00100000:10000000:0.0:1788390874.056950:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 95: rc = 0 00100000:10000000:0.0:1788390874.057290:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 95: rc = 0 00100000:10000000:0.0:1788390874.057541:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 95: rc = 0 00100000:10000000:0.0:1788390874.057886:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 84: rc = 0 00100000:10000000:0.0:1788390874.058440:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788390874.058613:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 69: rc = 0 00100000:10000000:0.0:1788390874.058791:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788390874.058858:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 69: rc = 0 00100000:10000000:0.0:1788390874.059057:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788390874.059126:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 69: rc = 0 00100000:10000000:0.0:1788390874.059463:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788390874.059536:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 73: rc = 0 00100000:10000000:0.0:1788390874.059710:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788390874.059778:0:30089:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 73: rc = 0 00100000:10000000:0.0:1788390874.059955:0:30089:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00010000:00010000:3.0:1788390874.063603:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.063605:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.063607:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.063927:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.063930:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.063931:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390874.074451:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788390874.077622:0:30098:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00080000:0.0:1788390874.082207:0:30103:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788390874.082670:0:30089:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788390874.082685:0:30089:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:0.0:1788390874.082686:0:30089:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788390874.082709:0:30089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:0.0:1788390874.082717:0:30089:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff95d69131b370) 00000020:00000080:0.0:1788390874.082727:0:30089:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788390874.082794:0:30089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6853bd800@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788390874.082935:0:30089:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:0.0:1788390874.082942:0:30089:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 00000020:00000080:0.0:1788390874.084744:0:30089:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 88fdb212-e2bb-4a0f-abe2-1cb76d00c478) 00000020:00000080:0.0:1788390874.084765:0:30089:0:(genops.c:1385:class_connect()) connect: client 88fdb212-e2bb-4a0f-abe2-1cb76d00c478, cookie 0x9aafc5f04cd34318 00000100:00080000:0.0:1788390874.084778:0:30089:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390874.084784:0:30089:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d6853bd800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390874.084815:0:30089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0c700 x1875263103347968/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390874.084841:0:30089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 88fdb212-e2bb-4a0f-abe2-1cb76d00c478->MGS 00000020:01000004:0.0:1788390874.084861:0:30089:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788390874.084865:0:30089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788390874.084877:0:30089:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95d691318000) 00000020:00000080:0.0:1788390874.084896:0:30089:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788390874.090653:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.090825:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390874.090832:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788390874.091371:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390874.091376:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788390874.091772:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390874.091780:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788390874.092446:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.092613:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788390874.092619:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788390874.093046:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788390874.093053:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788390874.112822:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.113036:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788390874.113043:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788390874.114111:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.114238:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390874.114242:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788390874.115854:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390874.115864:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788390874.116288:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.116423:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788390874.116428:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788390874.116668:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390874.116674:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788390874.127066:0:30089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390874.127285:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788390874.127292:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788390874.128206:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390874.128214:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788390874.128848:0:30089:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390874.128855:0:30089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788390874.129603:0:30089:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788390874.129642:0:30089:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788390874.129648:0:30089:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788390874.129767:0:30089:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390874.129808:0:30089:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788390874.129812:0:30089:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390874.129814:0:30089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390874.129815:0:30089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390874.129816:0:30089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390874.129817:0:30089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390874.129818:0:30089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390874.129819:0:30089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390874.129820:0:30089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390874.129822:0:30089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390874.129824:0:30089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390874.129826:0:30089:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788390874.129828:0:30089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390874.129829:0:30089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390874.129830:0:30089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390874.129831:0:30089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390874.129832:0:30089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390874.129833:0:30089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390874.129834:0:30089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390874.129835:0:30089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390874.129836:0:30089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390874.129837:0:30089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390874.129859:0:30089:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788390874.129876:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390874.129936:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.130008:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df0c0 going to sleep for 11 seconds 20000000:01000000:0.0:1788390874.130717:0:30102:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 11 20000000:01000000:0.0:1788390874.131677:0:30102:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788390874.131685:0:30102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788390874.135082:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390874.135097:0:30089:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788390874.135100:0:30089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390874.135109:0:30089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390874.135110:0:30089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390874.135111:0:30089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390874.135113:0:30089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390874.135114:0:30089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390874.135115:0:30089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390874.135117:0:30089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390874.135118:0:30089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390874.135119:0:30089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390874.135137:0:30089:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d587662000 from lustre-MDT0000 10000000:01000000:0.0:1788390874.135155:0:30089:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788390874.135158:0:30089:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788390874.135162:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d69131b370 10000000:01000000:0.0:1788390874.135167:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390874.135174:0:30089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d69131b370 from 1 10000000:01000000:0.0:1788390874.135177:0:30089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788390874.135227:0:30089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.135239:0:30089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.135249:0:30089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390874.135266:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390874.135294:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.135339:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.135559:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390874.135572:0:30089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.135582:0:30089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390874.135631:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390874.135655:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.135676:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.135929:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348352:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788390874.135955:0:30089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788390874.135995:0:30089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.136004:0:30089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390874.136011:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d587662000 10000000:01000000:0.0:1788390874.136015:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788390874.136020:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d587662000 10000000:01000000:0.0:1788390874.136022:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788390874.136025:0:30089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d587662000 from 1 10000000:01000000:0.0:1788390874.136028:0:30089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788390874.136043:0:30089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.136050:0:30089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.136058:0:30089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390874.136070:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390874.136116:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.136129:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.137835:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390874.137848:0:30089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.137856:0:30089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390874.137870:0:30089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788390874.137881:0:30089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.137885:0:30089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390874.137890:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788390874.137894:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390874.137897:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d587662000 10000000:01000000:0.0:1788390874.137898:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788390874.137901:0:30089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788390874.137903:0:30089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788390874.137918:0:30089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.137925:0:30089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.137933:0:30089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390874.137952:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390874.138001:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.138027:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.138207:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390874.138221:0:30089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.138229:0:30089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390874.138268:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390874.138291:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.138310:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.138714:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390874.138741:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390874.138775:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.138792:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.139220:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103348864:0@lo:503:mount.lustre.0 00000020:00000080:0.0:1788390874.184188:0:30126:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aafc5f04cd34396 00010000:00010000:3.0:1788390874.185150:0:30126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788390874.185593:0:30126:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788390874.185665:0:30126:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788390874.186188:0:30126:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 2, last_idx 3 00000040:00080000:3.0:1788390874.186925:0:30126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390874.187001:0:30126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000040:00080000:3.0:1788390874.187051:0:30126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000040:00080000:3.0:1788390874.187322:0:30130:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:3.0:1788390874.187327:0:30130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788390874.191534:0:30126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390874.191542:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788390874.191565:0:30126:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788390874.191578:0:30126:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd343c0 00000100:00080000:0.0:1788390874.191586:0:30126:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390874.191598:0:30126:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390874.191630:0:30126:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0f100 x1875263103349248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390874.191658:0:30126:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788390874.191707:0:30126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390874.191710:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390874.191712:0:30126:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788390874.191714:0:30126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390874.191717:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390874.191718:0:30126:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390874.191720:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390874.191904:0:30126:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390874.191910:0:30126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390874.191914:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390874.191916:0:30126:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788390874.191918:0:30126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390874.191921:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390874.191922:0:30126:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788390874.191925:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788390874.191955:0:30126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30126:1875263103349376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390874.192027:0:30126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390874.192136:0:30126:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390874.192595:0:30126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30126:1875263103349376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390874.192622:0:30126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390874.192627:0:30126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390874.192629:0:30126:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788390874.192632:0:30126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1788390874.194204:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103349632 00000100:00100000:0.0:1788390874.194209:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103349632 00000100:00100000:0.0:1788390874.194253:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390874.194262:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+10:30089:x1875263103349632:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788390874.194282:0:30102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788390874.194288:0:30102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788390874.194372:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+10:30089:x1875263103349632:12345-0@lo:256:mount.lustre.0 Request processed in 100us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390874.194381:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390874.195505:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103349760 00000100:00100000:3.0:1788390874.195511:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103349760 00000100:00100000:3.0:1788390874.195545:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390874.195555:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+10:30089:x1875263103349760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390874.195563:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390874.195575:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd343d5 expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.195592:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 11 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.195601:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 11 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.195609:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390874.195642:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30089:x1875263103349760:12345-0@lo:101:mount.lustre.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390874.195651:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390874.195842:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103349888 00000100:00100000:0.0:1788390874.195846:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103349888 00000100:00100000:0.0:1788390874.195901:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788390874.195909:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30089:x1875263103349888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390874.196270:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30089:x1875263103349888:12345-0@lo:501:mount.lustre.0 Request processed in 362us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390874.196277:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390874.196770:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103349888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390874.196818:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390874.196861:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.196889:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.197632:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390874.198170:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103350144 00000100:00100000:0.0:1788390874.198177:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103350144 00000100:00100000:0.0:1788390874.198216:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390874.198226:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30134:x1875263103350144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390874.198469:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30134:x1875263103350144:12345-0@lo:502:llog_process_th.0 Request processed in 243us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390874.198476:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:3.0:1788390874.199302:0:30089:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390874.199336:0:30089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390874.199355:0:30089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.199378:0:30089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390874.199448:0:30089:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390874.199452:0:30089:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d587662000 10000000:01000000:3.0:1788390874.199455:0:30089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d587662000 10000000:01000000:3.0:1788390874.199459:0:30089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390874.199465:0:30089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d587662000 from 1 10000000:01000000:3.0:1788390874.199468:0:30089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390874.199495:0:30089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.199503:0:30089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.199512:0:30089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390874.199527:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390874.199573:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.199610:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.200490:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390874.200504:0:30089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.200514:0:30089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390874.200647:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390874.200681:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.200710:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.201105:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390874.201134:0:30089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390874.201173:0:30089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.201199:0:30089:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.201476:0:30089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30089:1875263103350656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390874.201751:0:30135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30135:1875263103350784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390874.201781:0:30135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.201802:0:30135:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.202131:0:30135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30135:1875263103350784:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788390874.202179:0:30135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788390874.202195:0:30135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95d6bc7599b8) 00000020:00000080:3.0:1788390874.202214:0:30135:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788390874.202289:0:30135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d587662000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788390874.202293:0:30135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d587662000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788390874.202296:0:30135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d587662000 4 00010000:00080000:3.0:1788390874.202326:0:30135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d686d5c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390874.204858:0:30135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788390874.205091:0:30135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788390874.205137:0:30135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390874.205155:0:30135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aafc5f04cd343f8 00000100:00080000:3.0:1788390874.205166:0:30135:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390874.205181:0:30135:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d686d5c000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390874.205214:0:30135:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc68ed80 x1875263103350912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390874.205242:0:30135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788390874.205797:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103350912 00000100:00100000:3.0:1788390874.205805:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103350912 00000100:00100000:3.0:1788390874.205836:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390874.205898:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103350912:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788390874.206004:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103350912:12345-0@lo:38:llog_process_th.0 Request processed in 158us (662us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788390874.206012:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390874.207504:0:30135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30135:1875263103351040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390874.207578:0:30135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390874.207626:0:30135:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390874.208025:0:30135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30135:1875263103351040:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788390874.208122:0:30135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788390874.208631:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103351168 00000100:00100000:3.0:1788390874.208636:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103351168 00000100:00100000:3.0:1788390874.208682:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390874.208692:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30089:x1875263103351168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390874.208714:0:30100:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788390874.208728:0:30100:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788390874.240183:0:30100:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390874.240330:0:30100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788390874.244799:0:30090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103351296 00000100:00100000:0.0:1788390874.244814:0:30090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103351296 00000100:00100000:0.0:1788390874.244885:0:30090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390874.244899:0:30090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:30123:x1875263103351296:12345-0@lo:104: 00010000:00010000:0.0:1788390874.244917:0:30090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245072:0:30090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390874.245080:0:30090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:30123:x1875263103351296:12345-0@lo:104: Request processed in 186us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390874.245088:0:30090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390874.245108:0:30123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30123:1875263103351296:0@lo:104: 00010000:00010000:0.0:1788390874.245128:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390874.245137:0:30123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245138:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245159:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390874.245164:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245172:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390874.245179:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390874.245185:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390874.245544:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245553:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390874.245577:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245584:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd343c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343ce expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390874.245610:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390874.245611:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390874.245613:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390874.245793:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103351424 00000100:00100000:3.0:1788390874.245803:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103351424 00010000:00010000:3.0:1788390874.245826:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd343ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd343c7 expref: 13 pid: 30101 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390874.245890:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390874.245899:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+13:3287:x1875263103351424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390874.245911:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390874.245916:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd343ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd343c7 expref: 13 pid: 30101 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.245927:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd343ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd343c7 expref: 13 pid: 30101 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.245940:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd343ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd343c7 expref: 13 pid: 30101 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.245952:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.245979:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788390874.245994:0:30092:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005300419s 00010000:00010000:3.0:1788390874.245998:0:30092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246004:0:30092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246011:0:30092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246026:0:30092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246032:0:30092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390874.246036:0:30092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246043:0:30092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246058:0:30092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd343ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390874.246068:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390874.246114:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:3287:x1875263103351424:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390874.246122:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390874.246154:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103351424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390874.250022:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30089:x1875263103351168:12345-0@lo:253:mount.lustre.0 Request processed in 41259us (41563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390874.250038:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:3.0:1788390874.257729:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.257911:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390874.258219:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.258474:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390874.258752:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.258916:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390874.259554:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.259712:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390874.260063:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.260221:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390874.260543:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390874.260709:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1788390874.277852:0:30089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788390874.278155:0:30148:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788390874.278210:0:30148:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390874.281041:0:30148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788390874.281115:0:30148:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788390874.281119:0:30148:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788390874.282344:0:30089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390874.283310:0:30089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788390874.283838:0:30089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788390874.283869:0:30089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788390874.284337:0:30089:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 2, last_idx 3 00080000:10000000:3.0:1788390874.285259:0:30089:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00000001:00000004:3.0:1788390874.289866:0:30089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00080000:3.0:1788390874.307781:0:30089:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788390874.307823:0:30089:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8581c9f988 00100000:10000000:3.0:1788390874.307830:0:30089:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788390874.308560:0:30089:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390874.308576:0:30089:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390874.308594:0:30089:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788390874.308620:0:30089:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788390875.085133:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390875.280172:0:30144:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788390875.280181:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390875.280515:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:3.0:1788390875.280522:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 10000000:01000000:3.0:1788390875.661031:0:30105:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390875.661039:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d587662000 from 12 10000000:01000000:3.0:1788390875.661043:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390875.661085:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390875.661097:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390875.661118:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390875.661140:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103351552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390875.661201:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390875.661248:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326c000 going to sleep for 11 seconds 00010000:00010000:0.0:1788390876.109267:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788390876.301161:0:30144:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788390876.301170:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390876.301605:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 4 00000040:00080000:3.0:1788390876.301613:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:0.0:1788390876.347542:0:30391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788390877.133165:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390878.162523:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390878.244265:0:30541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390878.244285:0:30541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 11 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390878.244295:0:30541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390878.244347:0:30541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 11 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390878.244372:0:30541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 11 pid: 30101 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390878.244402:0:30541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:30541:1875263103351808:0@lo:104: 00000100:00100000:0.0:1788390878.244469:0:30541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390878.244552:0:30541:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788390878.245021:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390878.245029:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245036:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390878.245041:0:30095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245050:0:30095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390878.245057:0:30095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390878.245063:0:30095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390878.245097:0:30095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245114:0:30095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390878.245138:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245144:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd343d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd343dc expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245160:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390878.245161:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390878.245163:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390878.245184:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103351936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390878.245215:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390878.245269:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103351936 00000100:00100000:3.0:1788390878.245273:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103351936 00010000:00010000:3.0:1788390878.245291:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 12 pid: 30101 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390878.245326:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390878.245333:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:3288:x1875263103351936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390878.245344:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390878.245348:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 12 pid: 30101 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245357:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 12 pid: 30101 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245378:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd343dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd343d5 expref: 12 pid: 30101 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245405:0:30094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245413:0:30094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245427:0:30094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245434:0:30094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245441:0:30094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245447:0:30094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245452:0:30094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390878.245457:0:30094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245463:0:30094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245474:0:30094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6bc79a400/0x9aafc5f04cd34414 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390878.245483:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390878.245510:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:3288:x1875263103351936:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390878.245522:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390878.245555:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103351936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390879.181288:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390879.694693:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390879.694708:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:3289:x1875263103352064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390879.694757:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:3289:x1875263103352064:12345-0@lo:400:kworker.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390879.694765:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390879.694836:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103352064:0@lo:400:kworker.0 00000100:00100000:1.0:1788390879.694881:0:19520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d586481500 x1875263103352192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390879.695614:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103352192:0@lo:38:kworker.0 00000100:00100000:1.0:1788390879.695655:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390880.143669:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103352320 00000100:00100000:1.0:1788390880.143684:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103352320 00000100:00100000:1.0:1788390880.145552:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390880.145568:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+11:30105:x1875263103352320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390880.145584:0:30102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390880.145600:0:30102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34422 expref: -99 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390880.145741:0:30102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 12 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390880.145755:0:30102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 12 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390880.145765:0:30102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390880.145909:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30105:x1875263103352320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (4498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390880.145917:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788390880.146251:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103352448 00000100:00100000:1.0:1788390880.146257:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103352448 00000100:00100000:1.0:1788390880.146292:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390880.146300:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30105:x1875263103352448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390880.146561:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30105:x1875263103352448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390880.146568:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:01000000:1.0:1788390880.149951:0:30105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390880.150013:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390880.150025:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390880.150038:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390880.206172:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788390881.488715:0:30791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788390881.488719:0:30791:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788390881.488828:0:30791:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d6bc63a000 00000020:01000004:0.0:1788390881.488842:0:30791:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788390881.488854:0:30791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788390881.488866:0:30791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d6913199b8) 00000020:00000080:0.0:1788390881.488882:0:30791:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788390881.505563:0:30791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788390881.505846:0:30791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788390881.506789:0:30791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390881.507112:0:30791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788390881.507382:0:30791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:1.0:1788390881.507636:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 657: rc = 0 00100000:10000000:1.0:1788390881.507718:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 657: rc = 0 00100000:10000000:1.0:1788390881.507845:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 657: rc = 0 00100000:10000000:1.0:1788390881.508450:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390881.508643:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 571: rc = 0 00100000:10000000:1.0:1788390881.508886:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390881.509125:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 571: rc = 0 00100000:10000000:1.0:1788390881.509713:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390881.509942:0:30791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 571: rc = 0 00000020:00000080:1.0:1788390881.510507:0:30791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788390881.510515:0:30791:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390881.510536:0:30791:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd34437 00000020:01000004:1.0:1788390881.510544:0:30791:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788390881.510565:0:30791:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390881.510569:0:30791:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390881.510574:0:30791:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788390881.510579:0:30791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788390881.510590:0:30791:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d68a8ecd28) 00000020:00000080:1.0:1788390881.510599:0:30791:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788390881.513369:0:30791:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390881.513549:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390881.513554:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788390881.514190:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390881.514198:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788390881.514558:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788390881.514563:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788390881.516811:0:30791:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390881.517059:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788390881.517065:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788390881.517487:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390881.517494:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788390881.528708:0:30791:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390881.528954:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788390881.529029:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788390881.530292:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788390881.530303:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788390881.530935:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390881.530943:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788390881.533271:0:30791:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390881.533465:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788390881.533470:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788390881.534213:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390881.534221:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788390881.561845:0:30791:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390881.562075:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788390881.562080:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788390881.563056:0:30791:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390881.563062:0:30791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788390881.563329:0:30791:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788390881.563362:0:30791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788390881.563368:0:30791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788390881.570724:0:30791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788390881.570762:0:30791:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788390881.570767:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788390881.570769:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.570774:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.570775:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.570776:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.570777:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.570778:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.570780:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.570781:0:30791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390881.570784:0:30791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788390881.570786:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390881.570787:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.570788:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.570789:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.570790:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.570791:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.570792:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.570793:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.570794:0:30791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390881.570820:0:30791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788390881.570842:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390881.570911:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.571130:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b64059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.579416:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390881.579433:0:30791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788390881.579437:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390881.579438:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.579439:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.579441:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.579442:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.579443:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.579444:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.579446:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.579447:0:30791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390881.579476:0:30791:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d6bc63a000 from lustre-OST0000 10000000:01000000:3.0:1788390881.579506:0:30791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788390881.579510:0:30791:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788390881.579517:0:30791:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d69131b370 local copy 00010000:00010000:3.0:1788390881.579527:0:30791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390881.579780:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.579842:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.579882:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390881.579928:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103352832 00000100:00100000:1.0:1788390881.579936:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103352832 00000100:00100000:1.0:1788390881.580004:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390881.580014:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30791:x1875263103352832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390881.580159:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+12:30791:x1875263103352832:12345-0@lo:501:mount.lustre.0 Request processed in 146us (316us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390881.580166:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788390881.580418:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788390881.580433:0:30791:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390881.580591:0:30791:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390881.580597:0:30791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.580604:0:30791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390881.580813:0:30791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6bc63a000 10000000:01000000:3.0:1788390881.580817:0:30791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390881.580820:0:30791:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d69131b370 10000000:01000000:3.0:1788390881.580822:0:30791:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788390881.580824:0:30791:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d69131b370 from 1 10000000:01000000:3.0:1788390881.580826:0:30791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788390881.580846:0:30791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.580851:0:30791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.580858:0:30791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390881.580873:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390881.580894:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.580916:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.581183:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103352960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390881.581194:0:30791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.581203:0:30791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390881.581217:0:30791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788390881.581228:0:30791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.581235:0:30791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390881.581241:0:30791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788390881.581245:0:30791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390881.581249:0:30791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788390881.581251:0:30791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788390881.581263:0:30791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.581271:0:30791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.581278:0:30791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390881.581296:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390881.581319:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.581421:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390881.581471:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353088 00000100:00100000:1.0:1788390881.581476:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353088 00000100:00100000:3.0:1788390881.581707:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390881.581717:0:30791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.581725:0:30791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390881.582371:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1788390881.583084:0:30791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390881.583280:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788390881.583317:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:3.0:1788390881.583362:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:3.0:1788390881.583399:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:3.0:1788390881.583419:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:3.0:1788390881.583435:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:3.0:1788390881.583458:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:3.0:1788390881.583475:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:3.0:1788390881.583504:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:3.0:1788390881.583529:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:3.0:1788390881.583546:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:3.0:1788390881.583572:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:3.0:1788390881.583626:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:3.0:1788390881.583632:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:3.0:1788390881.583685:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.583733:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.583773:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390881.583810:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353216 00000100:00100000:0.0:1788390881.583832:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353216 00000100:00100000:0.0:1788390881.583880:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788390881.583889:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:30791:x1875263103353216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390881.584187:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:30791:x1875263103353216:12345-0@lo:501:mount.lustre.0 Request processed in 299us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390881.584195:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390881.584413:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.584443:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390881.584582:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.584678:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.585068:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353344:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390881.585750:0:30791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390881.585796:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390881.585826:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.585852:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390881.585878:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353472 00000100:00100000:1.0:1788390881.585883:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353472 00000100:00100000:1.0:1788390881.585911:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788390881.585917:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:30791:x1875263103353472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390881.586093:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:30791:x1875263103353472:12345-0@lo:502:mount.lustre.0 Request processed in 174us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390881.586100:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390881.586116:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390881.586323:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788390881.586512:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:3.0:1788390881.586540:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:3.0:1788390881.586567:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:3.0:1788390881.586600:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:3.0:1788390881.586675:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:3.0:1788390881.586704:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:3.0:1788390881.586722:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:3.0:1788390881.586750:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:3.0:1788390881.586784:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:3.0:1788390881.586804:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:3.0:1788390881.586826:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:3.0:1788390881.586845:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390881.586872:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.586896:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.587539:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390881.587596:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:3.0:1788390881.587606:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788390881.588314:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390881.588323:0:30806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788390881.588328:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.588330:0:30806:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788390881.588349:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390881.588363:0:30806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d6bc75b370) 00000020:00000080:3.0:1788390881.588383:0:30806:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788390881.588388:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390881.588458:0:30806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bc63a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788390881.588533:0:30806:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390881.588541:0:30806:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd34468 00010000:00010000:3.0:1788390881.591602:0:30806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788390881.592731:0:30806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901908 00080000:10000000:3.0:1788390881.594085:0:30806:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:3.0:1788390881.595384:0:30806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788390881.595398:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390881.595699:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595703:0:30806:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788390881.595708:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390881.595711:0:30806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788390881.595712:0:30806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390881.595714:0:30806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390881.595715:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390881.595718:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595719:0:30806:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390881.595722:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390881.595725:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595727:0:30806:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390881.595729:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390881.595731:0:30806:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390881.595733:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390881.595741:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595742:0:30806:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390881.595745:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390881.595748:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595749:0:30806:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390881.595752:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788390881.595802:0:30806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390881.595805:0:30806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390881.595806:0:30806:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390881.595809:0:30806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:1.0:1788390881.596021:0:30791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788390881.596051:0:30791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788390881.596110:0:30791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.596122:0:30791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390881.596131:0:30791:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bc63a000 from 1 10000000:01000000:1.0:1788390881.596188:0:30791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390881.596226:0:30791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.596235:0:30791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.596245:0:30791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390881.596269:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103353728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390881.596346:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390881.596489:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.596606:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353728 00000100:00100000:3.0:1788390881.596613:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353728 00000100:00100000:3.0:1788390881.596719:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390881.596730:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:30791:x1875263103353728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390881.596742:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390881.596755:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3446f expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.596777:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 15 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.596787:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 15 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.596796:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390881.596874:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103353728:12345-0@lo:101:mount.lustre.0 Request processed in 146us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390881.596880:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788390881.601597:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353856 00000100:00100000:3.0:1788390881.601605:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353856 00000100:00100000:3.0:1788390881.601760:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788390881.601777:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103353856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.602064:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103353856:12345-0@lo:501:mount.lustre.0 Request processed in 288us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390881.602072:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390881.602266:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103353984 00000100:00100000:1.0:1788390881.602270:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103353984 00000100:00100000:1.0:1788390881.602300:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390881.602308:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103353984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390881.602507:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103353984:12345-0@lo:503:mount.lustre.0 Request processed in 200us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390881.602514:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788390881.602990:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103354112 00000100:00100000:3.0:1788390881.602994:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103354112 00000100:00100000:3.0:1788390881.603016:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788390881.603023:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103354112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390881.603157:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103354112:12345-0@lo:502:mount.lustre.0 Request processed in 133us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390881.603164:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390881.603740:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103354240 00000100:00100000:1.0:1788390881.603744:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103354240 00000100:00100000:1.0:1788390881.603769:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390881.603776:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103354240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390881.604185:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103354240:12345-0@lo:502:mount.lustre.0 Request processed in 408us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390881.604193:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000020:01000000:1.0:1788390881.604932:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390881.604939:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.604941:0:30810:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390881.604946:0:30810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bc63a000 00000020:00000080:1.0:1788390881.604947:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390881.604953:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390881.604954:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.604955:0:30810:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390881.604957:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390881.605033:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.605035:0:30810:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390881.605040:0:30810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bc63a000 00000020:00000080:1.0:1788390881.605043:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390881.605097:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390881.605101:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.605102:0:30810:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390881.605105:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390881.605107:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.605108:0:30810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390881.605112:0:30810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6bc63a000 00000020:00000080:1.0:1788390881.605121:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390881.605167:0:30810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390881.605170:0:30810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390881.605171:0:30810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390881.605173:0:30810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000020:01000000:3.0:1788390881.605431:0:30791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390881.605452:0:30791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390881.605474:0:30791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.605485:0:30791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390881.605530:0:30791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390881.605533:0:30791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6bc63a000 10000000:01000000:3.0:1788390881.605536:0:30791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6bc63a000 10000000:01000000:3.0:1788390881.605540:0:30791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390881.605545:0:30791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6bc63a000 from 1 10000000:01000000:3.0:1788390881.605548:0:30791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390881.605671:0:30791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.605680:0:30791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.605696:0:30791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390881.605716:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390881.605765:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.605801:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390881.608420:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103354368 00000100:00100000:1.0:1788390881.608436:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103354368 00000100:00100000:1.0:1788390881.608493:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390881.608503:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30791:x1875263103354368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390881.608522:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390881.608541:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63600/0x9aafc5f04cd34484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3447d expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.608571:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63600/0x9aafc5f04cd34484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3447d expref: 16 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.608584:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63600/0x9aafc5f04cd34484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3447d expref: 16 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.608594:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390881.608689:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30791:x1875263103354368:12345-0@lo:101:mount.lustre.0 Request processed in 188us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390881.608695:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788390881.608707:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390881.608726:0:30791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.608735:0:30791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390881.609325:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:3.0:1788390881.609653:0:30791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390881.609901:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788390881.609944:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:3.0:1788390881.610014:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:3.0:1788390881.610065:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:3.0:1788390881.610104:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:3.0:1788390881.610150:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:3.0:1788390881.610187:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:3.0:1788390881.610222:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:3.0:1788390881.610270:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788390881.610307:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:3.0:1788390881.610354:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:3.0:1788390881.610401:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:3.0:1788390881.610436:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:3.0:1788390881.610481:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:3.0:1788390881.610528:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:3.0:1788390881.610565:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:3.0:1788390881.610598:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:3.0:1788390881.610642:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:3.0:1788390881.610691:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:3.0:1788390881.610725:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:3.0:1788390881.610784:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:3.0:1788390881.610819:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:3.0:1788390881.610850:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:3.0:1788390881.610891:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:3.0:1788390881.610922:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:3.0:1788390881.610954:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:3.0:1788390881.611273:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:3.0:1788390881.611310:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:3.0:1788390881.611354:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:3.0:1788390881.611411:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:3.0:1788390881.611449:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:3.0:1788390881.611483:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:3.0:1788390881.611515:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:3.0:1788390881.611560:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:3.0:1788390881.611608:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:3.0:1788390881.611657:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:3.0:1788390881.611694:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:3.0:1788390881.611727:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:3.0:1788390881.611771:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:3.0:1788390881.611805:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:3.0:1788390881.611890:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:3.0:1788390881.611898:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:3.0:1788390881.612010:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.612070:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.612107:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.612382:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390881.612409:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390881.612442:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.612505:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.612785:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354624:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390881.613257:0:30791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390881.613304:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390881.613346:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.613368:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.613682:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390881.613880:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:3.0:1788390881.613921:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:3.0:1788390881.613951:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:3.0:1788390881.614072:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:3.0:1788390881.614108:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:3.0:1788390881.614280:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:3.0:1788390881.614354:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:3.0:1788390881.614389:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:3.0:1788390881.614436:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1788390881.614473:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:3.0:1788390881.614508:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:3.0:1788390881.614555:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:3.0:1788390881.614589:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:3.0:1788390881.614623:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:3.0:1788390881.614669:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:3.0:1788390881.614706:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:3.0:1788390881.614739:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:3.0:1788390881.614793:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:3.0:1788390881.614833:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:3.0:1788390881.614865:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:3.0:1788390881.614910:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:3.0:1788390881.614945:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:3.0:1788390881.615075:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:3.0:1788390881.615124:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:3.0:1788390881.615159:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:3.0:1788390881.615194:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:3.0:1788390881.615241:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:3.0:1788390881.615278:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:3.0:1788390881.615312:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:3.0:1788390881.615377:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:3.0:1788390881.615415:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:3.0:1788390881.615448:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:3.0:1788390881.615481:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:3.0:1788390881.615527:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:3.0:1788390881.615564:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:3.0:1788390881.615624:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:3.0:1788390881.615661:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:3.0:1788390881.615695:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:3.0:1788390881.615759:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:3.0:1788390881.615796:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:3.0:1788390881.615838:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390881.615899:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.615930:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390881.618850:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103354880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390881.618953:0:30791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:3.0:1788390881.618985:0:30791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788390881.620876:0:30815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788390881.620891:0:30815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d6bc75cd28) 00000020:00000080:3.0:1788390881.620914:0:30815:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788390881.621015:0:30815:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bc63a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390881.621020:0:30815:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6bc63a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390881.621023:0:30815:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bc63a000 3 00010000:00080000:3.0:1788390881.621057:0:30815:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d69188a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390881.622708:0:30815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788390881.622927:0:30815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788390881.622975:0:30815:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390881.622987:0:30815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd34492 00000100:00080000:3.0:1788390881.622996:0:30815:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390881.623002:0:30815:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d69188a800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390881.623036:0:30815:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc68e300 x1875263103355008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390881.623064:0:30815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788390881.623277:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355008 00000100:00100000:3.0:1788390881.623285:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355008 00000100:00100000:3.0:1788390881.623321:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390881.623330:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103355008:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788390881.623364:0:30108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:3.0:1788390881.623399:0:30108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd34499 00000004:00100000:3.0:1788390881.623417:0:30108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788390881.623448:0:30108:0:(import.c:65:import_set_state_nolock()) ffff95d587043000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390881.623508:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103355008:12345-0@lo:38:llog_process_th.0 Request processed in 177us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390881.623521:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788390881.624188:0:30815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000020:01000000:3.0:1788390881.625882:0:30791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788390881.625921:0:30791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390881.625943:0:30791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390881.625975:0:30791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788390881.626022:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788390881.626024:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.626026:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.626028:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.626029:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.626031:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.626032:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.626034:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.626036:0:30791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390881.626039:0:30791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788390881.626042:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390881.626043:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.626045:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.626046:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.626047:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.626048:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.626049:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.626051:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.626052:0:30791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390881.626071:0:30791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788390881.626086:0:30791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103355264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390881.626140:0:30791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.626176:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355264 00000100:00100000:3.0:1788390881.626182:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355264 00000100:00100000:3.0:1788390881.626218:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788390881.626226:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30791:x1875263103355264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390881.626249:0:30101:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788390881.626262:0:30101:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788390881.626596:0:30791:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299d80 going to sleep for 11 seconds 20000000:01000000:0.0:1788390881.641688:0:30101:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390881.641705:0:30101:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788390881.641919:0:30090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355392 00000100:00100000:0.0:1788390881.641927:0:30090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355392 00000100:00100000:0.0:1788390881.641989:0:30090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390881.642000:0:30090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:30123:x1875263103355392:12345-0@lo:104: 00010000:00010000:0.0:1788390881.642013:0:30090:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390881.642089:0:30090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390881.642096:0:30090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:30123:x1875263103355392:12345-0@lo:104: Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390881.642104:0:30090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788390881.642109:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390881.642115:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642124:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390881.642128:0:30095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642147:0:30095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390881.642155:0:30095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390881.642161:0:30095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788390881.642188:0:30095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642194:0:30095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390881.642211:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642218:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3440d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390881.642218:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103355520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390881.642234:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390881.642236:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390881.642239:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390881.642246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390881.642361:0:30123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30123:1875263103355392:0@lo:104: 00010000:00010000:3.0:1788390881.642385:0:30123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390881.642539:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355520 00000100:00100000:1.0:1788390881.642544:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355520 00010000:00010000:1.0:1788390881.642561:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd3440d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34406 expref: 17 pid: 30101 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390881.642670:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390881.642678:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:3287:x1875263103355520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390881.642688:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390881.642693:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd3440d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34406 expref: 17 pid: 30101 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642708:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd3440d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34406 expref: 17 pid: 30101 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642721:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd3440d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34406 expref: 17 pid: 30101 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642733:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642741:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788390881.642752:0:30092:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005300419s 00010000:00010000:1.0:1788390881.642756:0:30092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642763:0:30092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642770:0:30092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642776:0:30092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642781:0:30092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390881.642785:0:30092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642792:0:30092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642815:0:30092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a92400/0x9aafc5f04cd344a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390881.642825:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390881.642859:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:3287:x1875263103355520:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390881.642867:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390881.642945:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103355520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390881.646101:0:30791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30791:1875263103355264:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390881.646117:0:30791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788390881.646121:0:30791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390881.646122:0:30791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788390881.646123:0:30791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390881.646124:0:30791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390881.646125:0:30791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390881.646126:0:30791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390881.646128:0:30791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390881.646129:0:30791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390881.646130:0:30791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788390881.646144:0:30791:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390881.646510:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390881.646669:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390881.646864:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390881.647030:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390881.647176:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390881.647343:0:30791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788390881.648294:0:30791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 10000000:01000000:3.0:1788390882.768270:0:30105:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390882.768281:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d587662000 from 13 10000000:01000000:3.0:1788390882.768289:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390882.768360:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390882.768377:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390882.768392:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390882.768447:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103355648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390882.768539:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390882.768610:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390882.768685:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355648 00000100:00100000:0.0:1788390882.768696:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355648 00000100:00100000:0.0:1788390882.768768:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788390882.768780:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:30105:x1875263103355648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390882.768807:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390882.768824:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd344a7 expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390882.768854:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd344a7 expref: 16 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390882.768867:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd344a7 expref: 16 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390882.768878:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788390882.768926:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30105:x1875263103355648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390882.768933:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390882.769122:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103355648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390882.769140:0:30105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd344ae expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390882.769152:0:30105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd344ae expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390882.769209:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103355776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390882.769247:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390882.769273:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390882.770055:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355776 00000100:00100000:0.0:1788390882.770067:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355776 00000100:00100000:0.0:1788390882.770118:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390882.770140:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30105:x1875263103355776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390882.770167:0:30101:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390882.770186:0:30101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390882.770189:0:30101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788390882.770310:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30105:x1875263103355776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390882.770319:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390882.770598:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103355776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390882.770680:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390882.770691:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd344ae expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390882.770702:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd344a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd344ae expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390883.280079:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390884.686711:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390874/real 1788390874] req@ffff95d584a0f100 x1875263103349248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.686745:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d584a0f100 x1875263103349248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390884 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.686770:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390874/real 1788390874] req@ffff95d586480700 x1875263103349120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.686783:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d586480700 x1875263103349120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390884 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788390884.686802:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390884.686827:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788390884.686831:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103349248:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788390884.686838:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390884.686842:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788390884.686846:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103349120:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788390884.686983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390884.686987:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788390884.686990:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390884.686995:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:0.0:1788390884.687000:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788390884.687007:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6bbee5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390884.687027:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0ea00 x1875263103356032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788390884.687041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390884.687044:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390884.687046:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390884.687049:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:0.0:1788390884.687052:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788390884.687055:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390884.687066:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0c000 x1875263103356160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390884.687115:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103356416:0@lo:400:kworker.0 00000100:00100000:0.0:1788390884.687182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.687318:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103356288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687351:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.687385:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390884.687390:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687415:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.687446:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356416 00000100:00100000:3.0:1788390884.687452:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356416 00000100:00100000:3.0:1788390884.687513:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356288 00000100:00100000:3.0:1788390884.687516:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356288 00000100:00100000:3.0:1788390884.687537:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390884.687546:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103356416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687598:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103356416:12345-0@lo:400:kworker.0 Request processed in 52us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390884.687605:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390884.687628:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390884.687634:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103356288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687665:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103356288:12345-0@lo:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390884.687672:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390884.687689:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103355904 00000100:00100000:3.0:1788390884.687692:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103355904 00000100:00100000:3.0:1788390884.687717:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788390884.687724:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:3289:x1875263103355904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687753:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:3289:x1875263103355904:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390884.687759:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788390884.687880:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d584a0f100 x1875263103356416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.687893:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103356416:0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687920:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103355904:0@lo:400:kworker.0 00010000:00080000:3.0:1788390884.687931:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d584a0ca80 x1875263103356288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.687939:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103356288:0@lo:400:kworker.0 00000100:00100000:3.0:1788390884.687956:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103356032:0@lo:8:kworker.0 00000100:00100000:3.0:1788390884.688019:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.688038:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103356160:0@lo:8:kworker.0 00000100:00100000:3.0:1788390884.688062:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390884.688199:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356032 00000100:00100000:1.0:1788390884.688204:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356032 00000100:00100000:1.0:1788390884.688222:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356160 00000100:00100000:1.0:1788390884.688225:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356160 00000100:00100000:1.0:1788390884.688236:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390884.688242:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103356032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788390884.688263:0:30793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:1.0:1788390884.688293:0:30793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd344b5 00002000:00100000:1.0:1788390884.688318:0:30793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d587f63800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788390884.688324:0:30793:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788390884.688327:0:30793:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390884.688690:0:30793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390884.688716:0:30793:0:(import.c:65:import_set_state_nolock()) ffff95d587f66000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390884.688763:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103356032:12345-0@lo:8:kworker.0 Request processed in 520us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390884.688771:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390884.688787:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390884.688801:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103356160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788390884.688811:0:30793:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788390884.690447:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d584a0ea00 x1875263103356032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.690476:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390884.690488:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1788390884.690496:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788390884.690502:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788390884.690505:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788390884.690526:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788390884.690533:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103356032:0@lo:8:kworker.0 00000004:00080000:3.0:1788390884.690604:0:30131:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x43:0x0] 00000100:00100000:3.0:1788390884.690625:0:30131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30131:1875263103356672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788390884.690681:0:30131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.690705:0:30131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b64050c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788390884.690743:0:30130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 5 count 2 00000040:00080000:3.0:1788390884.690812:0:30130:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390884.690816:0:30130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000004:00080000:3.0:1788390884.690850:0:30130:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390884.691128:0:30130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701798166193ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788390884.691453:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390884.691488:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.691523:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103356800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788390884.691546:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390884.691588:0:30795:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788390884.691596:0:30795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788390884.691762:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356672 00000100:00100000:3.0:1788390884.691770:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356672 00000100:00100000:3.0:1788390884.691806:0:30795:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788390884.691812:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356800 00000100:00100000:3.0:1788390884.691821:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356800 00000100:00100000:3.0:1788390884.691893:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390884.691903:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:30131:x1875263103356672:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788390884.695420:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390884.695431:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390884.695526:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356544 00000100:00100000:0.0:1788390884.695539:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356544 00000100:00100000:0.0:1788390884.695587:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390884.695598:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103356544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390884.695635:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390884.695717:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103356544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390884.695724:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788390884.696341:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc68ea00 x1875263103356544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390884.696365:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390884.708707:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103356160:12345-0@lo:8:kworker.0 Request processed in 19899us (20638us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390884.708720:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390884.708748:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390884.708759:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103356800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788390884.708787:0:30793:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:67 count 1 00000100:00100000:1.0:1788390884.709400:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103356800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 643us (17851us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390884.709408:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788390884.710591:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390884.710600:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390884.710605:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103356160:0@lo:8:kworker.0 00000004:00080000:3.0:1788390884.710648:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc68f480, transno 0 00000004:00080000:3.0:1788390884.710654:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68f480/1, rc -2, transno 0 00000100:00100000:3.0:1788390884.710667:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103356800:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1788390884.711987:0:30130:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1788390884.712035:0:30130:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00010000:00010000:3.0:1788390884.718985:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390884.725792:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390884.725800:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd344e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.725807:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390884.725811:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd344e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.725821:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd344e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.725853:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd344e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.725860:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd344e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.726111:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390884.726116:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd344ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.726123:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390884.726126:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd344ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.726132:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd344ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.726142:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd344ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390884.726148:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390884.726149:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390884.726151:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.727769:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.730273:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390884.730279:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.730287:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390884.730291:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.730300:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34502 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.730325:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34502 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.730332:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34502 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.730351:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.730353:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.730355:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.731090:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390884.731095:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.731103:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390884.731107:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.731115:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.731125:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34509 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.731131:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34509 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390884.731144:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.731146:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390884.731147:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390884.733387:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.734652:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.735279:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390884.735284:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd3452c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.735292:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390884.735295:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd3452c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.735313:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd3452c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.735330:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd3452c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.735337:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd3452c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.735363:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.735365:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.735367:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.737327:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.738463:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390884.738470:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd34548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.738479:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390884.738483:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd34548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.738492:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd34548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.738506:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd34548 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.738513:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd34548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.738528:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.738530:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.738531:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.739294:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390884.739300:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd3454f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.739325:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390884.739328:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd3454f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.739337:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd3454f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.739349:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd3454f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.739356:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd3454f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.739370:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.739372:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.739373:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.739995:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390884.740000:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd34556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740008:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390884.740011:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd34556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740020:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd34556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740037:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd34556 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740045:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd34556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740058:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.740060:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.740061:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.740101:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390884.740105:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd3455d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740112:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390884.740116:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd3455d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740123:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd3455d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740133:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd3455d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740140:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd3455d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390884.740162:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.740164:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390884.740166:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390884.745190:0:30131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30131:1875263103356672:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788390884.745213:0:30131:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x61:0x0] from OST, last_created [0x240000400:0x61:0x0]last_used is [0x240000400:0x43:0x0] 00000100:00100000:3.0:1788390884.745257:0:30131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30131:1875263103356928:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788390884.745293:0:30131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788390884.745466:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390884.746193:0:30131:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68451c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390884.746264:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103356928 00000100:00100000:3.0:1788390884.746271:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103356928 00000100:00100000:3.0:1788390884.746325:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390884.746334:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:30131:x1875263103356928:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788390884.746370:0:30795:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 98 00000004:00080000:3.0:1788390884.748876:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788390884.753040:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:30131:x1875263103356928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6701us (7740us total) trans 17179869185 rc 0/0 00000100:00100000:3.0:1788390884.753053:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390884.753536:0:30131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:30131:1875263103356928:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788390884.753553:0:30131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x61:0x0]-[0x240000400:0x81:0x0] 00010000:00010000:0.0:1788390886.352835:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390886.541402:0:30144:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788390886.541411:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390886.541595:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 2 00000040:00080000:0.0:1788390886.541602:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:00100000:1.0:1788390886.966516:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788390886.966584:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869185 is committed 00010000:00010000:3.0:1788390887.374929:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390889.421348:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390889.933439:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103357056:0@lo:400:kworker.0 00000100:00100000:0.0:1788390889.933513:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390889.933569:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390889.933576:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103357568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390889.933602:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390889.933876:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103357056:0@lo:400:kworker.0 00000100:00100000:3.0:1788390889.934092:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103357184:0@lo:400:kworker.0 00000100:00100000:3.0:1788390889.934125:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390889.934143:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390889.934149:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103357440:0@lo:400:kworker.0 00000100:00100000:3.0:1788390889.934170:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390889.934197:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103357312:0@lo:8:kworker.0 00000100:00100000:3.0:1788390889.934220:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390889.934246:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103357568 00000100:00100000:3.0:1788390889.934250:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103357568 00000100:00100000:3.0:1788390889.934301:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103357440 00000100:00100000:3.0:1788390889.934304:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103357440 00000100:00100000:3.0:1788390889.934338:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390889.934345:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103357568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390889.934383:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103357568:12345-0@lo:400:kworker.0 Request processed in 38us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390889.934389:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390889.934402:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390889.934408:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103357440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390889.934439:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103357440:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390889.934445:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788390889.934465:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788390889.934492:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691831f80 x1875263103357440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390889.934503:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103357440:0@lo:400:kworker.0 00010000:00080000:3.0:1788390889.934543:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691832680 x1875263103357568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390889.934551:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103357568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390889.936417:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390889.936434:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103357696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390889.936488:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390889.936527:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103357696 00000100:00100000:0.0:1788390889.936533:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103357696 00000100:00100000:0.0:1788390889.936570:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390889.936578:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103357696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390889.936607:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390889.936654:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103357696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390889.936661:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390889.936695:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:0.0:1788390889.936715:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103357696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390889.948142:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390889.948221:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103357184:0@lo:400:kworker.0 00000100:00100000:1.0:1788390889.949613:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103357312:12345-0@lo:8:kworker.0 Request processed in 14861us (15384us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788390889.949633:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788390889.949704:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390889.949710:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390889.949714:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103357312:0@lo:8:kworker.0 00010000:00010000:1.0:1788390890.447155:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390891.079535:0:31515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390891.079540:0:31515:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788390891.079654:0:31515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d587f66800 00000020:01000004:1.0:1788390891.079670:0:31515:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788390891.079683:0:31515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390891.079710:0:31515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d683d499b8) 00000020:00000080:1.0:1788390891.079728:0:31515:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788390891.098658:0:31515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788390891.098896:0:31515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788390891.100222:0:31515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390891.100477:0:31515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788390891.100734:0:31515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:1.0:1788390891.101365:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:1.0:1788390891.101460:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:1.0:1788390891.101605:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:1.0:1788390891.102311:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:1.0:1788390891.102499:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:1.0:1788390891.102712:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:1.0:1788390891.103296:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:1.0:1788390891.103495:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:1.0:1788390891.103697:0:31515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:1.0:1788390891.104548:0:31515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788390891.104567:0:31515:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390891.104580:0:31515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd34595 00000020:01000004:1.0:1788390891.104588:0:31515:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788390891.104623:0:31515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390891.104627:0:31515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390891.104633:0:31515:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788390891.105106:0:31515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788390891.105114:0:31515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788390891.119535:0:31515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788390891.119576:0:31515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788390891.119654:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788390891.119656:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390891.119658:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390891.119659:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390891.119661:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390891.119662:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390891.119664:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390891.119666:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390891.119667:0:31515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390891.119671:0:31515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788390891.119673:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390891.119675:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390891.119676:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390891.119677:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390891.119678:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390891.119679:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390891.119680:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390891.119681:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390891.119682:0:31515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788390891.119710:0:31515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788390891.119801:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103357824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390891.120083:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.120187:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d691559840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.120835:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103357824 00000100:00100000:3.0:1788390891.120846:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103357824 00000100:00100000:3.0:1788390891.120922:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390891.120933:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:31515:x1875263103357824:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390891.120993:0:30101:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788390891.120997:0:30101:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788390891.121001:0:30101:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788390891.132884:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103357824:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390891.132900:0:31515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788390891.132903:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390891.132906:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788390891.132919:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390891.132921:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390891.132922:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390891.132923:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390891.132925:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390891.132927:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390891.132928:0:31515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788390891.132947:0:31515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d587f66800 from lustre-OST0001 10000000:01000000:1.0:1788390891.133009:0:31515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788390891.133013:0:31515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788390891.133020:0:31515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d69131b370 local copy 00010000:00010000:1.0:1788390891.133031:0:31515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390891.133255:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103357952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390891.133291:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.133320:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390891.134138:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103357952:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788390891.134163:0:31515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788390891.134325:0:31515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788390891.134335:0:31515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.134346:0:31515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390891.134370:0:31515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d587f66800 10000000:01000000:1.0:1788390891.134376:0:31515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788390891.134381:0:31515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788390891.134384:0:31515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390891.134388:0:31515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788390891.134397:0:31515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788390891.134423:0:31515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.134432:0:31515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.134442:0:31515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390891.134457:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390891.134491:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.134526:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390891.135063:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390891.135076:0:31515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.135084:0:31515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390891.135682:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000040:00080000:1.0:1788390891.136355:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390891.136546:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788390891.136581:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:1.0:1788390891.136606:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:1.0:1788390891.136658:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:1.0:1788390891.136686:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:1.0:1788390891.136711:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:1.0:1788390891.136746:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:1.0:1788390891.136773:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:1.0:1788390891.136816:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 120 off9752 00000040:00080000:1.0:1788390891.136858:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9976 00000040:00080000:1.0:1788390891.136864:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 10 count 11 00000100:00100000:1.0:1788390891.136925:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390891.137002:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.137044:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390891.137843:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390891.137875:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390891.137913:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.137940:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.138025:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103358336 00000100:00100000:0.0:1788390891.138030:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103358336 00000100:00100000:0.0:1788390891.138067:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788390891.138075:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390891.138360:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358336:12345-0@lo:503:mount.lustre.0 Request processed in 286us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390891.138367:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390891.138491:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788390891.138910:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390891.139003:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390891.139046:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.139080:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.139142:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103358464 00000100:00100000:3.0:1788390891.139157:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103358464 00000100:00100000:3.0:1788390891.139183:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788390891.139191:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390891.139366:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358464:12345-0@lo:502:mount.lustre.0 Request processed in 176us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.139373:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788390891.139491:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390891.139667:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788390891.139709:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:1.0:1788390891.139739:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:1.0:1788390891.139777:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:1.0:1788390891.139805:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:1.0:1788390891.139830:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:1.0:1788390891.139885:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:1.0:1788390891.139921:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:1.0:1788390891.139999:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 120 off9752 00000100:00100000:1.0:1788390891.140023:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390891.140061:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.140087:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.140140:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103358592 00000100:00100000:3.0:1788390891.140145:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103358592 00000100:00100000:3.0:1788390891.140179:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390891.140185:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390891.140340:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358592:12345-0@lo:502:mount.lustre.0 Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.140348:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390891.140468:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390891.140521:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9976 00000040:00080000:1.0:1788390891.140530:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00010000:00010000:0.0:1788390891.146899:0:31516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788390891.147510:0:31516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 12884901897 00080000:10000000:0.0:1788390891.149506:0:31516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:0.0:1788390891.151115:0:31516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788390891.151127:0:31516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390891.151134:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390891.151136:0:31516:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788390891.151140:0:31516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390891.151144:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390891.151145:0:31516:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788390891.151219:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788390891.151222:0:31516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788390891.151225:0:31516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390891.151227:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390891.151228:0:31516:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788390891.151230:0:31516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390891.151232:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390891.151242:0:31516:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788390891.151275:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788390891.151331:0:31516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390891.151335:0:31516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390891.151337:0:31516:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788390891.151340:0:31516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000020:01000000:3.0:1788390891.155238:0:31515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788390891.155302:0:31515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788390891.158669:0:31515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.158693:0:31515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390891.158702:0:31515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d587f66800 from 1 10000000:01000000:3.0:1788390891.158714:0:31515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390891.158754:0:31515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.158762:0:31515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.158773:0:31515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390891.158798:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390891.158875:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390891.158931:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.159258:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390891.159270:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:31515:x1875263103358720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390891.159284:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390891.159295:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd345b8 expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.159318:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.159327:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.159335:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390891.159373:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103358720:12345-0@lo:101:mount.lustre.0 Request processed in 107us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.159379:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390891.159443:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390891.159458:0:31515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.159467:0:31515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390891.160046:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:3.0:1788390891.160554:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390891.160768:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788390891.160811:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:3.0:1788390891.160858:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:3.0:1788390891.160896:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:3.0:1788390891.160929:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:3.0:1788390891.161005:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:3.0:1788390891.161041:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:3.0:1788390891.161073:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:3.0:1788390891.161134:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:3.0:1788390891.161141:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:3.0:1788390891.162597:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390891.162666:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390891.163420:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.163979:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103358848 00000100:00100000:0.0:1788390891.163987:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103358848 00000100:00100000:0.0:1788390891.164038:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390891.164048:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103358848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390891.164342:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103358848:12345-0@lo:501:mount.lustre.0 Request processed in 295us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390891.164350:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788390891.164548:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390891.164591:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390891.164636:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.164669:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390891.165546:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103358976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788390891.166112:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390891.166593:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390891.166705:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.166779:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390891.167535:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390891.167767:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788390891.167811:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:1.0:1788390891.167852:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:1.0:1788390891.167882:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:1.0:1788390891.167911:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:1.0:1788390891.167951:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:1.0:1788390891.168047:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:1.0:1788390891.168096:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 128 off9664 00000100:00100000:1.0:1788390891.168122:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390891.168224:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.168456:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.168524:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103359232 00000100:00100000:3.0:1788390891.168530:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103359232 00000100:00100000:3.0:1788390891.168557:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788390891.168564:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103359232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390891.168723:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103359232:12345-0@lo:502:mount.lustre.0 Request processed in 158us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.168730:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788390891.168846:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390891.168931:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:1.0:1788390891.168940:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788390891.169941:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390891.169950:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.169953:0:31520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390891.169989:0:31520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d587f66800 00000020:00000080:1.0:1788390891.169992:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390891.170001:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390891.170004:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.170005:0:31520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390891.170008:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390891.170011:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.170012:0:31520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390891.170016:0:31520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d587f66800 00000020:00000080:1.0:1788390891.170018:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390891.170062:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390891.170065:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.170067:0:31520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390891.170069:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390891.170071:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.170073:0:31520:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390891.170076:0:31520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d587f66800 00000020:00000080:1.0:1788390891.170078:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390891.170109:0:31520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390891.170113:0:31520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390891.170114:0:31520:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390891.170117:0:31520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000100:00100000:3.0:1788390891.175918:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103359360 00000100:00100000:3.0:1788390891.175928:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103359360 00000100:00100000:3.0:1788390891.175991:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390891.176002:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b55ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103359360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390891.176015:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390891.176028:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd345cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd345c6 expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.176051:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd345cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd345c6 expref: 19 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.176062:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd345cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd345c6 expref: 19 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.176070:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788390891.176119:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b55ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103359360:12345-0@lo:101:mount.lustre.0 Request processed in 119us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.176125:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390891.176736:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390891.176753:0:31515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390891.176763:0:31515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390891.177407:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:3.0:1788390891.177799:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390891.178074:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788390891.178119:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:3.0:1788390891.178165:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:3.0:1788390891.178214:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:3.0:1788390891.178278:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:3.0:1788390891.178322:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:3.0:1788390891.178353:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:3.0:1788390891.178384:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:3.0:1788390891.178427:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788390891.178455:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:3.0:1788390891.178482:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:3.0:1788390891.178529:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:3.0:1788390891.178565:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:3.0:1788390891.178600:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:3.0:1788390891.178647:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:3.0:1788390891.178684:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:3.0:1788390891.178718:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:3.0:1788390891.178764:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:3.0:1788390891.178797:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:3.0:1788390891.178824:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:3.0:1788390891.178882:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:3.0:1788390891.178913:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:3.0:1788390891.178943:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:3.0:1788390891.179008:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:3.0:1788390891.179039:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:3.0:1788390891.179064:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:3.0:1788390891.179103:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:3.0:1788390891.179130:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:3.0:1788390891.179158:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:3.0:1788390891.179201:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:3.0:1788390891.179238:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:3.0:1788390891.182409:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:3.0:1788390891.182453:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:3.0:1788390891.182524:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:3.0:1788390891.182559:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:3.0:1788390891.182616:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:3.0:1788390891.183622:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:3.0:1788390891.184094:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:3.0:1788390891.184171:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:3.0:1788390891.184210:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:3.0:1788390891.184489:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:3.0:1788390891.184498:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:3.0:1788390891.184621:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390891.185817:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390891.185860:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.186271:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103359488 00000100:00100000:0.0:1788390891.186280:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103359488 00000100:00100000:0.0:1788390891.186326:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788390891.186336:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103359488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390891.187107:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103359488:12345-0@lo:501:mount.lustre.0 Request processed in 769us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390891.187116:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788390891.187463:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103359616 00000100:00100000:0.0:1788390891.187468:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103359616 00000100:00100000:0.0:1788390891.187502:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390891.187510:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103359616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390891.187790:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103359616:12345-0@lo:503:mount.lustre.0 Request processed in 280us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390891.187797:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788390891.187835:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788390891.188698:0:31515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390891.188763:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390891.188809:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390891.188890:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.192837:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390891.193143:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788390891.193332:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:0.0:1788390891.193364:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:0.0:1788390891.193406:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:0.0:1788390891.193442:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:0.0:1788390891.193490:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:0.0:1788390891.193540:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:0.0:1788390891.193572:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:0.0:1788390891.193615:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788390891.193650:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:0.0:1788390891.193684:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:0.0:1788390891.193729:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:0.0:1788390891.193763:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:0.0:1788390891.193795:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:0.0:1788390891.193839:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:0.0:1788390891.193874:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:0.0:1788390891.193904:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:0.0:1788390891.193949:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:0.0:1788390891.194020:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:0.0:1788390891.194054:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:0.0:1788390891.194107:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:0.0:1788390891.194144:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:0.0:1788390891.195390:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:0.0:1788390891.195452:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:0.0:1788390891.195489:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:0.0:1788390891.195528:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:0.0:1788390891.195574:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:0.0:1788390891.195605:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:0.0:1788390891.195635:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:0.0:1788390891.195683:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:0.0:1788390891.195720:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:0.0:1788390891.195754:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:0.0:1788390891.195784:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:0.0:1788390891.195826:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:0.0:1788390891.195859:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:0.0:1788390891.195900:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:0.0:1788390891.195932:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:0.0:1788390891.196744:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:0.0:1788390891.196818:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:0.0:1788390891.196848:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:0.0:1788390891.196895:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390891.197046:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390891.197085:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.197933:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103359872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390891.198029:0:31515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:0.0:1788390891.198041:0:31515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:3.0:1788390891.201998:0:31525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788390891.202191:0:31525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788390891.202230:0:31525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390891.202252:0:31525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd345db 00000100:00080000:3.0:1788390891.202263:0:31525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390891.202268:0:31525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d585fc9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390891.202303:0:31525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc68d880 x1875263103360000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390891.202327:0:31525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390891.202597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390891.202602:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788390891.202605:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390891.202609:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 707 00000100:00080000:1.0:1788390891.202618:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788390891.202622:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390891.202635:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d586481c00 x1875263103360256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390891.202802:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103360128:0@lo:400:kworker.0 00000100:00100000:3.0:1788390891.202864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.202993:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103360384:0@lo:400:kworker.0 00000100:00100000:1.0:1788390891.203023:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.203055:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103360128 00000100:00100000:1.0:1788390891.203061:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103360128 00000100:00100000:1.0:1788390891.203107:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390891.203117:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103360128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390891.203160:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103360128:12345-0@lo:400:kworker.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390891.203167:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390891.203188:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103360512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390891.203214:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.203261:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103360384 00000100:00100000:1.0:1788390891.203265:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103360384 00000100:00100000:1.0:1788390891.203290:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103360512 00000100:00100000:1.0:1788390891.203293:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103360512 00000100:00100000:1.0:1788390891.203315:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390891.203321:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390891.203353:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103360384:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390891.203360:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390891.203370:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390891.203376:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103360512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390891.203413:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103360512:12345-0@lo:400:kworker.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390891.203418:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788390891.203434:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788390891.203438:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788390891.203471:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d586481880 x1875263103360384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390891.203483:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103360384:0@lo:400:kworker.0 00010000:00080000:1.0:1788390891.203509:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d586482d80 x1875263103360512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390891.203517:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103360512:0@lo:400:kworker.0 00000100:00100000:3.0:1788390891.203989:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103360128:0@lo:400:kworker.0 00000100:00100000:0.0:1788390891.204000:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103360000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390891.204035:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390891.204071:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103360256:0@lo:8:kworker.0 00000100:00100000:0.0:1788390891.204107:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390891.204120:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103360000 00000100:00100000:3.0:1788390891.204124:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103360000 00000100:00100000:3.0:1788390891.204144:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390891.204149:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103360000:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788390891.204168:0:30108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:3.0:1788390891.204206:0:30108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd345e2 00000004:00100000:3.0:1788390891.204222:0:30108:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788390891.204261:0:30108:0:(import.c:65:import_set_state_nolock()) ffff95d69188e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390891.204310:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103360000:12345-0@lo:38:llog_process_th.0 Request processed in 159us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.204316:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1788390891.204453:0:31525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00010000:00080000:0.0:1788390891.204723:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc68d880 x1875263103360000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390891.204732:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390891.204746:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 4 00000100:00080000:0.0:1788390891.204752:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788390891.204756:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390891.204758:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d585fc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390891.204763:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103360000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788390891.204774:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390891.204777:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390891.204781:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788390891.204783:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103360256:0@lo:8:kworker.0 00000020:01000000:0.0:1788390891.204812:0:31515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788390891.204836:0:31515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788390891.204858:0:31515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390891.204869:0:31515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390891.204907:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788390891.204909:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390891.204910:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390891.204912:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390891.204913:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390891.204914:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390891.204916:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390891.204917:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390891.204918:0:31515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390891.204922:0:31515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788390891.204924:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390891.204926:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390891.204927:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390891.204928:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390891.204932:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390891.204933:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390891.204934:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390891.204935:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390891.204936:0:31515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788390891.204950:0:31515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788390891.204985:0:31515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103360640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390891.205020:0:31515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390891.205040:0:31515:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390891.205054:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103360640 00000100:00100000:0.0:1788390891.205058:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103360640 00000100:00100000:0.0:1788390891.205086:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390891.205093:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:31515:x1875263103360640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788390891.205119:0:30102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788390891.205131:0:30102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788390891.238763:0:30102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390891.238780:0:30102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788390891.238798:0:30123:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788390891.238803:0:30123:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788390891.238826:0:30123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd345e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.238913:0:30123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd344a7 expref: 19 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.238923:0:30123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd345e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.238983:0:30123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd344a7 expref: 19 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390891.238998:0:30123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd344ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd344a7 expref: 19 pid: 30100 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390891.239032:0:30123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30123:1875263103360768:0@lo:104: 00000100:00100000:1.0:1788390891.239095:0:30123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390891.239133:0:30123:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390891.259055:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:31515:x1875263103360640:12345-0@lo:253:mount.lustre.0 Request processed in 53953us (54025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390891.259068:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788390891.259229:0:31515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:31515:1875263103360640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390891.259256:0:31515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788390891.259259:0:31515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390891.259261:0:31515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788390891.259262:0:31515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390891.259263:0:31515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390891.259264:0:31515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390891.259266:0:31515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390891.259267:0:31515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390891.259269:0:31515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390891.259270:0:31515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788390891.259285:0:31515:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788390891.259673:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390891.259821:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390891.260756:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390891.260912:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390891.261088:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390891.261466:0:31515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788390891.262573:0:31515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00002000:00080000:1.0:1788390891.306796:0:31515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788390891.306805:0:31515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788390891.306837:0:31515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788390891.306901:0:31515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788390891.306918:0:31515:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788390891.306947:0:31515:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788390891.469133:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788390892.687911:0:30105:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788390892.687919:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d587662000 from 14 10000000:01000000:0.0:1788390892.687923:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788390892.688054:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688067:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688079:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390892.688104:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103361024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390892.688173:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390892.688225:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683168a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390892.688269:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361024 00000100:00100000:0.0:1788390892.688276:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361024 00000100:00100000:0.0:1788390892.688367:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390892.688378:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:30105:x1875263103361024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390892.688391:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390892.688404:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79b400/0x9aafc5f04cd345f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd345f0 expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688427:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79b400/0x9aafc5f04cd345f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd345f0 expref: 19 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688439:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79b400/0x9aafc5f04cd345f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd345f0 expref: 19 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688460:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788390892.688502:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103361024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390892.688510:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788390892.688907:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103361024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390892.688925:0:30105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.688935:0:30105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390892.689052:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103361152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788390892.689087:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390892.689153:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390892.693575:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361152 00000100:00100000:3.0:1788390892.693588:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361152 00000100:00100000:0.0:1788390892.703656:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103361152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788390892.703752:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788390892.703764:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390892.703776:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390893.517141:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390894.541933:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390895.053392:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390895.053416:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103361280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390895.053491:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390895.053563:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361280 00000100:00100000:0.0:1788390895.053571:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361280 00000100:00100000:0.0:1788390895.053625:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390895.053636:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103361280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390895.053740:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390895.053787:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103361280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390895.053794:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788390895.053814:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390895.053853:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103361280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788390895.565114:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390895.649449:0:31868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788390896.590080:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390896.590085:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390896.590088:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390896.590099:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390896.590119:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0e300 x1875263103361664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788390896.590297:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103361408:0@lo:400:kworker.0 00000100:00100000:0.0:1788390896.590377:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390896.590443:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103362048:0@lo:400:kworker.0 00000100:00100000:0.0:1788390896.590471:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390896.590495:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390896.590501:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103361920:0@lo:400:kworker.0 00000100:00100000:0.0:1788390896.590521:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390896.590546:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103361664:0@lo:8:kworker.0 00000100:00100000:0.0:1788390896.590570:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390896.590607:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361408 00000100:00100000:3.0:1788390896.590617:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361408 00000100:00100000:3.0:1788390896.590675:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788390896.590688:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103361408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390896.590761:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103361408:12345-0@lo:400:kworker.0 Request processed in 74us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390896.590769:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788390896.590811:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362048 00000100:00100000:3.0:1788390896.590815:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362048 00000100:00100000:3.0:1788390896.590853:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361920 00000100:00100000:3.0:1788390896.590856:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361920 00000100:00100000:3.0:1788390896.590879:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361792 00000100:00100000:3.0:1788390896.590882:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361792 00000100:00100000:3.0:1788390896.590899:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390896.590913:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103362048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390896.590946:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103362048:12345-0@lo:400:kworker.0 Request processed in 35us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390896.590953:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788390896.590991:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390896.590998:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103361920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390896.591035:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103361920:12345-0@lo:400:kworker.0 Request processed in 38us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390896.591047:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390896.591065:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390896.591077:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103361792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390896.591130:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103361792:12345-0@lo:400:kworker.0 Request processed in 54us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390896.591138:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788390896.591264:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361664 00000100:00100000:1.0:1788390896.591269:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361664 00000100:00100000:1.0:1788390896.591292:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103361536 00000100:00100000:1.0:1788390896.591294:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103361536 00000100:00100000:1.0:1788390896.591315:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390896.591322:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103361536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390896.591362:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103361536:12345-0@lo:400:kworker.0 Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390896.591369:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390896.591381:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390896.591385:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103361664:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788390896.591408:0:30793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788390896.591439:0:30793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd345fe 00002000:00100000:1.0:1788390896.591454:0:30793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d6bc8bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788390896.591458:0:30793:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788390896.591467:0:30793:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788390896.591786:0:30793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788390896.591812:0:30793:0:(import.c:65:import_set_state_nolock()) ffff95d6bc8bb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390896.591863:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103361664:12345-0@lo:8:kworker.0 Request processed in 476us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390896.591871:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788390896.591900:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d584a0e300 x1875263103361664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788390896.591916:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1788390896.591925:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788390896.591931:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788390896.591934:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788390896.591953:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788390896.591977:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103361664:0@lo:8:kworker.0 00000004:00080000:1.0:1788390896.591997:0:30132:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788390896.592030:0:30133:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x43:0x0] 00000100:00100000:3.0:1788390896.592050:0:30133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30133:1875263103362304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788390896.592088:0:30133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390896.592129:0:30133:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390896.592145:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362304 00000100:00100000:3.0:1788390896.592149:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362304 00000100:00100000:3.0:1788390896.592182:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390896.592189:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:30133:x1875263103362304:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788390896.592355:0:30132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 713699393313ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788390896.592402:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103362176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390896.592440:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390896.592485:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103361536:0@lo:400:kworker.0 00000100:00100000:1.0:1788390896.592515:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362176 00000100:00100000:1.0:1788390896.592520:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362176 00000100:00100000:1.0:1788390896.592551:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390896.592559:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103362176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788390896.592583:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788390896.592624:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103362176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390896.592631:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788390896.592763:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc68c380 x1875263103362176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390896.592780:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103362176:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788390896.594699:0:30795:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788390896.594711:0:30795:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -30 00002000:02000040:3.0:1788390896.594717:0:30795:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:68 to 0x280000400:97) 00010000:00010000:3.0:1788390896.609006:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.609014:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd34621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.609024:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.609029:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd34621 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.609039:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd34621 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.609219:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd34621 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.609229:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd34621 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.609248:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.609250:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.609253:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390896.612396:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614311:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.614321:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd34628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614331:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.614337:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd34628 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614346:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd34628 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614366:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd34628 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614373:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd34628 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614397:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614399:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614403:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614738:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.614744:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd3462f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614753:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.614757:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd3462f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614792:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd3462f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614804:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd3462f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614812:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd3462f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.614831:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614834:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.614835:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615180:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.615186:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd34636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615203:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.615207:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd34636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615216:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd34636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615228:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd34636 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615256:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd34636 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615273:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615276:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615278:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615517:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.615523:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd3463d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615531:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.615535:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd3463d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615543:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd3463d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615555:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd3463d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615563:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd3463d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.615577:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615580:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.615593:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.618472:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390896.618486:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd34644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618497:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.618503:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd34644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618514:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd34644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618536:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd34644 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618543:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd34644 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618569:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390896.618572:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd3464b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618579:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.618583:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd3464b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618590:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd3464b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618617:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd3464b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618625:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd3464b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618639:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.618643:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd34652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618650:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.618653:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd34652 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618660:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd34652 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618669:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd34652 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618676:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd34652 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.618689:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.618690:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.618697:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.618704:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.620704:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.620713:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd34659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.620723:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.620727:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd34659 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.620737:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd34659 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.620758:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd34659 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.620767:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd34659 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.620789:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.620791:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.620793:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.621377:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.621384:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd34660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.621392:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.621396:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd34660 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.621404:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd34660 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.621417:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd34660 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.621425:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd34660 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.621444:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.621446:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.621449:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.622916:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.622926:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd34667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.622935:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.622940:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd34667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.622990:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd34667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623024:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd34667 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623032:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017df106f/0x9aafc5f04cd34667 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623050:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623052:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623053:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623220:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.623226:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd3466e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623233:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.623237:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd3466e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623245:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd3466e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623259:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd3466e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623279:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd3466e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623296:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623298:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623300:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623852:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.623858:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623866:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.623869:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623877:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623888:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34675 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623895:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34675 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.623908:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623910:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.623911:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.624716:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.624723:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3467c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.624731:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.624736:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3467c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.624744:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3467c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.624782:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3467c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.624790:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3467c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.624808:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.624811:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.624814:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390896.627084:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390896.627093:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627117:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390896.627123:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627133:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627154:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34683 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627169:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e6c07b/0x9aafc5f04cd34683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627218:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390896.627223:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3468a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627239:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390896.627246:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3468a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627270:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3468a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627287:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3468a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627302:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3468a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627320:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390896.627324:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd34691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627331:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390896.627335:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd34691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627343:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd34691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627353:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd34691 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627360:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd34691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390896.627373:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390896.627375:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390896.627376:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.627619:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.628343:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.628349:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.628357:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.628361:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34698 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.628380:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34698 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.628393:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34698 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.628400:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34698 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.628416:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.628418:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.628420:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.628858:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.628865:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1ccd90/0x9aafc5f04cd3469f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.628872:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.628876:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1ccd90/0x9aafc5f04cd3469f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.628901:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1ccd90/0x9aafc5f04cd3469f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.628913:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1ccd90/0x9aafc5f04cd3469f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.628921:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1ccd90/0x9aafc5f04cd3469f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.628939:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.628942:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.628945:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788390896.629844:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788390896.630180:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.630186:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd346ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630204:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.630208:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd346ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630217:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd346ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630228:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd346ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630247:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd346ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630266:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.630269:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.630271:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.630609:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.630616:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd346b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630624:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.630628:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd346b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630637:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd346b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630650:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd346b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630658:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd346b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.630675:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.630678:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.630680:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.631266:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.631272:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd346bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.631280:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.631283:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd346bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.631291:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd346bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.631302:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd346bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.631315:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd346bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.631329:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.631331:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.631332:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.632033:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.632040:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd346c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.632049:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.632052:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd346c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.632059:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd346c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.632070:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd346c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.632076:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd346c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.632089:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.632091:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.632093:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.633034:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390896.633041:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd346c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.633049:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390896.633052:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd346c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.633060:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd346c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.633073:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd346c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.633080:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd346c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390896.633095:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.633097:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390896.633098:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390896.634119:0:30133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30133:1875263103362304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788390896.634135:0:30133:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x61:0x0] from OST, last_created [0x280000400:0x61:0x0]last_used is [0x280000400:0x43:0x0] 00000100:00100000:3.0:1788390896.634173:0:30133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30133:1875263103362432:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788390896.634219:0:30133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390896.634242:0:30133:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390896.634258:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362432 00000100:00100000:3.0:1788390896.634263:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362432 00000100:00100000:3.0:1788390896.634299:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390896.634307:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:30133:x1875263103362432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788390896.634342:0:30793:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 98 00010000:00010000:0.0:1788390896.636077:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390896.636086:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd346d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.636098:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390896.636103:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd346d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.636125:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd346d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.636142:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd346d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.636205:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd346d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390896.636225:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.636227:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390896.636229:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390896.639524:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:30133:x1875263103362432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5209us (5296us total) trans 17179869185 rc 0/0 00000100:00100000:3.0:1788390896.639537:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390896.639673:0:30133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:30133:1875263103362432:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788390896.639687:0:30133:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x61:0x0]-[0x280000400:0x81:0x0] 00000040:00080000:1.0:1788390896.782353:0:30144:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788390896.782364:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390896.782780:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 1 00000040:00080000:1.0:1788390896.782850:0:30144:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390896.782884:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 1 00000100:00100000:1.0:1788390897.145103:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.145186:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093955968 00000100:00100000:3.0:1788390897.145205:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093955968 00000100:00100000:3.0:1788390897.145265:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788390897.145273:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1875263093955968:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788390897.145302:0:30100:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6264aaa7-f441-4011-80bc-026a652f837f@192.168.202.1@tcp t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:3.0:1788390897.145341:0:30100:0:(genops.c:1385:class_connect()) connect: client 6264aaa7-f441-4011-80bc-026a652f837f, cookie 0x9aafc5f04cd346d7 00000100:00080000:3.0:1788390897.145501:0:30100:0:(import.c:65:import_set_state_nolock()) ffff95d69188a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390897.146047:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+5:2355:x1875263093955968:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 772us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.146056:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1788390897.147468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.148907:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093956224 00000100:00100000:3.0:1788390897.148914:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093956224 00000100:00100000:3.0:1788390897.148952:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788390897.148987:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+6:21647:x1875263093956224:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390897.149225:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+6:21647:x1875263093956224:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 239us (373us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390897.149233:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390897.150156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390897.153111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.153217:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093956480 00000100:00100000:3.0:1788390897.153226:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093956480 00000100:00100000:3.0:1788390897.153283:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788390897.153293:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+7:21647:x1875263093956480:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390897.153584:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+8:21647:x1875263093956480:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 291us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.153592:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788390897.156039:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.156814:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390897.156826:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+8:21647:x1875263093956608:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788390897.157128:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+8:21647:x1875263093956608:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 304us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.157137:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788390897.164709:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390897.164798:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093956736 00000100:00100000:0.0:1788390897.164809:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093956736 00000100:00100000:0.0:1788390897.164870:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788390897.164881:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+8:21666:x1875263093956736:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390897.165213:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+8:21666:x1875263093956736:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 333us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390897.165222:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788390897.180669:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.180752:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093956864 00000100:00100000:3.0:1788390897.180762:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093956864 00000100:00100000:3.0:1788390897.180822:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390897.180834:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+8:21666:x1875263093956864:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390897.181154:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+8:21666:x1875263093956864:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 312us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.181162:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390897.189374:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390897.189493:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093956992 00000100:00100000:0.0:1788390897.189502:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093956992 00000100:00100000:0.0:1788390897.189555:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1788390897.189565:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+8:21647:x1875263093956992:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390897.189581:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390897.189598:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79b200/0x9aafc5f04cd346ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff416 expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390897.189627:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79b200/0x9aafc5f04cd346ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff416 expref: 9 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390897.189639:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79b200/0x9aafc5f04cd346ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff416 expref: 9 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390897.189647:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788390897.189704:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+9:21647:x1875263093956992:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 140us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390897.189710:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788390897.192002:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.192063:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957120 00000100:00100000:3.0:1788390897.192072:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957120 00000100:00100000:3.0:1788390897.192129:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788390897.192139:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+9:21647:x1875263093957120:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788390897.192163:0:30102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788390897.192186:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788390897.192206:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788390897.192210:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788390897.192213:0:30102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:3.0:1788390897.193798:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+9:21647:x1875263093957120:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1649us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.193810:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788390897.196655:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957248 00000100:00100000:3.0:1788390897.196664:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957248 00000100:00100000:3.0:1788390897.196758:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390897.196769:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+9:21647:x1875263093957248:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390897.196785:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390897.196802:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff41d expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390897.196829:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 10 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390897.196839:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 10 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390897.196849:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00100000:3.0:1788390897.196912:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+10:21647:x1875263093957248:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.196919:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:1.0:1788390897.198126:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.198174:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957376 00000100:00100000:3.0:1788390897.198179:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957376 00000100:00100000:3.0:1788390897.198219:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788390897.198225:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+10:21647:x1875263093957376:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390897.198453:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+10:21647:x1875263093957376:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 228us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.198458:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1788390897.199430:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.199466:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957504 00000100:00100000:3.0:1788390897.199472:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957504 00000100:00100000:3.0:1788390897.199497:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390897.199504:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+10:21647:x1875263093957504:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788390897.199640:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+10:21647:x1875263093957504:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 135us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.199647:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788390897.201484:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957632 00000100:00100000:3.0:1788390897.201492:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957632 00000100:00100000:3.0:1788390897.201530:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788390897.201538:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+10:21668:x1875263093957632:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390897.201729:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+10:21668:x1875263093957632:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 190us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.201737:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1788390897.203293:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390897.203369:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093957760 00000100:00100000:3.0:1788390897.203388:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093957760 00000100:00100000:3.0:1788390897.203432:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1788390897.203440:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+10:21668:x1875263093957760:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390897.203619:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+10:21668:x1875263093957760:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 178us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.203627:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390897.208005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788390897.225730:0:30109:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb47800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390897.225798:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2355:x1875263093957888:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 17667us (17803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390897.225811:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390897.230449:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958016 00000100:00100000:1.0:1788390897.230460:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958016 00000100:00100000:3.0:1788390897.230465:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958144 00000100:00100000:3.0:1788390897.230472:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958144 00000100:00100000:3.0:1788390897.230545:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390897.230555:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390897.230561:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:21647:x1875263093958144:12345-192.168.202.1@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788390897.230580:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:0:x1875263093958016:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788390897.230609:0:30107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1788390897.230609:0:30817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788390897.230752:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:0:x1875263093958016:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 177us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390897.230761:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390897.230870:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21647:x1875263093958144:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 314us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390897.230879:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390897.234603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390897.237447:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958272 00000100:00100000:0.0:1788390897.237462:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958272 00000100:00100000:0.0:1788390897.237539:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390897.237552:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21647:x1875263093958272:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788390897.237658:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21647:x1875263093958272:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 108us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390897.237680:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390897.239773:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958400 00000100:00100000:1.0:1788390897.239782:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958400 00000100:00100000:1.0:1788390897.239818:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958528 00000100:00100000:1.0:1788390897.239823:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958528 00000100:00100000:1.0:1788390897.239857:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390897.239866:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875263093958400:12345-192.168.202.1@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788390897.239871:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390897.239874:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958656 00000100:00100000:3.0:1788390897.239881:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958656 00000100:00100000:0.0:1788390897.239882:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263093958528:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788390897.239899:0:31088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 714 last 0 00010000:00080000:0.0:1788390897.239905:0:30795:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 714 last 0 00000100:00100000:3.0:1788390897.239918:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390897.239928:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21647:x1875263093958656:12345-192.168.202.1@tcp:33:mount.lustre.0 00000020:00000080:0.0:1788390897.239944:0:30795:0:(genops.c:1385:class_connect()) connect: client 689ef09a-3944-4d2a-a8ee-4e7b3c142dac, cookie 0x9aafc5f04cd34701 00000020:00000080:1.0:1788390897.239945:0:31088:0:(genops.c:1385:class_connect()) connect: client 689ef09a-3944-4d2a-a8ee-4e7b3c142dac, cookie 0x9aafc5f04cd34708 00002000:00100000:1.0:1788390897.239989:0:31088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 689ef09a-3944-4d2a-a8ee-4e7b3c142dac/ffff95d6bc8bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390897.239993:0:30795:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 689ef09a-3944-4d2a-a8ee-4e7b3c142dac/ffff95d6bcb40800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390897.240018:0:30795:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788390897.240206:0:31088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390897.240270:0:30795:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390897.240303:0:30795:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb40000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390897.240370:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2355:x1875263093958528:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 488us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390897.240380:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00002000:00080000:1.0:1788390897.240515:0:31088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390897.240542:0:31088:0:(import.c:65:import_set_state_nolock()) ffff95d6bc8be000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390897.240573:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2355:x1875263093958400:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 708us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390897.240581:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000004:00080000:1.0:1788390897.243580:0:30110:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3564us 00000004:00200000:1.0:1788390897.251326:0:30110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788390897.251464:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21647:x1875263093958656:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 11532us (11704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390897.251488:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390897.377249:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093958784 00000100:00100000:1.0:1788390897.377259:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093958784 00000100:00100000:1.0:1788390897.377326:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788390897.377337:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21689:x1875263093958784:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:1.0:1788390897.377357:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390897.377384:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3470f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff447 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377452:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd34716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377467:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd34716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377498:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd34716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390897.377535:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390897.377539:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390897.377581:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd34716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377608:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd3470f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff447 expref: 8 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377624:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63e00/0x9aafc5f04cd34716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff447 expref: 7 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390897.377633:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:1.0:1788390897.377653:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390897.377656:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63e00, rc 0) 00000100:00100000:1.0:1788390897.377723:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:21689:x1875263093958784:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 387us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390897.377730:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:3.0:1788390897.616045:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390898.641573:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390899.072564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788390899.073035:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390899.075873:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959040 00000100:00100000:1.0:1788390899.075883:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959040 00000100:00100000:1.0:1788390899.076011:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390899.076022:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21741:x1875263093959040:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:1.0:1788390899.076060:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788390899.076133:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:21741:x1875263093959040:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.076159:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390899.078137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788390899.080485:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788390899.082543:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390899.232504:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390899.232624:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959296 00000100:00100000:0.0:1788390899.232640:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959296 00000100:00100000:0.0:1788390899.232784:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788390899.232796:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+10:21775:x1875263093959296:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390899.232815:0:30102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390899.232832:0:30102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd3471d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff44e expref: -99 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390899.232875:0:30102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd3471d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff44e expref: 11 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390899.232886:0:30102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd3471d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff44e expref: 11 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390899.232896:0:30102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79be00, rc 0) 00000100:00100000:0.0:1788390899.232995:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959296:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 202us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.233002:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788390899.242405:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390899.242511:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959424 00000100:00100000:1.0:1788390899.242522:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959424 00000100:00100000:1.0:1788390899.242577:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390899.242587:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959424:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788390899.242897:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68688ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959424:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 311us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.242906:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390899.248952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390899.249098:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959552 00000100:00100000:0.0:1788390899.249114:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959552 00000100:00100000:0.0:1788390899.249199:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788390899.249211:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959552:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788390899.249453:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68688bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959552:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 243us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.249462:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788390899.254107:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959680 00000100:00100000:0.0:1788390899.254118:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959680 00000100:00100000:0.0:1788390899.254192:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788390899.254202:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+11:21780:x1875263093959680:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390899.254472:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+11:21780:x1875263093959680:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 271us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.254481:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788390899.268252:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959808 00000100:00100000:3.0:1788390899.268261:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959808 00000100:00100000:3.0:1788390899.268318:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1788390899.268328:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+11:21780:x1875263093959808:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390899.268633:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+11:21780:x1875263093959808:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 305us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.268647:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788390899.276193:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093959936 00000100:00100000:1.0:1788390899.276206:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093959936 00000100:00100000:1.0:1788390899.276260:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788390899.276272:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+11:21775:x1875263093959936:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788390899.276288:0:30101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390899.276305:0:30101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd34724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff478 expref: -99 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.276335:0:30101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd34724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff478 expref: 12 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.276346:0:30101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd34724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff478 expref: 12 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.276355:0:30101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390899.276413:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+12:21775:x1875263093959936:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 143us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.276428:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1788390899.283606:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960064 00000100:00100000:0.0:1788390899.283629:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960064 00000100:00100000:0.0:1788390899.283779:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788390899.283791:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+12:21775:x1875263093960064:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788390899.283816:0:30102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788390899.283833:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788390899.283837:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788390899.283841:0:30102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788390899.283843:0:30102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:0.0:1788390899.285327:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+12:21775:x1875263093960064:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1532us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.285338:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788390899.289553:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960192 00000100:00100000:3.0:1788390899.289563:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960192 00000100:00100000:3.0:1788390899.289605:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788390899.289613:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+12:21775:x1875263093960192:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390899.289627:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390899.289641:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff47f expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390899.289674:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 13 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390899.289683:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 13 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390899.289690:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0e00, rc 0) 00000100:00100000:3.0:1788390899.289748:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:21775:x1875263093960192:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.289753:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788390899.294149:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960320 00000100:00100000:0.0:1788390899.294159:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960320 00000100:00100000:0.0:1788390899.294221:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788390899.294231:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21775:x1875263093960320:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390899.294482:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68688b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21775:x1875263093960320:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 252us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.294487:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788390899.296389:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960448 00000100:00100000:1.0:1788390899.296396:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960448 00000100:00100000:1.0:1788390899.296432:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1788390899.296438:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+13:21775:x1875263093960448:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788390899.296582:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+13:21775:x1875263093960448:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 144us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.296587:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788390899.298797:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960576 00000100:00100000:3.0:1788390899.298805:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960576 00000100:00100000:3.0:1788390899.298851:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:3.0:1788390899.298860:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:21784:x1875263093960576:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390899.299070:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:21784:x1875263093960576:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 212us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.299076:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788390899.311520:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960704 00000100:00100000:0.0:1788390899.311528:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960704 00000100:00100000:0.0:1788390899.311599:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788390899.311607:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21784:x1875263093960704:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390899.311861:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21784:x1875263093960704:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 253us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.311868:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1788390899.328135:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960832 00000100:00100000:1.0:1788390899.328145:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960832 00000100:00100000:1.0:1788390899.328238:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390899.328247:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2355:x1875263093960832:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788390899.328277:0:30817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5d0a7814-65be-4163-903b-0e55692238e5@192.168.202.1@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788390899.328313:0:30817:0:(genops.c:1385:class_connect()) connect: client 5d0a7814-65be-4163-903b-0e55692238e5, cookie 0x9aafc5f04cd34732 00000004:00100000:1.0:1788390899.328341:0:30817:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788390899.328444:0:30817:0:(import.c:65:import_set_state_nolock()) ffff95d6bc8ba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390899.328510:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+6:2355:x1875263093960832:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 263us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.328517:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390899.338095:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093960960 00000100:00100000:3.0:1788390899.338106:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093960960 00000100:00100000:3.0:1788390899.338158:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961088 00000100:00100000:3.0:1788390899.338161:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961088 00000100:00100000:3.0:1788390899.338194:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390899.338203:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+7:0:x1875263093960960:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788390899.338234:0:30108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788390899.338288:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+7:0:x1875263093960960:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 86us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.338294:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390899.338310:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390899.338316:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961088:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788390899.338325:0:30108:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788390899.338341:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961088:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 26us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.338347:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390899.344936:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961216 00000100:00100000:3.0:1788390899.344946:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961216 00000100:00100000:3.0:1788390899.345451:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390899.345462:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961216:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788390899.345542:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961216:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 83us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.345549:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390899.355414:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961344 00000100:00100000:0.0:1788390899.355437:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961344 00000100:00100000:0.0:1788390899.355480:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961472 00000100:00100000:0.0:1788390899.355483:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961472 00000100:00100000:0.0:1788390899.355502:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390899.355511:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093961344:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788390899.355544:0:30793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5d0a7814-65be-4163-903b-0e55692238e5@192.168.202.1@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:0.0:1788390899.355576:0:30793:0:(genops.c:1385:class_connect()) connect: client 5d0a7814-65be-4163-903b-0e55692238e5, cookie 0x9aafc5f04cd34739 00002000:00100000:0.0:1788390899.355588:0:30793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d0a7814-65be-4163-903b-0e55692238e5/ffff95d6bcb44800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390899.355599:0:30793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390899.355695:0:30793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390899.355725:0:30793:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb41000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390899.355789:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d0a7814-65be-4163-903b-0e55692238e5+6:2355:x1875263093961344:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 278us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.355797:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390899.355814:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390899.355819:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263093961472:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788390899.355833:0:30793:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5d0a7814-65be-4163-903b-0e55692238e5@192.168.202.1@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:0.0:1788390899.355853:0:30793:0:(genops.c:1385:class_connect()) connect: client 5d0a7814-65be-4163-903b-0e55692238e5, cookie 0x9aafc5f04cd34740 00002000:00100000:0.0:1788390899.355858:0:30793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d0a7814-65be-4163-903b-0e55692238e5/ffff95d6b6530000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788390899.355864:0:30793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788390899.355906:0:30793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390899.355921:0:30793:0:(import.c:65:import_set_state_nolock()) ffff95d6b6537000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390899.355942:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d0a7814-65be-4163-903b-0e55692238e5+6:2355:x1875263093961472:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 122us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390899.355947:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390899.356647:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961600 00000100:00100000:3.0:1788390899.356652:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961600 00000100:00100000:3.0:1788390899.356680:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788390899.356691:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961600:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788390899.356773:0:30111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788390899.356827:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:21775:x1875263093961600:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 137us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390899.356832:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390899.501866:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093961728 00000100:00100000:1.0:1788390899.501876:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093961728 00000100:00100000:1.0:1788390899.501934:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390899.501945:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+6:21806:x1875263093961728:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:1.0:1788390899.501983:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390899.502002:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4a9 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502073:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502086:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502098:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390899.502129:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390899.502133:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390899.502148:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502183:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4a9 expref: 8 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502200:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4a9 expref: 7 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390899.502208:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:1.0:1788390899.502211:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390899.502214:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62c00, rc 0) 00000100:00100000:1.0:1788390899.502272:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+7:21806:x1875263093961728:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 329us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390899.502279:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:3.0:1788390899.665297:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390900.174192:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390900.174216:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103362560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788390900.174289:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390900.174590:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362560 00000100:00100000:0.0:1788390900.174655:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362560 00000100:00100000:0.0:1788390900.174717:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390900.174728:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103362560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390900.174749:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390900.174805:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103362560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390900.174812:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788390900.174848:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390900.174858:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103362560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390900.686140:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788390901.414724:0:32071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788390901.712337:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363456 00000100:00100000:0.0:1788390901.712347:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363456 00000100:00100000:0.0:1788390901.712427:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390901.712579:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103363456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390901.712623:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390901.712711:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103363456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.712719:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788390901.712744:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390901.712801:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103363456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390901.712990:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363200 00000100:00100000:0.0:1788390901.712996:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363200 00000100:00100000:0.0:1788390901.713041:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363072 00000100:00100000:0.0:1788390901.713045:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363072 00000100:00100000:0.0:1788390901.713066:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390901.713073:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103363200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713126:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103363200:12345-0@lo:400:kworker.0 Request processed in 53us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.713133:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788390901.713144:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390901.713162:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103363072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713193:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103363072:12345-0@lo:400:kworker.0 Request processed in 43us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.713199:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788390901.713220:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390901.713248:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103363072:0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713290:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390901.713662:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103363328:0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390901.713731:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103363200:0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713754:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363328 00000100:00100000:0.0:1788390901.713758:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363328 00000100:00100000:0.0:1788390901.713791:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390901.713797:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103363328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713833:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103363328:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.713840:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788390901.713856:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390901.713875:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103363328:0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.713930:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362944 00000100:00100000:0.0:1788390901.713935:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362944 00000100:00100000:0.0:1788390901.713997:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103362816 00000100:00100000:0.0:1788390901.714000:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103362816 00000100:00100000:0.0:1788390901.714021:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390901.714026:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103362944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.714063:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103362944:12345-0@lo:400:kworker.0 Request processed in 37us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.714069:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390901.714080:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390901.714085:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103362816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.714114:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103362816:12345-0@lo:400:kworker.0 Request processed in 28us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390901.714120:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390901.714158:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103362944:0@lo:400:kworker.0 00000100:00100000:0.0:1788390901.714186:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103362816:0@lo:400:kworker.0 00000100:00100000:3.0:1788390901.715040:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788390901.715055:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3286:x1875263103362688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390901.715112:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3286:x1875263103362688:12345-0@lo:400:kworker.0 Request processed in 62us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390901.715119:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000001:00100000:0.0:1788390902.280013:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d0a7814-65be-4163-903b-0e55692238e5 00000001:00100000:0.0:1788390902.280028:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689ef09a-3944-4d2a-a8ee-4e7b3c142dac 00010000:00010000:3.0:1788390902.733862:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390903.757263:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390904.008564:0:32223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 00010000:00010000:3.0:1788390904.017754:0:32222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017781:0:32222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 18 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017791:0:32222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 18 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017799:0:32222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017830:0:32222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 12 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017838:0:32222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 12 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017848:0:32222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017922:0:32222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 12 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.017942:0:32222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 12 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.018585:0:32222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363584:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390904.018913:0:32222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 12 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.018925:0:32222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 12 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.018936:0:32222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363712:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390904.019004:0:32222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.019013:0:32222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.019052:0:32222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363840:0@lo:104: 00000100:00100000:3.0:1788390904.019105:0:32222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390904.019167:0:32222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 18 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.019176:0:32222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 18 pid: 30101 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.019186:0:32222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363968:0@lo:104: 00000100:00100000:3.0:1788390904.019216:0:32222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390904.019243:0:32222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 18 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390904.019251:0:32222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 18 pid: 30102 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.019259:0:32222:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103364096:0@lo:104: 00000100:00100000:3.0:1788390904.019286:0:32222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390904.019296:0:32222:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390904.019475:0:30091:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788390904.019493:0:30091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363840 00000100:00100000:0.0:1788390904.019502:0:30091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363840 00000100:00100000:0.0:1788390904.019550:0:30091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103363968 00000100:00100000:0.0:1788390904.019553:0:30091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103363968 00000100:00100000:0.0:1788390904.019564:0:30091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364096 00000100:00100000:0.0:1788390904.019567:0:30091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364096 00000100:00100000:0.0:1788390904.019588:0:30091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390904.019608:0:30091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+5:32222:x1875263103363840:12345-0@lo:104: 00010000:00010000:0.0:1788390904.019623:0:30091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.019715:0:30091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390904.019722:0:30091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+5:32222:x1875263103363840:12345-0@lo:104: Request processed in 126us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.019730:0:30091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390904.019750:0:30091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390904.019756:0:30091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+4:32222:x1875263103363968:12345-0@lo:104: 00010000:00010000:0.0:1788390904.019764:0:30091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.019799:0:30091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788390904.019804:0:30091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+4:32222:x1875263103363968:12345-0@lo:104: Request processed in 49us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.019810:0:30091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390904.019823:0:30091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390904.019831:0:30091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:32222:x1875263103364096:12345-0@lo:104: 00010000:00010000:0.0:1788390904.019838:0:30091:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.019865:0:30091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788390904.019870:0:30091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+3:32222:x1875263103364096:12345-0@lo:104: Request processed in 41us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.019876:0:30091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788390904.019918:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788390904.019925:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.019934:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1a00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390904.019946:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.019957:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390904.019990:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390904.019997:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390904.020043:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020050:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390904.020072:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020080:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1a00/0x9aafc5f04cd345b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd345bf expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020096:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390904.020099:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020106:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390904.020109:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020117:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390904.020142:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390904.020148:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390904.020163:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020170:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390904.020188:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020196:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62e00/0x9aafc5f04cd3446f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34476 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020205:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390904.020209:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020214:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390904.020218:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020224:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390904.020231:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390904.020237:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788390904.020256:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020262:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390904.020269:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020275:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92600/0x9aafc5f04cd34422 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34429 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.020289:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390904.020291:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390904.020293:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390904.020302:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390904.020327:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103364224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390904.020366:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390904.020808:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103364480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390904.020845:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390904.020884:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390904.020891:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103364352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390904.020915:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390904.020982:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364224 00000100:00100000:1.0:1788390904.020988:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364224 00010000:00010000:1.0:1788390904.021024:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 19 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390904.021115:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364480 00000100:00100000:1.0:1788390904.021118:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364480 00010000:00010000:1.0:1788390904.021142:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 20 pid: 30102 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390904.021154:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364352 00000100:00100000:1.0:1788390904.021157:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364352 00010000:00010000:1.0:1788390904.021168:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 21 pid: 30101 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390904.021182:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390904.021191:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+21:3289:x1875263103364224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390904.021206:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390904.021212:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 21 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021224:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 21 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021247:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390904.021292:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+21:3289:x1875263103364224:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390904.021300:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390904.021317:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390904.021323:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+20:3287:x1875263103364480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390904.021330:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390904.021335:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 20 pid: 30102 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021343:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 20 pid: 30102 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021353:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390904.021379:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+20:3287:x1875263103364480:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390904.021386:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390904.021399:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390904.021405:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103364352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390904.021412:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390904.021417:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 19 pid: 30101 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021426:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 19 pid: 30101 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390904.021435:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390904.021456:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103364352:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390904.021463:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390904.021538:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103364352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390904.021548:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103364480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390904.021790:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd345bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd345b8 expref: 18 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.021806:0:32222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363840:0@lo:104: 00010000:00010000:3.0:1788390904.021818:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd3446f expref: 17 pid: 30101 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.021826:0:32222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363968:0@lo:104: 00010000:00010000:3.0:1788390904.021836:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34422 expref: 16 pid: 30102 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390904.021853:0:32222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103364096:0@lo:104: 00000100:00100000:0.0:1788390904.022277:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103364224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390904.033008:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390904.033061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390904.034775:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0a00/0x9aafc5f04cd346f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff41d expref: 12 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390904.034803:0:32222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363712:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390904.034820:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd3472b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff47f expref: 11 pid: 30100 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390904.034829:0:32222:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32222:1875263103363584:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390904.034871:0:32222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.034881:0:32222:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.035136:0:32222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.035144:0:32222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34755 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390904.445211:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390904.445267:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390904.445421:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093962112 00000100:00100000:0.0:1788390904.445435:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093962112 00000100:00100000:0.0:1788390904.445533:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788390904.445548:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2358:x1875263093962112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390904.445659:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2358:x1875263093962112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 115us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.445668:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390904.445937:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390904.445989:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390904.451751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390904.451898:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390904.452039:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093962624 00000100:00100000:0.0:1788390904.452045:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093962624 00000100:00100000:0.0:1788390904.452207:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390904.452221:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093962368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390904.452323:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093962368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 105us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.452332:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390904.452353:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390904.452361:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2358:x1875263093962624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390904.452388:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2358:x1875263093962624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.452395:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390904.453384:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390904.453493:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390904.453524:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093962496 00000100:00100000:1.0:1788390904.453532:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093962496 00000100:00100000:0.0:1788390904.453588:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093962240 00000100:00100000:0.0:1788390904.453593:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093962240 00000100:00080000:3.0:1788390904.453990:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390904.454072:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390904.454075:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390904.454414:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390904.454428:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+6:2358:x1875263093962496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390904.454514:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+6:2358:x1875263093962496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 89us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390904.454522:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788390904.455253:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390904.455265:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093962240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390904.455314:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093962240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.455321:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390904.455414:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788390904.455424:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d0a7814-65be-4163-903b-0e55692238e5+5:2358:x1875263093962752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390904.455454:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d0a7814-65be-4163-903b-0e55692238e5+5:2358:x1875263093962752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390904.455460:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:0.0:1788390904.781373:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390904.890129:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390904.890302:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093962880 00000100:00100000:0.0:1788390904.890317:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093962880 00000100:00100000:0.0:1788390904.890403:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390904.890416:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:22261:x1875263093962880:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390904.890445:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390904.890473:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3475c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4b0 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890559:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890577:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890592:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890610:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890618:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.890641:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891402:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891416:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891426:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390904.891457:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390904.891461:0:30107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390904.891506:0:30107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891519:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891525:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891532:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891539:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390904.891543:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891552:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891572:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788390904.891576:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390904.891582:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891589:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891604:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891610:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891616:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891622:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390904.891625:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891631:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891638:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d684d23700) 00010000:00010000:0.0:1788390904.891641:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390904.891645:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891650:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3476a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891701:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3475c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b0 expref: 8 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891716:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b0 expref: 7 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.891725:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390904.891727:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390904.891730:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788390904.892057:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:22261:x1875263093962880:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1642us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390904.892067:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390904.896530:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390904.896621:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093963136 00000100:00100000:0.0:1788390904.896633:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093963136 00000100:00100000:0.0:1788390904.896773:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390904.896786:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:22261:x1875263093963136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390904.896814:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390904.896841:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34778 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4b7 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.896945:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897007:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897023:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897055:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897062:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897069:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897508:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3478d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897518:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3478d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897525:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3478d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390904.897535:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788390904.897778:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897787:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897795:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897802:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390904.897807:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897824:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897839:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d684d23200) 00010000:00010000:0.0:1788390904.897842:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390904.897847:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897854:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3477f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897866:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897873:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897879:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897884:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390904.897886:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897891:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897898:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d684d23700) 00010000:00010000:0.0:1788390904.897901:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390904.897904:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.897919:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd34786 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.898514:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34778 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b7 expref: 10 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.898531:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3478d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b7 expref: 9 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390904.898539:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:0.0:1788390904.898542:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390904.898545:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b800, rc 0) 00000100:00100000:0.0:1788390904.898629:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:22261:x1875263093963136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1843us (2110us total) trans 17179869185 rc 0/0 00000100:00100000:0.0:1788390904.898638:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788390904.902654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000040:00080000:3.0:1788390904.974951:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788390905.013812:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.025840:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.028006:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.031189:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.031281:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093963904 00000100:00100000:0.0:1788390905.031294:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093963904 00010000:00010000:0.0:1788390905.031345:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4a9 expref: 6 pid: 30817 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.031395:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390905.031407:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d0a7814-65be-4163-903b-0e55692238e5+6:2356:x1875263093963904:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390905.031425:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390905.031433:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4a9 expref: 6 pid: 30817 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.031471:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd3474e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4a9 expref: 6 pid: 30817 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.031497:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788390905.031503:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd347b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.031514:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd347b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.031521:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd347b0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.031546:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390905.031628:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d0a7814-65be-4163-903b-0e55692238e5+6:2356:x1875263093963904:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 223us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.031636:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390905.064222:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.064483:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093964032 00000100:00100000:0.0:1788390905.064497:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093964032 00000100:00100000:0.0:1788390905.064706:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390905.064721:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:22276:x1875263093964032:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:0.0:1788390905.064755:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.064786:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd347be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4c5 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.064875:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.064912:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.064925:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.065003:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390905.065008:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390905.065060:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.065087:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd347be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4c5 expref: 11 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.065105:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4c5 expref: 10 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.065116:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.065128:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390905.065133:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788390905.065203:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+10:22276:x1875263093964032:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 486us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.065211:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390905.067362:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.067440:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093964160 00000100:00100000:0.0:1788390905.067452:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093964160 00000100:00100000:0.0:1788390905.067519:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390905.067531:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+10:22276:x1875263093964160:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:0.0:1788390905.067557:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.067609:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd347cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4cc expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067686:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067700:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067713:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067730:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067737:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.067744:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073485:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd347e1 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073511:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd347e1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073525:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd347e1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.073574:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390905.073578:0:30107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390905.073598:0:30107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd347e1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073628:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073635:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073643:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073650:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.073655:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073663:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073679:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.073683:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.073688:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073694:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd347d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073711:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073718:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073724:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073736:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.073739:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073746:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073755:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff95d684d23300) 00010000:00010000:0.0:1788390905.073758:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.073761:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073767:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd347da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073809:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd347cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4cc expref: 12 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073824:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd347e1 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4cc expref: 11 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.073833:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d684d23900) 00010000:00010000:0.0:1788390905.073835:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390905.073838:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a200, rc 0) 00000100:00100000:0.0:1788390905.074043:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+11:22276:x1875263093964160:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 6511us (6690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.074059:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390905.081412:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390905.090908:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.090940:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.090948:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.090954:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.090998:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.091007:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.091024:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:0.0:1788390905.091027:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390905.091032:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.091037:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd347e8 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390905.098593:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.103035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.103174:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093964800 00000100:00100000:0.0:1788390905.103183:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093964800 00000100:00100000:0.0:1788390905.103235:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390905.103245:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:22277:x1875263093964800:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390905.103266:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.103285:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3480b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4da expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.103375:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390905.103507:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3480b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4da expref: 14 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.103522:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.103525:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390905.103530:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3480b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4da expref: 14 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.103544:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a400, rc 0) 00000100:00100000:0.0:1788390905.103604:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22277:x1875263093964800:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 360us (587us total) trans 17179869188 rc 301/301 00000100:00100000:0.0:1788390905.103612:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390905.116896:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.117242:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093965056 00000100:00100000:0.0:1788390905.117251:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093965056 00000100:00100000:0.0:1788390905.117308:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390905.117321:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22277:x1875263093965056:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:0.0:1788390905.117380:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390905.117409:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34804 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4d3 expref: 13 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.117428:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390905.117437:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390905.117463:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34819 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.117473:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34819 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.117479:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34819 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390905.117662:0:30107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e24c9bf reply state 000000007a921ecb transno 17179869189 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34819 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.117669:0:30107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788390905.117675:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788390905.117745:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:22277:x1875263093965056:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 427us (860us total) trans 17179869189 rc 0/0 00000100:00100000:0.0:1788390905.117752:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788390905.119780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.119991:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093965312 00000100:00100000:3.0:1788390905.120000:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093965312 00000100:00100000:3.0:1788390905.120055:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390905.120065:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22277:x1875263093965312:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390905.120286:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:22277:x1875263093965312:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 221us (508us total) trans 17179869190 rc 0/0 00000100:00100000:3.0:1788390905.120293:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788390905.125854:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.125998:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093965568 00000100:00100000:0.0:1788390905.126010:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093965568 00000100:00100000:0.0:1788390905.126066:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390905.126077:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:22277:x1875263093965568:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390905.126102:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.126132:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4e1 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126216:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126230:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126241:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126257:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126263:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126283:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.126404:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390905.126500:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126507:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126514:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126519:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.126524:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126531:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126544:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.126546:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.126551:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126557:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126570:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126586:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126592:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126597:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.126600:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126605:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126613:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff95d684d23f00) 00010000:00010000:0.0:1788390905.126615:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.126617:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126622:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd3482e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126658:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4e1 expref: 16 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126666:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.126668:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390905.126670:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd34820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4e1 expref: 16 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.126685:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ba00, rc 0) 00000100:00100000:0.0:1788390905.126727:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:22277:x1875263093965568:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 654us (886us total) trans 17179869191 rc 301/301 00000100:00100000:0.0:1788390905.126733:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390905.130332:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.138574:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.138916:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093965824 00000100:00100000:3.0:1788390905.138927:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093965824 00000100:00100000:3.0:1788390905.139021:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390905.139033:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:22277:x1875263093965824:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:3.0:1788390905.145157:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:22277:x1875263093965824:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 6116us (6582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.145171:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390905.151713:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.151953:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093966080 00000100:00100000:1.0:1788390905.152173:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093966080 00000100:00100000:1.0:1788390905.152285:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390905.152299:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:22277:x1875263093966080:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390905.152619:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22277:x1875263093966080:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 322us (920us total) trans 17179869192 rc 0/0 00000100:00100000:1.0:1788390905.152628:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390905.196690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000004:00080000:3.0:1788390905.199182:0:30108:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1821us 00010000:00010000:3.0:1788390905.209834:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.209868:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.209887:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.209906:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.209914:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.209921:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210229:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210239:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210247:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390905.210276:0:30108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390905.210281:0:30108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390905.210325:0:30108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210340:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210358:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210365:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210372:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390905.210377:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210384:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210401:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390905.210404:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390905.210409:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210415:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd34851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210426:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210431:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210437:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210442:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390905.210451:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210458:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210466:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff95d6a704c100) 00010000:00010000:3.0:1788390905.210468:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390905.210472:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210477:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd34858 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210528:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3484a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4ef expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210546:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4ef expref: 18 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.210554:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:3.0:1788390905.210557:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788390905.210561:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390905.210656:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:22283:x1875263093966208:12345-192.168.202.1@tcp:101:dd.500 Request processed in 13436us (13974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.210667:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788390905.213693:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.213746:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.213778:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093966592 00000100:00100000:3.0:1788390905.213790:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093966592 00000100:00100000:3.0:1788390905.213881:0:30093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390905.213894:0:30093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:2357:x1875263093966592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390905.213913:0:30093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390905.213941:0:30093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd3485f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4ef expref: 18 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.213983:0:30093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:3.0:1788390905.213989:0:30093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390905.214043:0:30093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:2357:x1875263093966592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 154us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.214049:0:30093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390905.214558:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093966464 00000100:00100000:0.0:1788390905.214566:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093966464 00000100:00100000:0.0:1788390905.214617:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390905.214627:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22283:x1875263093966464:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788390905.214647:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.214650:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390905.214665:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd34843 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4e8 expref: 17 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.214680:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e100) 00010000:00010000:0.0:1788390905.214692:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390905.214712:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34866 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4f6 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.214923:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.214945:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.214957:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.214999:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.215008:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.215016:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216006:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3487b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216018:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3487b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216028:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3487b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.216039:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390905.216072:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216080:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216087:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216094:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.216099:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216129:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216142:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d684d23f00) 00010000:00010000:0.0:1788390905.216146:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.216151:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216157:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd3486d lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390905.216171:0:30107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cfa31d5 reply state 00000000c1dcb30a transno 17179869193 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.216181:0:30107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390905.216218:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34866 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4f6 expref: 19 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216239:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3487b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4f6 expref: 18 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.216246:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390905.216249:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788390905.216251:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ba00, rc 0) 00000100:00100000:0.0:1788390905.216342:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:22283:x1875263093966464:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1717us (2659us total) trans 17179869193 rc 0/0 00000100:00100000:0.0:1788390905.216352:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00010000:00010000:3.0:1788390905.217590:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217605:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217613:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217619:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390905.217623:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217630:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217646:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff95d684d23a00) 00010000:00010000:3.0:1788390905.217649:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390905.217665:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.217672:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd34874 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390905.228686:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.229326:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093966848 00000100:00100000:3.0:1788390905.229341:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093966848 00000100:00100000:3.0:1788390905.229416:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390905.229429:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:22283:x1875263093966848:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:3.0:1788390905.229902:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:22283:x1875263093966848:12345-192.168.202.1@tcp:35:dd.500 Request processed in 473us (1228us total) trans 17179869194 rc 0/0 00000100:00100000:3.0:1788390905.229912:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390905.293668:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364736 00000100:00100000:0.0:1788390905.293696:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364736 00000100:00100000:0.0:1788390905.293791:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390905.293803:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103364736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390905.293851:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390905.293904:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103364736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.293913:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788390905.294484:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390905.295570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.295662:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093967104 00000100:00100000:0.0:1788390905.295670:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093967104 00000100:00100000:0.0:1788390905.295793:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390905.295804:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:22293:x1875263093967104:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390905.295831:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.295854:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff4fd expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.295952:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296173:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296187:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296201:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296206:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296225:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.296346:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390905.296476:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296483:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296488:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296492:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.296495:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296500:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296521:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.296523:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.296527:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296532:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd34890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296543:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296555:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296559:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296562:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.296563:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296567:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296571:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff95d684d23f00) 00010000:00010000:0.0:1788390905.296572:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.296574:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296578:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd34897 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296612:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34889 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4fd expref: 21 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296619:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.296621:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390905.296623:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd34889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4fd expref: 21 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.296636:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a000, rc 0) 00000100:00100000:0.0:1788390905.296696:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22293:x1875263093967104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 894us (1130us total) trans 17179869195 rc 301/301 00000100:00100000:0.0:1788390905.296879:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390905.302289:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.302381:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093967360 00000100:00100000:3.0:1788390905.302395:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093967360 00000100:00100000:3.0:1788390905.302457:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390905.302467:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22293:x1875263093967360:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390905.333251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.333397:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093967488 00000100:00100000:0.0:1788390905.333411:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093967488 00000100:00100000:0.0:1788390905.333677:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1788390905.333688:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+11:21661:x1875263093967488:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390905.333708:0:30102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.333729:0:30102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd348a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff504 expref: -99 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.333759:0:30102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd348a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff504 expref: 12 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.333768:0:30102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd348a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff504 expref: 12 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.333776:0:30102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a000, rc 0) 00000100:00100000:0.0:1788390905.334141:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+12:21661:x1875263093967488:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 453us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.334150:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788390905.338803:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.338935:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093967616 00000100:00100000:3.0:1788390905.338950:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093967616 00000100:00100000:3.0:1788390905.339081:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390905.339096:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+12:21661:x1875263093967616:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390905.339625:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+12:21661:x1875263093967616:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 532us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.339634:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390905.341839:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.341928:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093967744 00000100:00100000:0.0:1788390905.341943:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093967744 00000100:00100000:0.0:1788390905.342265:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788390905.342298:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+12:21661:x1875263093967744:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.343411:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+12:21661:x1875263093967744:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 1107us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.343424:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390905.348691:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.353229:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093968000 00000100:00100000:3.0:1788390905.353265:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093968000 00000100:00100000:3.0:1788390905.353415:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390905.353428:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:21661:x1875263093968000:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390905.353826:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:21661:x1875263093968000:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 398us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.353835:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390905.358472:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.358593:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.358687:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093968256 00000100:00100000:0.0:1788390905.358693:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093968256 00000100:00100000:0.0:1788390905.358749:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:0.0:1788390905.358762:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21661:x1875263093968256:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.359088:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:21661:x1875263093968256:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 327us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.359098:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:3.0:1788390905.362672:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.365946:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.366170:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093968768 00000100:00100000:1.0:1788390905.366244:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093968768 00000100:00100000:1.0:1788390905.366311:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390905.366324:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+24:22299:x1875263093968768:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788390905.366831:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:22299:x1875263093968768:12345-192.168.202.1@tcp:35:dd.500 Request processed in 508us (894us total) trans 17179869198 rc 0/0 00000100:00100000:1.0:1788390905.366840:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390905.413492:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.413571:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093969024 00000100:00100000:1.0:1788390905.413585:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093969024 00000100:00100000:1.0:1788390905.413803:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788390905.413817:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:22307:x1875263093969024:12345-192.168.202.1@tcp:36:truncate.500 00010000:00010000:1.0:1788390905.413903:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390905.413940:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd348d6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff519 expref: 25 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.414335:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390905.414343:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390905.414645:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd348e4 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.414664:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd348e4 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.414678:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd348e4 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390905.414758:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869199 00000004:00010000:1.0:1788390905.414789:0:30107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004524e49d reply state 0000000027b5dc60 transno 17179869200 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd348e4 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390905.414800:0:30107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390905.415014:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+27:22307:x1875263093969024:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 1146us (1480us total) trans 17179869200 rc 0/0 00000100:00100000:1.0:1788390905.415046:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000020:00080000:1.0:1788390905.415052:0:30107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788390905.463366:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.463468:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093969152 00000100:00100000:0.0:1788390905.463479:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093969152 00000100:00100000:0.0:1788390905.463545:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390905.463554:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+26:22313:x1875263093969152:12345-192.168.202.1@tcp:101:truncate.500 00010000:00010000:0.0:1788390905.463586:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.463613:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd348eb lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff520 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463695:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463710:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463733:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463767:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463775:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463783:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.463989:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464000:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464007:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.464045:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 256 00000004:00200000:0.0:1788390905.464049:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390905.464072:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464084:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464090:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464095:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464108:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464112:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.464128:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464137:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464156:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:0.0:1788390905.464159:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.464164:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464170:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd348f2 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464186:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464192:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464198:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464203:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390905.464206:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464229:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464237:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff95d684d23600) 00010000:00010000:0.0:1788390905.464239:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390905.464242:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464247:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd348f9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464286:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd348eb lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff520 expref: 28 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464301:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34900 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff520 expref: 27 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.464308:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390905.464310:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390905.464313:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:0.0:1788390905.464403:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+27:22313:x1875263093969152:12345-192.168.202.1@tcp:101:truncate.500 Request processed in 847us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.464412:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788390905.467702:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390905.470300:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.470327:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.470417:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390905.470503:0:30109:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869201 00000004:00010000:3.0:1788390905.470529:0:30109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba2b3c82 reply state 00000000d6ca4fb0 transno 17179869202 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390905.470540:0:30109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390905.470685:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+29:22313:x1875263093969408:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 2776us (2993us total) trans 17179869202 rc 0/0 00000100:00100000:3.0:1788390905.470697:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000020:00080000:3.0:1788390905.470722:0:30109:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390905.473089:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473110:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473129:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473136:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390905.473141:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473150:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473175:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390905.473178:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390905.473183:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.473190:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0000/0x9aafc5f04cd34907 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390905.505471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.512715:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.512825:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.513283:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093970048 00000100:00100000:0.0:1788390905.513289:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093970048 00000100:00100000:0.0:1788390905.513332:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788390905.513341:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+29:22319:x1875263093970048:12345-192.168.202.1@tcp:36:dd.500 00010000:00010000:0.0:1788390905.513705:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34931 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.514053:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34931 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.514069:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34931 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390905.514148:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869204 00000004:00010000:0.0:1788390905.514179:0:30107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090b60b5a reply state 000000009e0f01b6 transno 17179869205 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34931 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.514189:0:30107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390905.514290:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+32:22319:x1875263093970048:12345-192.168.202.1@tcp:36:dd.500 Request processed in 948us (1462us total) trans 17179869205 rc 0/0 00000100:00100000:0.0:1788390905.514297:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000020:00080000:0.0:1788390905.514302:0:30107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788390905.518111:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.585223:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.585351:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093970560 00000100:00100000:0.0:1788390905.585365:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093970560 00000100:00100000:0.0:1788390905.585438:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390905.585448:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+32:22329:x1875263093970560:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390905.585481:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.585504:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd34938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff52e expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.585633:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788390905.585797:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd34938 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff52e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.585831:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390905.585834:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390905.585839:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd34938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff52e expref: 34 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.585852:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93000, rc 0) 00000100:00100000:0.0:1788390905.585920:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+33:22329:x1875263093970560:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 474us (719us total) trans 17179869207 rc 301/301 00000100:00100000:0.0:1788390905.585926:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788390905.589269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.589548:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093970816 00000100:00100000:1.0:1788390905.589564:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093970816 00000100:00100000:1.0:1788390905.589682:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390905.589696:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+33:22329:x1875263093970816:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390905.590078:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+34:22329:x1875263093970816:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 385us (823us total) trans 17179869208 rc 0/0 00000100:00100000:1.0:1788390905.590087:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 10000000:01000000:0.0:1788390905.677184:0:30105:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390905.677194:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d587f66800 from 10 10000000:01000000:0.0:1788390905.677200:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390905.677267:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.677279:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.677290:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.677317:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103364864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.677413:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.677495:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390905.677593:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364864 00000100:00100000:3.0:1788390905.677603:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364864 00000100:00100000:3.0:1788390905.677675:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788390905.677689:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+16:30105:x1875263103364864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390905.677795:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390905.677811:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd3494d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34946 expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.677841:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd3494d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34946 expref: 17 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.677853:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd3494d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34946 expref: 17 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.677864:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788390905.677953:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103364864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.677985:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788390905.678072:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103364864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390905.678089:0:30105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.678106:0:30105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.678188:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103364992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.678215:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.678248:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390905.678303:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103364992 00000100:00100000:3.0:1788390905.678308:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103364992 00000100:00100000:3.0:1788390905.678340:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390905.678348:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103364992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390905.678769:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103364992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.678777:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788390905.681007:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103364992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.681583:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.681689:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.681872:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390905.681934:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103365120 00000100:00100000:3.0:1788390905.681943:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103365120 00000100:00100000:3.0:1788390905.682095:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788390905.682109:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103365120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390905.682407:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103365120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.682425:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788390905.683587:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788390905.686759:0:32237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788390905.687763:0:30105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788390905.687802:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788390905.687819:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.687835:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390905.687850:0:30105:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788390905.687853:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bc63a000 from 10 10000000:01000000:0.0:1788390905.687857:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390905.687912:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.687922:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.687957:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.689919:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.690186:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.690243:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390905.690385:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103365248 00000100:00100000:3.0:1788390905.690395:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103365248 00000100:00100000:3.0:1788390905.690563:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788390905.690576:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+17:30105:x1875263103365248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390905.690596:0:30102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390905.690618:0:30102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd3495b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34954 expref: -99 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.690650:0:30102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd3495b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34954 expref: 18 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.690662:0:30102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd3495b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34954 expref: 18 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.690673:0:30102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390905.690739:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:30105:x1875263103365248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.690747:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788390905.690833:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390905.690850:0:30105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.690861:0:30105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390905.690934:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.690993:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.691643:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390905.692662:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.692767:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390905.692822:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390905.692880:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390905.693649:0:30105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390905.694893:0:32238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788390905.695445:0:30105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390905.695474:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390905.695488:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.695501:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390905.695513:0:30105:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390905.695516:0:30105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d587662000 from 10 10000000:01000000:1.0:1788390905.695520:0:30105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390905.695568:0:30105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.695576:0:30105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.695602:0:30105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390905.695627:0:30105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:30105:1875263103365632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390905.695698:0:30105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390905.695744:0:30105:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684eb3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390905.695849:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103365632 00000100:00100000:3.0:1788390905.695858:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103365632 00000100:00100000:3.0:1788390905.695913:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788390905.695923:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:30105:x1875263103365632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390905.695940:0:30100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390905.695955:0:30100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34969 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34962 expref: -99 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.696032:0:30100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34962 expref: 19 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.696043:0:30100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1400/0x9aafc5f04cd34969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34962 expref: 19 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390905.696054:0:30100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788390905.696106:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103365632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.696124:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788390905.697148:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103365760 00000100:00100000:1.0:1788390905.697154:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103365760 00000100:00100000:1.0:1788390905.697206:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788390905.697216:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103365760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390905.697768:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103365760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 553us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390905.697777:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390905.698184:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103365888 00000100:00100000:3.0:1788390905.698190:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103365888 00000100:00100000:3.0:1788390905.698222:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788390905.698230:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103365888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390905.698397:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:30105:x1875263103365888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390905.698404:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000020:01000000:1.0:1788390905.700523:0:30105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390905.700562:0:30105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390905.700575:0:30105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.700589:0:30105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.805498:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390905.822922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390905.823206:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093970944 00000100:00100000:1.0:1788390905.823221:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093970944 00000100:00100000:1.0:1788390905.823306:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1788390905.823320:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+34:22366:x1875263093970944:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788390905.823356:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390905.823405:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff535 expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823500:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823516:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823531:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390905.823575:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390905.823580:0:30109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390905.823625:0:30109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823658:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff535 expref: 36 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823679:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff535 expref: 35 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.823688:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390905.823691:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390905.823696:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390905.824740:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:22366:x1875263093970944:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 1415us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390905.824752:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788390905.828867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390905.832083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.832321:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093971328 00000100:00100000:0.0:1788390905.832351:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093971328 00000100:00100000:0.0:1788390905.832420:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788390905.832433:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22366:x1875263093971328:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788390905.832459:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390905.832494:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3498c lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff543 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.832737:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34993 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.832753:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34993 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.832766:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34993 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390905.832833:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390905.833024:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd3498c lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff543 expref: 39 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.833045:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34993 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff543 expref: 38 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.833055:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390905.833060:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390905.833064:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:0.0:1788390905.833329:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:22366:x1875263093971328:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 897us (1258us total) trans 17179869209 rc 0/0 00000100:00100000:0.0:1788390905.833339:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788390905.835935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.836339:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093971584 00000100:00100000:0.0:1788390905.836353:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093971584 00000100:00100000:0.0:1788390905.836434:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390905.836447:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:22366:x1875263093971584:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1788390905.836467:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788390905.836500:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34993 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff543 expref: 38 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.836525:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd34985 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff53c expref: 37 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.836538:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3487b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4f6 expref: 36 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.836550:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390905.836562:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390905.836643:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:22366:x1875263093971584:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 198us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.836651:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788390905.838942:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390905.839125:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093971712 00000100:00100000:0.0:1788390905.839138:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093971712 00000100:00100000:0.0:1788390905.839198:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788390905.839212:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:22366:x1875263093971712:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1788390905.839373:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.839393:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390905.839418:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390905.840558:0:30817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390905.840686:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 64 off8448 00000040:00080000:0.0:1788390905.840912:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 136 off8328 00000100:00100000:0.0:1788390905.841366:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:22366:x1875263093971712:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 2150us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390905.841378:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788390905.843621:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093971840 00000100:00100000:1.0:1788390905.843635:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093971840 00000100:00100000:1.0:1788390905.843719:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788390905.843732:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:22366:x1875263093971840:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390905.843760:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390905.843790:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff54a expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843866:0:30109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843878:0:30109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 36 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843902:0:30109:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843919:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 36 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843936:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:1.0:1788390905.843939:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390905.843943:0:30109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 36 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390905.843952:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390905.844067:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22366:x1875263093971840:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 337us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390905.844074:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000040:00080000:3.0:1788390905.997501:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390905.997514:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390905.997559:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:3.0:1788390905.997567:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788390905.997819:0:30144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:30144:1875263103366016:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390905.998006:0:30144:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390906.004065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390906.004318:0:30144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:30144:1875263103366016:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1788390906.005346:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390906.008319:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093972096 00000100:00100000:3.0:1788390906.008610:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093972096 00000100:00100000:3.0:1788390906.008772:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788390906.008787:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22367:x1875263093972096:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390906.008832:0:30108:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390906.009041:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22367:x1875263093972096:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 257us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390906.009049:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788390906.018043:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390906.018280:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093972224 00000100:00100000:3.0:1788390906.018293:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093972224 00000100:00100000:0.0:1788390906.018529:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390906.018546:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22367:x1875263093972224:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.018645:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018665:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018683:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018702:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018710:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018716:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018771:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018781:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018787:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390906.018839:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788390906.018844:0:30107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390906.018858:0:30107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018871:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018879:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018886:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018893:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.018897:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018905:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018918:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:0.0:1788390906.018927:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.018933:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018940:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd349af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018954:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018988:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.018995:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019000:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.019002:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019008:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019258:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xbe39250a (ffff95d684d23d00) 00010000:00010000:0.0:1788390906.019262:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.019265:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019271:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019287:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019300:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019307:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019312:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.019315:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019335:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019345:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:0.0:1788390906.019532:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.019537:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.019543:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349bd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.019645:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22367:x1875263093972224:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1102us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.019655:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1788390906.022845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.022952:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093972480 00000100:00100000:0.0:1788390906.023138:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093972480 00000100:00100000:0.0:1788390906.023224:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788390906.023236:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:22367:x1875263093972480:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.023262:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390906.023302:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd349c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff551 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023599:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023618:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023633:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390906.023646:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788390906.023782:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023791:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023798:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023805:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.023811:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023818:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023832:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:0.0:1788390906.023835:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390906.023840:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023856:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd349cb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023907:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd349c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff551 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023919:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:0.0:1788390906.023921:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390906.023925:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd349c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff551 expref: 38 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.023934:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:0.0:1788390906.024774:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:22367:x1875263093972480:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1940us total) trans 17179869210 rc 301/301 00000100:00100000:0.0:1788390906.024782:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788390906.029247:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093972608 00000100:00100000:3.0:1788390906.029258:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093972608 00000100:00100000:3.0:1788390906.034528:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093972864 00000100:00100000:3.0:1788390906.034542:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093972864 00000100:00100000:3.0:1788390906.034616:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390906.034629:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:22367:x1875263093972864:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390906.034657:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390906.034661:0:30108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390906.034697:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34977 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff535 expref: 37 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.034731:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788390906.034736:0:30108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390906.034753:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd349d9 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff558 expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390906.036298:0:30108:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x44:0x0], count =30 00000004:00080000:3.0:1788390906.036313:0:30108:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x44:0x0]+30 in llog 00000100:00100000:0.0:1788390906.042211:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093973120 00000100:00100000:0.0:1788390906.042226:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093973120 00000100:00100000:0.0:1788390906.042306:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390906.042329:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:22367:x1875263093973120:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.042576:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390906.042611:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd349e0 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff558 expref: 38 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042634:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d68641e800) 00010000:00010000:0.0:1788390906.042646:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390906.042675:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042721:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042732:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042749:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042757:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042764:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042847:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042854:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042860:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042866:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.042870:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042877:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042886:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:0.0:1788390906.042894:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.042899:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042904:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd349ee lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042916:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042922:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042928:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042933:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.042935:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042941:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042948:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xb1da5617 (ffff95d684d23d00) 00010000:00010000:0.0:1788390906.042950:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.042953:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.042957:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd349f5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xb1da5617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.043766:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:22367:x1875263093973120:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1443us (1650us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390906.043786:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390906.050278:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093973248 00000100:00100000:0.0:1788390906.050294:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093973248 00000100:00100000:0.0:1788390906.050403:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788390906.050418:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:22367:x1875263093973248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.050625:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390906.050657:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd349fc lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff55f expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050710:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050726:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050741:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050892:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd349fc lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 39 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050919:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 38 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.050930:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390906.050934:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390906.050939:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92800, rc 0) 00000100:00100000:0.0:1788390906.051626:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:22367:x1875263093973248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1206us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.051648:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1788390906.057947:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093973504 00000100:00100000:1.0:1788390906.058001:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093973504 00000100:00100000:1.0:1788390906.058089:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788390906.058103:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:22367:x1875263093973504:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390906.058233:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.058257:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.058273:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390906.059596:0:30109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 88 off8344 00000004:00080000:1.0:1788390906.059616:0:30109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 723166655084ns, next at 724166651169ns, rc = 0 00000004:00010000:1.0:1788390906.059755:0:30109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071dc3c4e reply state 00000000762c960c transno 17179869212 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.059768:0:30109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390906.059924:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:22367:x1875263093973504:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1820us (2108us total) trans 17179869212 rc 0/0 00000100:00100000:1.0:1788390906.059933:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:3.0:1788390906.062502:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062524:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062534:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062540:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390906.062546:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062556:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062579:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788390906.062583:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390906.062589:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.062596:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a0a lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.065343:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093973632 00000100:00100000:0.0:1788390906.065358:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093973632 00000100:00100000:0.0:1788390906.065450:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1788390906.065464:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:22367:x1875263093973632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.065499:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390906.065528:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff566 expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.065648:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 40 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.065669:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 40 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.065696:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390906.065699:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390906.065704:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:0.0:1788390906.065782:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:22367:x1875263093973632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 321us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.065790:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788390906.069928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390906.070144:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093973760 00000100:00100000:3.0:1788390906.070158:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093973760 00000100:00080000:0.0:1788390906.070504:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390906.074328:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974016 00000100:00100000:0.0:1788390906.074475:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974016 00000100:00100000:0.0:1788390906.074555:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390906.074569:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:22367:x1875263093974016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390906.074898:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:22367:x1875263093974016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 331us (682us total) trans 17179869213 rc 0/0 00000100:00100000:0.0:1788390906.074907:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390906.078184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390906.078640:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974272 00000100:00100000:1.0:1788390906.078653:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974272 00000100:00100000:1.0:1788390906.078737:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788390906.078748:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:22367:x1875263093974272:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390906.078894:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:22367:x1875263093974272:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 147us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.078902:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1788390906.081703:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.081883:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974400 00000100:00100000:0.0:1788390906.081895:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974400 00000100:00100000:0.0:1788390906.082048:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1788390906.082061:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:22367:x1875263093974400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.082088:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390906.082128:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34a18 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff56d expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082220:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082237:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082252:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390906.082303:0:30108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390906.082324:0:30108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082506:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34a18 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff56d expref: 43 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082527:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff56d expref: 42 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.082554:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390906.082557:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788390906.082562:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:0.0:1788390906.082903:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:22367:x1875263093974400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 843us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.082912:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788390906.088768:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974528 00000100:00100000:3.0:1788390906.088804:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974528 00000100:00100000:1.0:1788390906.095288:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974784 00000100:00100000:1.0:1788390906.095308:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974784 00000100:00100000:1.0:1788390906.095403:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390906.095415:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:22367:x1875263093974784:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788390906.095766:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:22367:x1875263093974784:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 353us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.095775:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788390906.100876:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.100915:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093974912 00000100:00100000:0.0:1788390906.100929:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093974912 00000100:00100000:0.0:1788390906.101034:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390906.101046:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:22367:x1875263093974912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.101070:0:30793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390906.101093:0:30793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff57b expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.101147:0:30793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.101159:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390906.101165:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390906.101173:0:30793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 8 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.101216:0:30793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.101257:0:30793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.101276:0:30793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103366144:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390906.101391:0:30793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390906.104210:0:30793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103366144:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390906.104414:0:30793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 8 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.104436:0:30793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92e00, rc 0) 00000100:00100000:0.0:1788390906.104636:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:22367:x1875263093974912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3590us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.104646:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788390906.104749:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093975040 00000100:00100000:1.0:1788390906.104759:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093975040 00010000:00010000:1.0:1788390906.104800:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.104873:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390906.104885:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2357:x1875263093975040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390906.104904:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390906.104936:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.104951:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.105016:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008138fe28/0x9aafc5f04cd34a26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff574 expref: 8 pid: 30794 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.105054:0:30094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390906.105058:0:30094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390906.105069:0:30094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.105081:0:30094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.105146:0:30094:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.105165:0:30094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:30094:1875263103366272:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788390906.105256:0:30094:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683168a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390906.107592:0:30094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:30094:1875263103366272:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788390906.107624:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390906.107688:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093975040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2804us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.107701:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390906.112400:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000001:00080000:0.0:1788390906.137149:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869213 is committed 00000004:00080000:0.0:1788390906.137203:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788390906.138159:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103366400 00000100:00100000:1.0:1788390906.138169:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103366400 00000100:00100000:1.0:1788390906.138228:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390906.138240:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103366400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788390906.138497:0:30795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 256 00002000:00010000:1.0:1788390906.138503:0:30795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788390906 00002000:00010000:1.0:1788390906.138521:0:30795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788390906.138524:0:30795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788390906 -> 1788390906 00002000:00010000:1.0:1788390906.138527:0:30795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788390906.138575:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103366400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (686us total) trans 17179869188 rc 0/0 00000100:00100000:1.0:1788390906.138583:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788390906.138632:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d691118e00/2, rc 0, transno 17179869188 00000100:00100000:1.0:1788390906.138640:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103366400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788390906.139544:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390906.139609:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093975424 00000100:00100000:3.0:1788390906.139616:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093975424 00000100:00100000:3.0:1788390906.139655:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390906.139665:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:2357:x1875263093975424:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788390906.169687:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869188 is committed 00000001:00080000:0.0:1788390906.169710:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00000100:00100000:1.0:1788390906.172247:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093975680 00000100:00100000:1.0:1788390906.172261:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093975680 00000100:00100000:1.0:1788390906.172377:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1788390906.172391:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22367:x1875263093975680:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390906.172470:0:30109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390906.172508:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34a1f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff56d expref: 13 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.172532:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:1.0:1788390906.172538:0:30109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390906.172577:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34a34 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.172592:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34a34 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.172609:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34a34 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390906.172905:0:30109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a400c11 reply state 0000000092926363 transno 17179869214 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34a34 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.172929:0:30109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390906.173063:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:22367:x1875263093975680:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 676us (1135us total) trans 17179869214 rc 0/0 00000100:00100000:1.0:1788390906.173068:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788390906.174765:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390906.174807:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093975808 00000100:00100000:1.0:1788390906.174816:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093975808 00000100:00100000:1.0:1788390906.174873:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390906.174884:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2357:x1875263093975808:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788390906.175224:0:30795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 256 -> 256 00002000:00010000:1.0:1788390906.175229:0:30795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 1788390906 -> 1788390905 00002000:00010000:1.0:1788390906.175232:0:30795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 1788390905 00002000:00010000:1.0:1788390906.175234:0:30795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788390906 -> 1788390905 00002000:00010000:1.0:1788390906.175237:0:30795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788390906.176105:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093975808:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 1216us (1335us total) trans 17179869189 rc 0/0 00000100:00100000:1.0:1788390906.176125:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390906.177633:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.177702:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976064 00000100:00100000:0.0:1788390906.177713:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976064 00000100:00100000:0.0:1788390906.177781:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1788390906.177793:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22367:x1875263093976064:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.177883:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.177925:0:30108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 13 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.177935:0:30108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.178023:0:30108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 13 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.178039:0:30108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 13 pid: 30817 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.178058:0:30108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103366528:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390906.178163:0:30108:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1b6dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788390906.179689:0:30108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103366528:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390906.179690:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390906.179718:0:30108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.179761:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976192 00000100:00100000:1.0:1788390906.179769:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976192 00010000:00010000:1.0:1788390906.179811:0:30093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 14 pid: 30817 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.179846:0:30093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390906.179856:0:30093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:2356:x1875263093976192:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390906.179872:0:30093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390906.179879:0:30093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 14 pid: 30817 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.179913:0:30093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 14 pid: 30817 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.179940:0:30093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34a03 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff55f expref: 14 pid: 30817 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.179997:0:30093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:1.0:1788390906.180004:0:30093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.180015:0:30093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.180022:0:30093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.180044:0:30093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390906.180126:0:30108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180133:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180169:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180178:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180700:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180709:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.180714:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180724:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180734:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390906.180737:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788390906.180741:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.180748:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34a3b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.180797:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22367:x1875263093976064:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3005us (3168us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788390906.180806:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1788390906.180864:0:30093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:2356:x1875263093976192:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1009us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.180872:0:30093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390906.182500:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.182580:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976320 00000100:00100000:0.0:1788390906.182588:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976320 00000100:00100000:0.0:1788390906.182656:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390906.182664:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2358:x1875263093976320:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.182708:0:30793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.182726:0:30793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.182745:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390906.182749:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390906.182752:0:30793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.182786:0:30793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.182798:0:30793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.182810:0:30793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103366656:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390906.182881:0:30793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1b6dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390906.184582:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976448 00000100:00100000:1.0:1788390906.184591:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976448 00010000:00010000:1.0:1788390906.184630:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 8 pid: 30793 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.184670:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390906.184680:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2356:x1875263093976448:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390906.184715:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390906.184747:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 8 pid: 30793 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.184763:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 8 pid: 30793 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.184788:0:30094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390906.184791:0:30094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390906.184795:0:30094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.184804:0:30094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.184822:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390906.184862:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2356:x1875263093976448:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.184870:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:0.0:1788390906.184938:0:30793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002633cab1/0x9aafc5f04cd34a2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff57b expref: 7 pid: 30793 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.184955:0:30793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103366656:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390906.185103:0:30793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185127:0:30793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185135:0:30793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185172:0:30793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185181:0:30793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185191:0:30793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185198:0:30793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390906.185203:0:30793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185213:0:30793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185225:0:30793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.185233:0:30793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7bcc40e/0x9aafc5f04cd34a42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.185283:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2358:x1875263093976320:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 2619us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.185301:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390906.186487:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390906.186538:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976704 00000100:00100000:0.0:1788390906.186545:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976704 00000100:00100000:0.0:1788390906.186608:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1788390906.186615:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:22367:x1875263093976704:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390906.186692:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.186708:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.186719:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.186947:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.186956:0:30107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 13 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.187003:0:30107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.187044:0:30107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 13 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.187061:0:30107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 13 pid: 30108 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.187092:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103366784:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390906.187187:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1b6dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390906.189450:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976832 00000100:00100000:1.0:1788390906.189460:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976832 00010000:00010000:1.0:1788390906.189504:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 14 pid: 30108 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.189539:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390906.189548:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:2357:x1875263093976832:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390906.189578:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390906.189585:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 14 pid: 30108 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.189600:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 14 pid: 30108 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.189623:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:1.0:1788390906.189628:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.189638:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.189645:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.189665:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390906.189833:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:2357:x1875263093976832:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 285us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.189841:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:0.0:1788390906.190053:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a11 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff566 expref: 13 pid: 30108 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.190071:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103366784:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390906.190095:0:30107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.190104:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.190124:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390906.190355:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869215 00000001:00080000:0.0:1788390906.190516:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869216 00000001:00080000:0.0:1788390906.190564:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869217 00000100:00100000:0.0:1788390906.190656:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103366912:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788390906.190827:0:30107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.190883:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390906.190919:0:30112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103366912 00000100:00100000:1.0:1788390906.190926:0:30112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103366912 00000100:00100000:1.0:1788390906.190994:0:30112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390906.191004:0:30112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30107:x1875263103366912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788390906.191117:0:30112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30107:x1875263103366912:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.191126:0:30112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390906.191255:0:30107:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869188 gen 2 00000004:00080000:0.0:1788390906.191263:0:30107:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d691118e00, transno 17179869188 00000100:00100000:0.0:1788390906.191286:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103366912:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788390906.192539:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869218 00000100:00100000:0.0:1788390906.192621:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103367040:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788390906.192841:0:30107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.192867:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1b6dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788390906.192999:0:30112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390906.193023:0:30112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:30107:x1875263103367040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788390906.194420:0:30112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:30107:x1875263103367040:12345-0@lo:1000:mdt00_000.0 Request processed in 1405us (1572us total) trans 17179869190 rc 0/0 00000100:00100000:1.0:1788390906.194432:0:30112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390906.194631:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103367040:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788390906.194682:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194693:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194701:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194716:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.194722:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194731:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194750:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390906.194753:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390906.194758:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194766:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34a50 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194805:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194809:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194822:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194826:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.194828:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194831:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194837:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:0.0:1788390906.194838:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390906.194845:0:30107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 16 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194855:0:30107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 16 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194861:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 16 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.194891:0:30107:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 16 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.194902:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103367168:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788390906.195098:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390906.197581:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103367168:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390906.197640:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197651:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd349a1 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197693:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197709:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197724:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197737:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197744:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197752:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197758:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.197762:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197770:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197784:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:0.0:1788390906.197787:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390906.197798:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197804:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34a57 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197815:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197821:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197827:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197832:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390906.197835:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197842:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197850:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:0.0:1788390906.197853:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390906.197856:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.197861:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34a49 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390906.198148:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093976960 00000100:00100000:1.0:1788390906.198158:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093976960 00000100:00100000:1.0:1788390906.198228:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390906.198241:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22366:x1875263093976960:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:1.0:1788390906.198731:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22366:x1875263093976960:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 490us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.198739:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390906.198812:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:22367:x1875263093976704:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 12197us (12329us total) trans 17179869219 rc 0/0 00000100:00100000:0.0:1788390906.198821:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000020:00080000:0.0:1788390906.198834:0:30107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788390906.198861:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390906.198867:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390906.198896:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:3.0:1788390906.198904:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788390906.200449:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093977216 00000100:00100000:0.0:1788390906.200460:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093977216 00000100:00100000:1.0:1788390906.200750:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093977472 00000100:00100000:1.0:1788390906.200755:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093977472 00000100:00100000:1.0:1788390906.200805:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788390906.200816:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22366:x1875263093977472:12345-192.168.202.1@tcp:58:lfs.0 00000100:00100000:0.0:1788390906.201194:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390906.201203:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:22367:x1875263093977216:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788390906.201309:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 136 off8464 00000100:00100000:1.0:1788390906.201461:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:22366:x1875263093977472:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 647us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.201469:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000004:00080000:0.0:1788390906.201814:0:30111:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788390906.201947:0:30111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869220 00010000:00010000:0.0:1788390906.202228:0:30111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202248:0:30111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202259:0:30111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202268:0:30111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202275:0:30111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202284:0:30111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390906.202310:0:30111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390906.202340:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390906.202350:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.202360:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390906.202365:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.202374:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.202393:0:30096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff95d684d23100) 00010000:00010000:3.0:1788390906.202396:0:30096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390906.202402:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390906.202420:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34a5e lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390906.202439:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:22367:x1875263093977216:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1234us (2141us total) trans 17179869221 rc 0/0 00010000:00010000:3.0:1788390906.202443:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390906.202447:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390906.202450:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:3.0:1788390906.202451:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788390906.202458:0:30111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788390906.203715:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093977728 00000100:00100000:1.0:1788390906.203726:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093977728 00000100:00100000:1.0:1788390906.203784:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390906.203795:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:22366:x1875263093977728:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:1.0:1788390906.204196:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:22366:x1875263093977728:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 401us (647us total) trans 17179869222 rc 0/0 00000100:00100000:1.0:1788390906.204219:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390906.223886:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093977856 00000100:00100000:1.0:1788390906.223901:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093977856 00000100:00100000:1.0:1788390906.224017:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788390906.224092:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:22369:x1875263093977856:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390906.224140:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390906.224169:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34a65 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff582 expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224266:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224283:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224297:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224314:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224604:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224612:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.224998:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225120:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225129:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390906.225176:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00000004:00200000:1.0:1788390906.225181:0:30109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390906.225204:0:30109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225218:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225228:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225235:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225242:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225249:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390906.225253:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225261:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225275:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390906.225284:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390906.225290:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225296:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34a6c lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225309:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225314:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225386:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225394:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390906.225397:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225403:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225412:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff95d6a0d59c00) 00010000:00010000:1.0:1788390906.225415:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390906.225418:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225423:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34a73 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225463:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34a65 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff582 expref: 21 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225495:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff582 expref: 20 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390906.225502:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:1.0:1788390906.225505:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390906.225508:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62c00, rc 0) 00000100:00100000:1.0:1788390906.225745:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22369:x1875263093977856:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1657us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.225755:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000040:00080000:3.0:1788390906.787881:0:32278:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390906.787897:0:32278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390906.787951:0:32278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788390906.787982:0:32278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1788390906.829161:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390906.830326:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103367552:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830421:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.830485:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390906.830490:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103367680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390906.830497:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3286:1875263103367296:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830509:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.830537:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103367552 00000100:00100000:0.0:1788390906.830545:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103367552 00000100:00100000:1.0:1788390906.830550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390906.830588:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103367808:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830591:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103367680 00000100:00100000:0.0:1788390906.830594:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103367680 00000100:00100000:0.0:1788390906.830624:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390906.830630:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.830636:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103367552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390906.830648:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788390906.830656:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103367424:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830692:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103367552:12345-0@lo:400:kworker.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.830699:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390906.830702:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788390906.830720:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103367808 00000100:00100000:0.0:1788390906.830722:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103367808 00000100:00100000:0.0:1788390906.830738:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390906.830742:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103367680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390906.830757:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390906.830765:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103367680:12345-0@lo:400:kworker.0 Request processed in 22us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390906.830772:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103367808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830773:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788390906.830792:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390906.830819:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103367680:0@lo:400:kworker.0 00000100:00100000:1.0:1788390906.830825:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103367808:12345-0@lo:400:kworker.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.830830:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103367552:0@lo:400:kworker.0 00000100:00100000:1.0:1788390906.830839:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390906.830879:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103367424 00000100:00100000:0.0:1788390906.830882:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103367424 00000100:00100000:1.0:1788390906.830892:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103367808:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830913:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390906.830919:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103367424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.830988:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103367424:12345-0@lo:400:kworker.0 Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390906.830993:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788390906.831004:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390906.831020:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:0.0:1788390906.831031:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103367424:0@lo:400:kworker.0 00000100:00100000:0.0:1788390906.832823:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3286:1875263103367296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390906.833403:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103367936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390906.833476:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390906.833538:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103367936 00000100:00100000:3.0:1788390906.833545:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103367936 00000100:00100000:3.0:1788390906.833600:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390906.833612:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103367936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390906.833659:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390906.833715:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103367936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390906.833724:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390906.833777:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103367936:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788390907.213686:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390907.213701:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390907.213783:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788390907.213792:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788390907.214184:0:30144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:30144:1875263103368064:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390907.214390:0:30144:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a26e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390907.219226:0:30144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:30144:1875263103368064:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390907.227174:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093977984 00000100:00100000:0.0:1788390907.227184:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093977984 00000100:00100000:0.0:1788390907.227283:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1788390907.227294:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22381:x1875263093977984:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390907.227325:0:30108:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390907.227431:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22381:x1875263093977984:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 139us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390907.227439:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788390907.235899:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093978240 00000100:00100000:1.0:1788390907.235928:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093978240 00000100:00100000:1.0:1788390907.236059:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1788390907.236070:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+20:22381:x1875263093978240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390907.236092:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390907.236125:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34a81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff589 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.236236:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a88 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.236251:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a88 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.236265:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a88 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390907.236277:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:1.0:1788390907.236410:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34a81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff589 expref: 23 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.236428:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a88 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff589 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.236437:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:1.0:1788390907.236440:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390907.236444:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390907.236514:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:22381:x1875263093978240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 445us (2348us total) trans 17179869223 rc 0/0 00000100:00100000:1.0:1788390907.236521:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1788390907.239837:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390907.240916:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390907.240946:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093978624 00000100:00100000:1.0:1788390907.240951:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093978624 00000100:00100000:1.0:1788390907.241018:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788390907.241026:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+24:2359:x1875263093978624:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390907.241037:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390907.241051:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a88 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff589 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390907.241063:0:30094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:1.0:1788390907.241066:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390907.241128:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:2359:x1875263093978624:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390907.241136:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000040:00080000:1.0:1788390907.242326:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788390907.242331:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390907.242349:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:1.0:1788390907.242355:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788390907.243363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390907.243413:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093978880 00000100:00100000:0.0:1788390907.243419:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093978880 00000100:00100000:0.0:1788390907.243456:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788390907.243463:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:22381:x1875263093978880:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390907.243628:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:22381:x1875263093978880:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 164us (268us total) trans 17179869225 rc 0/0 00000100:00100000:0.0:1788390907.243635:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:3.0:1788390907.854264:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390908.321808:0:32329:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788390908.321818:0:32329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390908.321860:0:32329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:0.0:1788390908.321874:0:32329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788390908.410448:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390908.410509:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979136 00000100:00100000:1.0:1788390908.410522:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979136 00000100:00100000:1.0:1788390908.410599:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1788390908.410623:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:22398:x1875263093979136:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390908.410656:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390908.410681:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff590 expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390908.410828:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34aa4 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390908.410847:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34aa4 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390908.410865:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34aa4 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390908.410879:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788390908.411100:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34a9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff590 expref: 26 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390908.411127:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34aa4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff590 expref: 25 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390908.411137:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:1.0:1788390908.411141:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788390908.411147:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62600, rc 0) 00000100:00100000:1.0:1788390908.411227:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:22398:x1875263093979136:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 615us (789us total) trans 17179869226 rc 0/0 00000100:00100000:1.0:1788390908.411237:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00080000:1.0:1788390908.411276:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788390908.877471:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390909.557268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390909.557325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390909.557407:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979648 00000100:00100000:3.0:1788390909.557424:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979648 00000100:00100000:1.0:1788390909.557424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390909.557487:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390909.557513:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979904 00000100:00100000:3.0:1788390909.557520:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979904 00000100:00100000:1.0:1788390909.557533:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390909.557562:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390909.557571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390909.557580:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093979648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390909.557621:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390909.557656:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979264 00000100:00100000:1.0:1788390909.557664:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979264 00000100:00100000:3.0:1788390909.557682:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093979648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 105us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390909.557695:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390909.557717:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390909.557724:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979520 00000100:00100000:1.0:1788390909.557729:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:2356:x1875263093979264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390909.557733:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979520 00000100:00100000:3.0:1788390909.557767:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980032 00000100:00100000:3.0:1788390909.557771:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980032 00000100:00100000:1.0:1788390909.557783:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:2356:x1875263093979264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390909.557789:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788390909.557837:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390909.557843:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093979904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390909.557886:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390909.557886:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093979904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390909.557901:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390909.557912:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263093979520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390909.557932:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390909.557940:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093980032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390909.557951:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263093979520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390909.557957:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390909.557999:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093980032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390909.558089:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093979776 00000100:00100000:0.0:1788390909.558096:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093979776 00000100:00100000:1.0:1788390909.558124:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:1.0:1788390909.558160:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390909.558177:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00080000:1.0:1788390909.558179:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390909.558184:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390909.558190:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093979776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390909.558241:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093979776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390909.558250:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:3.0:1788390909.901184:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390910.925217:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788390911.494031:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869190 is committed 00000001:00080000:0.0:1788390911.494047:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869189 is committed 00000001:00080000:1.0:1788390911.494563:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869225 is committed 00000020:00080000:1.0:1788390911.494582:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a79300 refcount 2 committed 0 result 0 batchid 12884902006 00000020:00080000:1.0:1788390911.494587:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a79000 00000020:00080000:1.0:1788390911.494598:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a1795800 00000001:00080000:1.0:1788390911.494632:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869226 is committed 00000020:00080000:1.0:1788390911.494736:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902006 committed batchid 8589934680 00000020:00080000:1.0:1788390911.495016:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934680 00000100:00100000:3.0:1788390911.841534:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390911.841647:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980160 00000100:00100000:0.0:1788390911.841658:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980160 00000100:00100000:0.0:1788390911.841748:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1788390911.841760:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:22261:x1875263093980160:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788390911.841868:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:22261:x1875263093980160:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 110us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390911.841875:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788390911.844919:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390911.845130:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980416 00000100:00100000:1.0:1788390911.845142:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980416 00000100:00100000:1.0:1788390911.845224:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390911.845237:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+12:22261:x1875263093980416:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390911.845598:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:22261:x1875263093980416:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 363us (694us total) trans 17179869227 rc 0/0 00000100:00100000:1.0:1788390911.845608:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:0.0:1788390911.949130:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390911.950126:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103368320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950200:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950261:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103368832:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950289:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950316:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390911.950322:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103368704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950345:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950373:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103368448:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950398:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950424:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103368960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950450:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950468:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390911.950474:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103368576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390911.950525:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368320 00000100:00100000:3.0:1788390911.950550:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368320 00000100:00100000:3.0:1788390911.950611:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788390911.950621:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3289:x1875263103368320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950672:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3289:x1875263103368320:12345-0@lo:400:kworker.0 Request processed in 53us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390911.950680:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788390911.950686:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368448 00000100:00100000:1.0:1788390911.950690:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368448 00000100:00100000:3.0:1788390911.950723:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368576 00000100:00100000:3.0:1788390911.950726:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368576 00000100:00100000:1.0:1788390911.950735:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390911.950742:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103368448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950757:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390911.950762:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390911.950783:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103368448:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390911.950786:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103368576:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390911.950792:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788390911.950825:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390911.950846:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390911.950853:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103368576:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950863:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869190 gen 2 00000100:00100000:1.0:1788390911.950866:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368832 00000100:00100000:1.0:1788390911.950869:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368832 00000004:00080000:3.0:1788390911.950872:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869190 committed transno 17179869190 00000100:00100000:3.0:1788390911.950890:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103368448:0@lo:400:kworker.0 00000100:00100000:1.0:1788390911.950896:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368704 00000100:00100000:1.0:1788390911.950898:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368704 00000100:00100000:1.0:1788390911.950908:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103368960 00000100:00100000:3.0:1788390911.950911:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390911.950911:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103368960 00000100:00100000:3.0:1788390911.950918:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103368832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390911.950923:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788390911.950927:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103368704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.950948:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103368832:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390911.950949:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103368704:12345-0@lo:400:kworker.0 Request processed in 22us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390911.950953:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390911.951042:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390911.952768:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390911.952791:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103368960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.952878:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103368960:12345-0@lo:400:kworker.0 Request processed in 99us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390911.952886:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788390911.952913:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390911.952949:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103368960:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.953010:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103368704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.953023:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103368320:0@lo:400:kworker.0 00000100:00100000:3.0:1788390911.953034:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103368832:0@lo:400:kworker.0 00000100:00100000:1.0:1788390912.020678:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390912.024814:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980544 00000100:00100000:3.0:1788390912.024829:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980544 00000100:00100000:3.0:1788390912.024937:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788390912.024949:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+5:22838:x1875263093980544:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:3.0:1788390912.024999:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390912.025018:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff597 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025093:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025108:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025119:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390912.025154:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390912.025157:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390912.025197:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025221:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff597 expref: 7 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025243:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff597 expref: 6 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390912.025252:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390912.025255:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390912.025258:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0200, rc 0) 00000100:00100000:3.0:1788390912.025330:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d0a7814-65be-4163-903b-0e55692238e5+6:22838:x1875263093980544:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 382us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390912.025338:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00080000:0.0:1788390912.025930:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788390912.978227:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390913.998684:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390914.677887:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390914.677932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390914.677998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390914.678054:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390914.678089:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980928 00000100:00100000:3.0:1788390914.678101:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980928 00000100:00100000:3.0:1788390914.678169:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981440 00000100:00100000:3.0:1788390914.678171:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981440 00000100:00100000:3.0:1788390914.678193:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390914.678205:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093980928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390914.678288:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093980928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390914.678296:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390914.678324:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390914.678330:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093981440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390914.678351:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093981440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390914.678357:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:3.0:1788390914.678372:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390914.678376:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390914.678660:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981184 00000100:00100000:1.0:1788390914.678665:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981184 00000100:00100000:1.0:1788390914.678713:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390914.678721:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d0a7814-65be-4163-903b-0e55692238e5+6:2356:x1875263093981184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390914.678749:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d0a7814-65be-4163-903b-0e55692238e5+6:2356:x1875263093981184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390914.678756:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:0.0:1788390914.678975:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390914.680727:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981056 00000100:00100000:1.0:1788390914.680739:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981056 00000100:00100000:1.0:1788390914.680816:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981312 00000100:00100000:1.0:1788390914.680819:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981312 00000100:00100000:1.0:1788390914.680846:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788390914.680857:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093981056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390914.680979:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263093981056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390914.680987:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788390914.681004:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788390914.681011:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093981312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390914.681050:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d0a7814-65be-4163-903b-0e55692238e5+5:2356:x1875263093981312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390914.681056:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390914.682155:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093980800 00000100:00100000:3.0:1788390914.682167:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093980800 00000100:00100000:3.0:1788390914.682272:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788390914.682281:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:2356:x1875263093980800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390914.682372:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:2356:x1875263093980800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390914.682397:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00010000:00010000:0.0:1788390915.021298:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390915.165196:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981696 00000100:00100000:1.0:1788390915.165210:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981696 00000100:00100000:1.0:1788390915.165322:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788390915.165335:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+13:23098:x1875263093981696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390915.165365:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390915.165393:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34ac0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff59e expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166001:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166021:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166043:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166060:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166068:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166074:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166442:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34ad5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166452:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166460:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390915.166481:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788390915.166592:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166601:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166609:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166616:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.166621:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166630:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166644:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d684d23200) 00010000:00010000:1.0:1788390915.166647:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.166652:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166659:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34ac7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166674:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166681:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166699:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166704:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.166706:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166712:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166720:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a0d59100) 00010000:00010000:1.0:1788390915.166723:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.166726:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.166732:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34ace lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.171397:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34ac0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff59e expref: 16 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.171447:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff59e expref: 15 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.171458:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:1.0:1788390915.171461:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.171467:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390915.174188:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093981696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 8837us (9116us total) trans 17179869228 rc 0/0 00000100:00100000:1.0:1788390915.174229:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788390915.182348:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.182600:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981824 00000100:00100000:3.0:1788390915.182615:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981824 00000100:00100000:3.0:1788390915.182694:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390915.182707:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093981824:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788390915.182858:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093981824:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 153us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390915.182866:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788390915.194712:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.194849:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093981952 00000100:00100000:1.0:1788390915.194864:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093981952 00000100:00100000:1.0:1788390915.194951:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390915.195007:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:2357:x1875263093981952:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390915.195035:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.195071:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34ad5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff59e expref: 15 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.195096:0:30094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:1.0:1788390915.195101:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390915.195168:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:2357:x1875263093981952:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.195176:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1788390915.237828:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093982208 00000100:00100000:0.0:1788390915.237843:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093982208 00000100:00100000:0.0:1788390915.237944:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1788390915.238017:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+14:23107:x1875263093982208:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788390915.238061:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.238066:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788390915.238108:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd347c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4c5 expref: 14 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238136:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.238142:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390915.238159:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34ae3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5a5 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238568:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238586:0:30107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff597 expref: 5 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238596:0:30107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238639:0:30107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff597 expref: 5 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.238655:0:30107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd34ab9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff597 expref: 5 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.238672:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103369216:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390915.238813:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4c99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788390915.242851:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788390915.243540:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.243549:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.243582:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.243593:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.243603:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390915.245336:0:30107:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x44:0x0], count =30 00000004:00080000:0.0:1788390915.245351:0:30107:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x44:0x0]+30 in llog 00000004:00080000:0.0:1788390915.245399:0:30107:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62:0x0], index 1: 0 00010000:00010000:0.0:1788390915.247627:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34af8 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247655:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34af8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247670:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34af8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247782:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247790:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247818:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247824:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.247829:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247838:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247853:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.247856:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.247861:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.247868:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34aea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390915.247891:0:30107:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2625c30 reply state 000000004328c2ff transno 17179869229 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.247902:0:30107:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788390915.248129:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34ae3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5a5 expref: 16 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.248154:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34af8 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5a5 expref: 15 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.248163:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390915.248171:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390915.248175:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:0.0:1788390915.248321:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23107:x1875263093982208:12345-192.168.202.1@tcp:101:dd.0 Request processed in 10307us (10737us total) trans 17179869229 rc 0/0 00000100:00100000:0.0:1788390915.248331:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00010000:00010000:3.0:1788390915.251197:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251221:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251230:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251236:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390915.251242:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251250:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251272:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d684d23800) 00010000:00010000:3.0:1788390915.251276:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390915.251281:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.251306:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd34af1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390915.252653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.253208:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093982464 00000100:00100000:1.0:1788390915.253223:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093982464 00000100:00100000:1.0:1788390915.253344:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390915.253357:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:23107:x1875263093982464:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788390915.253385:0:30795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390915.253423:0:30795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5ac expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390915.253459:0:30795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390915.253488:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1788390915.253494:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390915.253506:0:30795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 6 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.253556:0:30795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 6 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.253571:0:30795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390915.253653:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:23107:x1875263093982464:12345-192.168.202.1@tcp:101:dd.0 Request processed in 299us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.253662:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390915.255886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.256129:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093982720 00000100:00100000:3.0:1788390915.256141:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093982720 00000100:00100000:3.0:1788390915.256236:0:32236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390915.256246:0:32236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23107:x1875263093982720:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:3.0:1788390915.256800:0:32236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23107:x1875263093982720:12345-192.168.202.1@tcp:35:dd.0 Request processed in 552us (921us total) trans 17179869230 rc 0/0 00000100:00100000:3.0:1788390915.256809:0:32236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788390915.266166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.266296:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093982848 00000100:00100000:0.0:1788390915.266309:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093982848 00000100:00100000:0.0:1788390915.266443:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1788390915.266456:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23108:x1875263093982848:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:0.0:1788390915.266492:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.266534:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34b0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5b3 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266636:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34b14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266653:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266666:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390915.266719:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390915.266723:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390915.266746:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34b14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266773:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34b0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5b3 expref: 18 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266821:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd34b14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5b3 expref: 17 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.266831:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.266834:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390915.266838:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:0.0:1788390915.266928:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:23108:x1875263093982848:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 467us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.266936:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788390915.270851:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093983104 00000100:00100000:1.0:1788390915.270865:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093983104 00000100:00100000:1.0:1788390915.270951:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788390915.270997:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:23108:x1875263093983104:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:1.0:1788390915.271081:0:30109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.271115:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34af8 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5a5 expref: 17 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.271145:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d684d23300) 00010000:00010000:1.0:1788390915.271160:0:30109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390915.271203:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.271219:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.271230:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390915.271501:0:30109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eea2d9d9 reply state 000000006d52e21a transno 17179869231 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.272669:0:30109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390915.272904:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23108:x1875263093983104:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 1937us (2650us total) trans 17179869231 rc 0/0 00000100:00100000:1.0:1788390915.272914:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00010000:00010000:0.0:1788390915.281258:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281273:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281282:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281289:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.281296:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281305:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281322:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.281324:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788390915.281329:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.281348:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b1b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390915.284285:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.284392:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093983360 00000100:00100000:1.0:1788390915.284405:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093983360 00000100:00100000:1.0:1788390915.284508:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788390915.284522:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263093983360:12345-192.168.202.1@tcp:2:chmod.0 00002000:00010000:1.0:1788390915.285257:0:31088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788390915.285263:0:31088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788390915.285267:0:31088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788390915.285269:0:31088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1788390915 00002000:00010000:1.0:1788390915.285272:0:31088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788390915.285343:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2356:x1875263093983360:12345-192.168.202.1@tcp:2:chmod.0 Request processed in 822us (1071us total) trans 17179869186 rc 0/0 00000100:00100000:1.0:1788390915.285353:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390915.337214:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093983616 00000100:00100000:0.0:1788390915.337227:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093983616 00000100:00100000:0.0:1788390915.337351:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788390915.337364:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23114:x1875263093983616:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788390915.337392:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.337419:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34b29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5c1 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337632:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337649:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337661:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337676:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337682:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337698:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337845:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337869:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.337877:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390915.337888:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:0.0:1788390915.337914:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338063:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338072:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338079:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.338084:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338092:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338105:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.338109:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390915.338113:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338121:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34b3e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338157:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338164:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338170:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338175:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.338178:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338183:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338190:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.338192:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.338194:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338200:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338207:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338213:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338219:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338228:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.338231:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338237:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338243:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d684d23d00) 00010000:00010000:0.0:1788390915.338245:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.338247:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338253:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34b37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338286:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34b29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5c1 expref: 19 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338296:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.338298:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788390915.338301:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34b29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5c1 expref: 19 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.338310:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92800, rc 0) 00000100:00100000:0.0:1788390915.338504:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23114:x1875263093983616:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1141us (1608us total) trans 0 rc 301/301 00000100:00100000:0.0:1788390915.338513:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788390915.390345:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093983872 00000100:00100000:1.0:1788390915.390369:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093983872 00000100:00100000:1.0:1788390915.390984:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390915.390999:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23120:x1875263093983872:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788390915.391041:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390915.391071:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34b45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5c8 expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391174:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391213:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391228:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391246:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391254:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391260:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391438:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391448:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391455:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390915.391467:0:30108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788390915.391492:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391499:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391506:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391518:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.391524:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391531:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391546:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788390915.391549:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390915.391554:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391560:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b5a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391580:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391587:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391593:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391597:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.391600:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391607:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391625:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390915.391627:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.391629:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.391635:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393111:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393130:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393137:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393143:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.393148:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393154:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393172:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d6a0d59600) 00010000:00010000:1.0:1788390915.393175:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.393179:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393185:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393272:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34b45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5c8 expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393285:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390915.393288:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390915.393292:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34b45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5c8 expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.393302:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62000, rc 0) 00000100:00100000:1.0:1788390915.393593:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23120:x1875263093983872:12345-192.168.202.1@tcp:101:dd.500 Request processed in 2595us (6685us total) trans 0 rc 301/301 00000100:00100000:1.0:1788390915.393604:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390915.435263:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093984000 00000100:00100000:1.0:1788390915.435277:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093984000 00000100:00100000:1.0:1788390915.435352:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788390915.435365:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23126:x1875263093984000:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390915.435397:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390915.435430:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5cf expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435532:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435550:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435563:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435599:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435607:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435614:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435731:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435740:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435747:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390915.435867:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:1.0:1788390915.435873:0:30109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390915.435898:0:30109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435913:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435921:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435930:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435949:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.435955:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.436002:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436013:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436037:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390915.436041:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.436047:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436054:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436070:0:30109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436077:0:30109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436083:0:30109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436088:0:30109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.436090:0:30109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436107:0:30109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436116:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d6a0d59600) 00010000:00010000:1.0:1788390915.436119:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.436121:0:30109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436126:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436164:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5cf expref: 20 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436179:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5cf expref: 19 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.436187:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788390915.436190:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390915.436193:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62400, rc 0) 00000100:00100000:1.0:1788390915.436272:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:23126:x1875263093984000:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 909us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.436282:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788390915.439684:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.447370:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093984640 00000100:00100000:3.0:1788390915.447384:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093984640 00000100:00100000:1.0:1788390915.447395:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093984512 00000100:00100000:1.0:1788390915.447402:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093984512 00000100:00100000:1.0:1788390915.447477:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788390915.447492:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:23126:x1875263093984512:12345-192.168.202.1@tcp:101:lfs.0 00000100:00100000:3.0:1788390915.447494:0:30093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390915.447505:0:30093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:2357:x1875263093984640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390915.447520:0:30093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.447541:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390915.447549:0:30093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34b84 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5d6 expref: 22 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.447564:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b92 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff5dd expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.447566:0:30093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788390915.447572:0:30093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390915.447625:0:30093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:2357:x1875263093984640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390915.447630:0:30093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00010000:00010000:1.0:1788390915.447695:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b99 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.447713:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b99 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.447727:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b99 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390915.447740:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:0.0:1788390915.448075:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34b92 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5dd expref: 23 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.448092:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b99 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5dd expref: 22 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.448099:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.448102:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788390915.448106:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:0.0:1788390915.448146:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:23126:x1875263093984512:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 659us (980us total) trans 17179869233 rc 0/0 00000100:00100000:0.0:1788390915.448153:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:0.0:1788390915.454233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.457218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.457304:0:30799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093984896 00000100:00100000:3.0:1788390915.457352:0:30799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093984896 00002000:00100000:3.0:1788390915.457401:0:30799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x62:0x0] (0->1023) req@ffff95d6bbcf0a80 x1875263093984896/t0(0) o4->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:531/0 lens 1512/0 e 0 to 0 dl 1788390926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390915.457409:0:30799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263093984896 ext(0->1023) 00010000:00010000:3.0:1788390915.457416:0:30799:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 8 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.457427:0:30799:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 8 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390915.457432:0:30799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:3.0:1788390915.457461:0:30799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390915.457469:0:30799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2357:x1875263093984896:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:3.0:1788390915.458013:0:30799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+10:2357:x1875263093984896:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 542us (795us total) trans 17179869187 rc 0/0 00000100:00100000:3.0:1788390915.458020:0:30799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:3.0:1788390915.458035:0:30799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x62:0x0] (0->1023) req@ffff95d6bbcf0a80 x1875263093984896/t17179869187(0) o4->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:531/0 lens 1512/448 e 0 to 0 dl 1788390926 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788390915.458044:0:30799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263093984896 ext(0->1023) 00010000:00010000:3.0:1788390915.458050:0:30799:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.458067:0:30799:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390915.458086:0:30799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:1.0:1788390915.461666:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093985024 00000100:00100000:1.0:1788390915.461677:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093985024 00010000:00010000:1.0:1788390915.461739:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.461786:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390915.461803:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+10:2359:x1875263093985024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390915.461819:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788390915.461842:0:30092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1788390915.461845:0:30092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788390915 00002000:00010000:1.0:1788390915.461847:0:30092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 1788390915 00010000:00010000:1.0:1788390915.461851:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.461889:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.461911:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dee697c8/0x9aafc5f04cd34b06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ac expref: 10 pid: 30795 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.461926:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390915.461932:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390915.461939:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.461949:0:30092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.462044:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390915.462063:0:30793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462074:0:30793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462103:0:30793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462111:0:30793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462118:0:30793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462133:0:30793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc176a230) 00000100:00100000:1.0:1788390915.462134:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:2359:x1875263093985024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 340us (574us total) trans 0 rc 0/0 00010000:00010000:0.0:1788390915.462138:0:30793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.462143:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:0.0:1788390915.462149:0:30793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462161:0:30793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.462169:0:30793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd34ba7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.462222:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685fa3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2356:x1875263093984768:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 7757us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.462230:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390915.466412:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.473265:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.473305:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.473388:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093985536 00000100:00100000:0.0:1788390915.473400:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093985536 00010000:00010000:0.0:1788390915.473453:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd34b22 lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ba expref: 27 pid: 30108 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.473506:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093985408 00000100:00100000:0.0:1788390915.473510:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093985408 00010000:00010000:0.0:1788390915.473524:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5cf expref: 28 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.473566:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390915.473576:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+28:2356:x1875263093985536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390915.473599:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390915.473607:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd34b22 lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ba expref: 28 pid: 30108 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473621:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd34b22 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5ba expref: 28 pid: 30108 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473647:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.473653:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473662:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473669:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390915.473733:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+28:2356:x1875263093985536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 158us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.473742:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390915.473762:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390915.473768:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+27:2356:x1875263093985408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390915.473776:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390915.473781:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5cf expref: 27 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473804:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34b76 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5cf expref: 27 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473816:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.473820:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473829:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473836:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.473857:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390915.473878:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+27:2356:x1875263093985408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 109us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.473884:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788390915.480741:0:32240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103369728 00000100:00100000:3.0:1788390915.480751:0:32240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103369728 00000100:00100000:3.0:1788390915.480829:0:32240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788390915.480841:0:32240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:30111:x1875263103369728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788390915.480956:0:32240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:30111:x1875263103369728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390915.480986:0:32240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390915.481080:0:30111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30111:1875263103369728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788390915.482492:0:30111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869239 00000100:00100000:0.0:1788390915.482595:0:30111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30111:1875263103369856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788390915.482658:0:30111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390915.482706:0:30111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4c99540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390915.483290:0:30111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:30111:1875263103369856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788390915.483354:0:30111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869240 00010000:00010000:0.0:1788390915.483390:0:30111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483408:0:30111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483414:0:30111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483418:0:30111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.483422:0:30111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483429:0:30111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483446:0:30111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.483448:0:30111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788390915.483451:0:30111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.483455:0:30111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd34bae lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390915.483785:0:30111:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788390915.484200:0:30111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].2, 64 off8320 00000004:00080000:0.0:1788390915.484214:0:30111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 732591252783ns, next at 733591250057ns, rc = 0 00000001:00080000:0.0:1788390915.484223:0:30111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869241 00010000:00010000:0.0:1788390915.484261:0:30111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788390915.484265:0:30111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788390915.484274:0:30111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34b99 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5dd expref: 29 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.484420:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+28:23126:x1875263093985280:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 17682us (18019us total) trans 17179869242 rc 0/0 00000100:00100000:0.0:1788390915.484430:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000020:00080000:0.0:1788390915.484434:0:30111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788390915.486719:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.492885:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093985920 00000100:00100000:3.0:1788390915.492900:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093985920 00000100:00100000:3.0:1788390915.493091:0:32236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390915.493104:0:32236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+29:23126:x1875263093985920:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788390915.493432:0:32236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+30:23126:x1875263093985920:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 330us (682us total) trans 17179869243 rc 0/0 00000100:00100000:3.0:1788390915.493441:0:32236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390915.533524:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390915.533558:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103369984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390915.533758:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390915.540165:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103369984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390915.540349:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390915.558770:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.558911:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093986048 00000100:00100000:0.0:1788390915.558925:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093986048 00000100:00100000:0.0:1788390915.560744:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1788390915.560772:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+30:23136:x1875263093986048:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788390915.560879:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.560900:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.560914:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.560933:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.560940:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.560947:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561147:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561156:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561162:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390915.561215:0:30107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561230:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561236:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561243:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561250:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.561255:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561264:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561278:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390915.561282:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.561288:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561301:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34bbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561325:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561332:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561338:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561344:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.561347:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561353:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561361:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d684d23d00) 00010000:00010000:0.0:1788390915.561364:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.561367:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.561373:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34bc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562658:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562674:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562691:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562697:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390915.562702:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562709:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562722:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.562725:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390915.562729:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.562736:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34bca lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.563041:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+30:23136:x1875263093986048:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 2277us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.563055:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1788390915.622552:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.671998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.685047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.688247:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.692351:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.692457:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093987072 00000100:00100000:1.0:1788390915.692472:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093987072 00000100:00100000:1.0:1788390915.692551:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390915.692565:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+7:23149:x1875263093987072:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:1.0:1788390915.692637:0:30108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.692672:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd34c2c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff600 expref: 7 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.692695:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390915.692700:0:30108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390915.692735:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.692750:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.692762:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390915.693100:0:30108:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0f21b0c reply state 000000001288c8fa transno 17179869244 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.693112:0:30108:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390915.693219:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+8:23149:x1875263093987072:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 657us (881us total) trans 17179869244 rc 0/0 00000100:00100000:1.0:1788390915.693225:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390915.697251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390915.697315:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.697331:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.697340:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.697346:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390915.697371:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.697374:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093987200 00010000:00010000:3.0:1788390915.697382:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.697389:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093987200 00010000:00010000:3.0:1788390915.697405:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390915.697410:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390915.697416:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.697423:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c33 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.697537:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788390915.697550:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d0a7814-65be-4163-903b-0e55692238e5+7:23149:x1875263093987200:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:0.0:1788390915.697577:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.697599:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff607 expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.697696:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 8 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.697711:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 8 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.697731:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.697734:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788390915.697737:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:0.0:1788390915.697814:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d0a7814-65be-4163-903b-0e55692238e5+8:23149:x1875263093987200:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 266us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.697823:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788390915.728609:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.728903:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093987456 00000100:00100000:1.0:1788390915.728915:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093987456 00000100:00100000:1.0:1788390915.729356:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390915.729371:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+30:23155:x1875263093987456:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788390915.729400:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390915.729427:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34c41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff60e expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729524:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729543:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729557:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729574:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729581:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729587:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729756:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34c56 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729764:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34c56 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729770:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34c56 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390915.729793:0:30108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788390915.729916:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729924:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729932:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729938:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.729943:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.729951:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730212:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390915.730216:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.730222:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730230:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34c48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730246:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730252:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730268:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730273:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390915.730328:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730337:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730345:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d6a0d59600) 00010000:00010000:1.0:1788390915.730347:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390915.730350:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730356:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34c4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730403:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34c41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff60e expref: 33 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730417:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34c56 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff60e expref: 32 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.730425:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390915.730426:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788390915.730429:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390915.730517:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+32:23155:x1875263093987456:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1150us (1924us total) trans 17179869245 rc 0/0 00000100:00100000:1.0:1788390915.730533:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1788390915.733169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.740543:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.740747:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093987968 00000100:00100000:0.0:1788390915.740760:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093987968 00000100:00100000:0.0:1788390915.740895:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390915.740908:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+33:23155:x1875263093987968:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:0.0:1788390915.741400:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+34:23155:x1875263093987968:12345-192.168.202.1@tcp:35:dd.500 Request processed in 493us (867us total) trans 17179869248 rc 0/0 00000100:00100000:0.0:1788390915.741410:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390915.780764:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.784793:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093988352 00000100:00100000:0.0:1788390915.784806:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093988352 00000100:00100000:0.0:1788390915.784905:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788390915.784918:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+35:23161:x1875263093988352:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788390915.784994:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.785030:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff61c expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.785185:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.785203:0:30109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.785212:0:30109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.785258:0:30109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 36 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.785273:0:30109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 36 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.785290:0:30109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30109:1875263103370112:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390915.785404:0:30109:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4c99240 going to sleep for 11 seconds 00000100:00100000:3.0:1788390915.787566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.787712:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093988480 00000100:00100000:1.0:1788390915.787724:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093988480 00010000:00010000:1.0:1788390915.787780:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 37 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.787831:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788390915.787842:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:2356:x1875263093988480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390915.787861:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.787870:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 37 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.787887:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 37 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.787915:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390915.787927:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.787939:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.787948:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.788010:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390915.788087:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:2356:x1875263093988480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 246us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.788130:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:0.0:1788390915.788552:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd34c80 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff615 expref: 36 pid: 30817 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.788574:0:30109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:30109:1875263103370112:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390915.788602:0:30109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.788624:0:30109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.788631:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390915.788654:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788390915.788854:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 37 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.788879:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 36 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.788887:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.788891:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390915.788894:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:0.0:1788390915.788936:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:23161:x1875263093988352:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 4021us (4219us total) trans 17179869249 rc 0/0 00000100:00100000:0.0:1788390915.788943:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788390915.792374:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.792458:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093988736 00000100:00100000:0.0:1788390915.792471:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093988736 00000100:00100000:0.0:1788390915.792581:0:32236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390915.792593:0:32236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+36:23161:x1875263093988736:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:0.0:1788390915.792954:0:32236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+37:23161:x1875263093988736:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 362us (592us total) trans 17179869250 rc 0/0 00000100:00100000:0.0:1788390915.792989:0:32236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390915.813158:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.820536:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.820754:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093988992 00000100:00100000:0.0:1788390915.820768:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093988992 00010000:00010000:0.0:1788390915.820878:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 39 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.820924:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390915.820935:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:2356:x1875263093988992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390915.820985:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390915.820995:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 39 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821081:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 39 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821110:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34c8e lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff61c expref: 39 pid: 30109 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821139:0:30094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.821145:0:30094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd34cb1 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821156:0:30094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd34cb1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821165:0:30094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd34cb1 lrc: 4/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.821197:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390915.821312:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:2356:x1875263093988992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 377us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.821326:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390915.823752:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.826301:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.826946:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093989376 00000100:00100000:0.0:1788390915.826985:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093989376 00000100:00100000:0.0:1788390915.827060:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1788390915.827072:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+38:23162:x1875263093989376:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:0.0:1788390915.827139:0:30817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390915.827170:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd34cb1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff623 expref: 38 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.827190:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.827195:0:30817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390915.827227:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.827243:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.827254:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788390915.827504:0:30817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb519d85 reply state 000000005723e0a3 transno 17179869251 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.827514:0:30817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788390915.827622:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:23162:x1875263093989376:12345-192.168.202.1@tcp:36:chown.0 Request processed in 551us (1327us total) trans 17179869251 rc 0/0 00000100:00100000:0.0:1788390915.827629:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00010000:00010000:3.0:1788390915.830436:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830454:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830462:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830468:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390915.830473:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830497:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830518:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390915.830520:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788390915.830525:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.830531:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd34cc6 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390915.885191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.889608:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.891466:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093989760 00000100:00100000:0.0:1788390915.891502:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093989760 00000100:00100000:0.0:1788390915.891572:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788390915.891585:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:23168:x1875263093989760:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788390915.891613:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390915.891640:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff638 expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.891770:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.891785:0:30817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 40 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.891801:0:30817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.891838:0:30817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 40 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.891848:0:30817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 40 pid: 30107 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.891860:0:30817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30817:1875263103370368:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390915.891983:0:30817:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4c99540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390915.898417:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390915.898670:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093989888 00000100:00100000:3.0:1788390915.898683:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093989888 00010000:00010000:3.0:1788390915.898733:0:30093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 41 pid: 30107 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390915.898783:0:30093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390915.898804:0:30093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:2357:x1875263093989888:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390915.898822:0:30093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390915.898829:0:30093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 41 pid: 30107 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.898845:0:30093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 41 pid: 30107 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.898881:0:30093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390915.898887:0:30093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.898918:0:30093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.898927:0:30093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390915.898951:0:30093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390915.899078:0:30093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:2357:x1875263093989888:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 277us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390915.899086:0:30093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:0.0:1788390915.900307:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd34ce2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff631 expref: 40 pid: 30107 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.900333:0:30817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30817:1875263103370368:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390915.900386:0:30817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.900399:0:30817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.900405:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390915.900432:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788390915.900730:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff638 expref: 41 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.900758:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff638 expref: 40 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.900768:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.900772:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788390915.900776:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92800, rc 0) 00000100:00100000:0.0:1788390915.901395:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:23168:x1875263093989760:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 9807us (11795us total) trans 17179869252 rc 0/0 00000100:00100000:0.0:1788390915.901407:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788390915.904387:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390915.904594:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093990144 00000100:00100000:0.0:1788390915.904609:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093990144 00000100:00100000:0.0:1788390915.904697:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390915.904712:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:23168:x1875263093990144:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1788390915.904737:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390915.904765:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd34bb5 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5e4 expref: 40 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390915.904814:0:30094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390915.904821:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390915.904896:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:23168:x1875263093990144:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 186us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390915.904904:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788390915.906841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390915.910840:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093990400 00000100:00100000:1.0:1788390915.910852:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093990400 00010000:00010000:1.0:1788390915.910907:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 8 pid: 30109 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390915.910987:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390915.910999:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d0a7814-65be-4163-903b-0e55692238e5+8:2357:x1875263093990400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390915.911018:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390915.911034:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 8 pid: 30109 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.911050:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 8 pid: 30109 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.911083:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390915.911090:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.911101:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.911124:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.911165:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390915.911570:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d0a7814-65be-4163-903b-0e55692238e5+8:2357:x1875263093990400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 570us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.911580:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:0.0:1788390915.911887:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34c3a lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff607 expref: 7 pid: 30109 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390915.911925:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103370496:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390915.911956:0:30107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.912098:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390915.912114:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390915.912538:0:30107:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].3, 136 off8600 00000100:00100000:1.0:1788390915.912842:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+39:23168:x1875263093990272:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 5508us (6009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390915.912852:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788390915.915447:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390916.045371:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788390916.495582:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788390916.495593:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390916.495905:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 4 00000040:00080000:1.0:1788390916.495914:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788390916.497471:0:30144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685278700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:30144:1875263103370624:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788390916.497634:0:30144:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390916.505272:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.505357:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093990656 00000100:00100000:0.0:1788390916.505370:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093990656 00000100:00080000:1.0:1788390916.505484:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390916.505490:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788390916.505505:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:23169:x1875263093990656:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390916.505552:0:30109:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390916.505692:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:23169:x1875263093990656:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 191us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.505701:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788390916.515331:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093990784 00000100:00100000:0.0:1788390916.515351:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093990784 00000100:00100000:0.0:1788390916.515455:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788390916.515469:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:23169:x1875263093990784:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788390916.515578:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515619:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515635:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515656:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515664:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515670:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515702:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515712:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515719:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390916.515795:0:30817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:0.0:1788390916.515802:0:30817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390916.515818:0:30817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515832:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515849:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515856:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515861:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390916.515866:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515875:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515891:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:0.0:1788390916.515894:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390916.515899:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515905:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515929:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515935:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515941:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.515947:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390916.515956:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516034:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516044:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2d0f3245 (ffff95d684d23d00) 00010000:00010000:0.0:1788390916.516047:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390916.516051:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516057:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516076:0:30817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516083:0:30817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516089:0:30817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516094:0:30817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390916.516097:0:30817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516103:0:30817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516111:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390916.516113:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390916.516126:0:30817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.516132:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34d1a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.516222:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:23169:x1875263093990784:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 755us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.516232:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788390916.519005:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390916.519274:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093991040 00000100:00100000:1.0:1788390916.519288:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093991040 00000100:00100000:1.0:1788390916.519370:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1788390916.519384:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+40:23169:x1875263093991040:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390916.519430:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390916.519460:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff646 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519599:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519619:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519635:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390916.519651:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:1.0:1788390916.519798:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519807:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519815:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519822:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.519827:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519836:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519851:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390916.519861:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390916.519880:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.519887:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34d28 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.520115:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d21 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff646 expref: 42 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.520127:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:1.0:1788390916.520130:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788390916.520134:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff646 expref: 42 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.520145:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62e00, rc 0) 00000100:00100000:1.0:1788390916.520264:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:23169:x1875263093991040:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 883us (1316us total) trans 17179869253 rc 301/301 00000100:00100000:1.0:1788390916.520272:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1788390916.526542:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390916.530777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.532154:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093991424 00000100:00100000:0.0:1788390916.532173:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093991424 00000100:00100000:3.0:1788390916.537062:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390916.537221:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093991552 00000100:00100000:1.0:1788390916.537233:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093991552 00000100:00100000:1.0:1788390916.537301:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390916.537314:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:23169:x1875263093991552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788390916.537345:0:30107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390916.537369:0:30107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff654 expref: -99 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537454:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537486:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537499:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390916.537547:0:30107:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390916.537551:0:30107:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390916.537576:0:30107:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537606:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff654 expref: 44 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537627:0:30107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff654 expref: 43 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.537636:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390916.537639:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390916.537643:0:30107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390916.537713:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+43:23169:x1875263093991552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 401us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390916.537721:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390916.542152:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390916.542239:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093991808 00000100:00100000:3.0:1788390916.542252:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093991808 00000100:00100000:3.0:1788390916.542329:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788390916.542343:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+43:23169:x1875263093991808:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390916.542423:0:30107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788390916.542461:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd34d3d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff64d expref: 43 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542486:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:3.0:1788390916.542504:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34d52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff654 expref: 42 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542538:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:3.0:1788390916.542542:0:30107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390916.542574:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542589:0:30107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 6 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542598:0:30107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542648:0:30107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 6 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.542665:0:30107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 6 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.542684:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103370752:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390916.542810:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390916.547218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.547315:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093991936 00000100:00100000:0.0:1788390916.547331:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093991936 00000100:00100000:1.0:1788390916.547371:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103370752:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390916.547412:0:30107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547422:0:30094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 7 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.547478:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390916.547492:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d0a7814-65be-4163-903b-0e55692238e5+7:2357:x1875263093991936:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390916.547511:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390916.547519:0:30094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 7 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547533:0:30094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 7 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547562:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd34c10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff5f9 expref: 7 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547580:0:30094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:0.0:1788390916.547591:0:30094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547603:0:30094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547612:0:30094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.547696:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390916.547765:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d0a7814-65be-4163-903b-0e55692238e5+6:2357:x1875263093991936:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 276us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.547774:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:1.0:1788390916.551187:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.551212:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.552876:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.552901:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.552913:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554696:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554711:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554718:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554724:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.554728:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554736:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554751:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23700) 00010000:00010000:1.0:1788390916.554770:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390916.554775:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554783:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd34d59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554807:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554812:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554817:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554822:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.554824:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554830:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554837:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b0c219b (ffff95d6a0d59600) 00010000:00010000:1.0:1788390916.554839:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390916.554842:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.554847:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd34d60 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7b0c219b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.554950:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:23169:x1875263093991808:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 12606us (12810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390916.555030:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788390916.561576:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093992064 00000100:00100000:0.0:1788390916.561591:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093992064 00000100:00100000:0.0:1788390916.561740:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1788390916.561756:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+41:23169:x1875263093992064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390916.561787:0:30817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390916.561821:0:30817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d67 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff65b expref: -99 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.561874:0:30817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.561891:0:30817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.561907:0:30817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.562538:0:30817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd34d67 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff65b expref: 43 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.562579:0:30817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff65b expref: 42 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.562590:0:30817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390916.562594:0:30817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390916.562598:0:30817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:0.0:1788390916.563793:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:23169:x1875263093992064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2032us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.563806:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788390916.568592:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390916.569169:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093992320 00000100:00100000:1.0:1788390916.569188:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093992320 00000100:00100000:1.0:1788390916.569287:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1788390916.569304:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+42:23169:x1875263093992320:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390916.569422:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.569444:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.569459:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390916.570307:0:30109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].3, 88 off8432 00000004:00080000:1.0:1788390916.570322:0:30109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 733677360522ns, next at 734677356996ns, rc = 0 00000004:00010000:1.0:1788390916.570449:0:30109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000701d37e0 reply state 00000000999ec033 transno 17179869255 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.570460:0:30109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390916.570597:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+44:23169:x1875263093992320:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1295us (2011us total) trans 17179869255 rc 0/0 00000100:00100000:1.0:1788390916.570607:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00010000:00010000:1.0:1788390916.580772:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580797:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580820:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580826:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.580832:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580842:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580863:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390916.580867:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788390916.580872:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.580879:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34d75 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.598168:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.598513:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093992576 00000100:00100000:0.0:1788390916.598529:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093992576 00000100:00100000:0.0:1788390916.598604:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390916.598615:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2357:x1875263093992576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788390916.598947:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2357:x1875263093992576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 333us (793us total) trans 17179869191 rc 0/0 00000100:00100000:0.0:1788390916.598954:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788390916.601985:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093992832 00000100:00100000:1.0:1788390916.602067:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093992832 00000100:00100000:1.0:1788390916.602154:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390916.602168:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+44:23169:x1875263093992832:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788390916.602485:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+45:23169:x1875263093992832:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 319us (651us total) trans 17179869256 rc 0/0 00000100:00100000:1.0:1788390916.602495:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000001:00080000:0.0:1788390916.606596:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869252 is committed 00000004:00080000:0.0:1788390916.606632:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788390916.606660:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b4c99480 refcount 2 committed 0 result 0 batchid 12884902007 00000020:00080000:0.0:1788390916.606666:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b4c99840 00000020:00080000:0.0:1788390916.606670:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585bfb000 00000001:00080000:0.0:1788390916.606692:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869253 is committed 00000001:00080000:0.0:1788390916.606702:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869244 is committed 00000020:00080000:0.0:1788390916.606718:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902006 batchid updated 00000001:00080000:0.0:1788390916.606752:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869254 is committed 00000100:00100000:3.0:1788390916.607729:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.608100:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093993088 00000100:00100000:0.0:1788390916.608112:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093993088 00000100:00100000:0.0:1788390916.608192:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788390916.608205:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23169:x1875263093993088:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788390916.608366:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23169:x1875263093993088:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 162us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.608375:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:3.0:1788390916.609435:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390916.609462:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103370880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390916.609535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390916.609642:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103370880 00000100:00100000:0.0:1788390916.609649:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103370880 00000100:00100000:0.0:1788390916.609708:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390916.609717:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103370880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788390916.609747:0:30795:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:98 count 1 00002000:00010000:0.0:1788390916.609794:0:30795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 1024, mtime: 0x6a98ae03, atime: 0x6a98ae03, ctime: 0x6a98ae03, blocks: 0x1 00010000:00010000:0.0:1788390916.609804:0:30795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.609825:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1788390916.609831:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390916.609839:0:30795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.609858:0:30795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.609870:0:30795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.609913:0:30795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.609943:0:30795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390916.610883:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390916.610902:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.610915:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390916.610920:0:30095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.610932:0:30095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.610956:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.610984:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be1a2b0/0x9aafc5f04cd34d83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.611090:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390916.611092:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390916.611094:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390916.613324:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103370880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3606us (3785us total) trans 17179869189 rc 0/0 00000100:00100000:0.0:1788390916.613335:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1788390916.613502:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bbcf2d80/2, rc 0, transno 17179869189 00000100:00100000:3.0:1788390916.613510:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103370880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788390916.616125:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.616211:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093993344 00000100:00100000:0.0:1788390916.616223:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093993344 00000100:00100000:0.0:1788390916.616295:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390916.616306:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263093993344:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390916.616330:0:30794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390916.616358:0:30794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff670 expref: -99 pid: 30794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390916.616393:0:30794:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ae04, blocks: 0x1 00010000:00010000:0.0:1788390916.616418:0:30794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=733s v=(0 0) 00010000:00010000:0.0:1788390916.616423:0:30794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390916.616434:0:30794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 7 pid: 30794 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.616458:0:30794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 7 pid: 30794 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.616475:0:30794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:0.0:1788390916.616563:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2356:x1875263093993344:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 258us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.616571:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390916.620696:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390916.624692:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390916.628906:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093993856 00000100:00100000:1.0:1788390916.628926:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093993856 00010000:00010000:1.0:1788390916.629059:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 9 pid: 30794 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.629126:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390916.629141:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:2357:x1875263093993856:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390916.629161:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390916.629193:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 9 pid: 30794 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.629208:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 9 pid: 30794 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.629241:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390916.629246:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390916.629255:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 9 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.629266:0:30092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 9 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.629318:0:30092:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 9 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.629336:0:30092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:30092:1875263103371136:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788390916.629455:0:30092:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788390916.630449:0:30793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ecdbe89/0x9aafc5f04cd34d98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff670 expref: 9 pid: 30794 timeout: 833 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.630473:0:30793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103371008:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390916.630505:0:30793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 8 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.630520:0:30793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ee00, rc 0) 00000100:00100000:0.0:1788390916.630617:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:23169:x1875263093993728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5503us (5939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.630627:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788390916.631854:0:30092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:30092:1875263103371136:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788390916.631899:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390916.631953:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093993856:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2816us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390916.632137:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390916.639748:0:30800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093993984 00000100:00100000:1.0:1788390916.639762:0:30800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093993984 00002000:00100000:1.0:1788390916.639830:0:30800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x63:0x0] (0->1023) req@ffff95d682e96300 x1875263093993984/t0(0) o4->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:532/0 lens 1512/0 e 0 to 0 dl 1788390927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390916.639844:0:30800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96300 with x1875263093993984 ext(0->1023) 00002000:00010000:1.0:1788390916.639851:0:30800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e96300 00000100:00100000:1.0:1788390916.639897:0:30800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390916.639909:0:30800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2356:x1875263093993984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788390916.640542:0:30800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:2356:x1875263093993984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 632us (939us total) trans 17179869192 rc 0/0 00000100:00100000:1.0:1788390916.640551:0:30800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:1.0:1788390916.640559:0:30800:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x63:0x0] (0->1023) req@ffff95d682e96300 x1875263093993984/t17179869192(0) o4->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:532/0 lens 1512/448 e 0 to 0 dl 1788390927 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788390916.640573:0:30800:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96300 with x1875263093993984 ext(0->1023) 00002000:00010000:1.0:1788390916.640577:0:30800:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e96300 00000100:00100000:3.0:1788390916.645079:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000001:00080000:0.0:1788390916.676361:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869256 is committed 00000004:00080000:0.0:1788390916.676386:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1788390916.676557:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103371264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788390916.676652:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390916.676721:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103371264 00000100:00100000:0.0:1788390916.676731:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103371264 00000100:00100000:0.0:1788390916.677449:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788390916.677472:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103371264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788390916.677648:0:30794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788390916.677652:0:30794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1788390916 00002000:00010000:0.0:1788390916.677654:0:30794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390916.677655:0:30794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb ctime from disk: 1788390916 -> 1788390916 00002000:00010000:0.0:1788390916.677668:0:30794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788390916.677748:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103371264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (1095us total) trans 17179869193 rc 0/0 00000100:00100000:0.0:1788390916.677757:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00080000:1.0:1788390916.677877:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902007 batchid updated 00000020:00080000:0.0:1788390916.678077:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902007 00000020:00080000:0.0:1788390916.678092:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902007 00000100:00100000:3.0:1788390916.678129:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:23169:x1875263093994112:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 32776us (33062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390916.678165:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788390916.681577:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.681844:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093994240 00000100:00100000:0.0:1788390916.681853:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093994240 00000100:00100000:0.0:1788390916.681910:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390916.681920:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+9:2357:x1875263093994240:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788390916.722129:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869193 is committed 00000001:00080000:1.0:1788390916.722154:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869191 is committed 00000001:00080000:1.0:1788390916.722166:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869192 is committed 00000100:00100000:0.0:1788390916.722194:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2357:x1875263093994240:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 40265us (40615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.722210:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390916.727813:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390916.730664:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730680:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730687:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730694:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390916.730699:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730707:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730723:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390916.730726:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390916.730731:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.730737:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd34da6 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.731290:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.731481:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093994624 00000100:00100000:0.0:1788390916.731490:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093994624 00000100:00100000:0.0:1788390916.731591:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390916.731602:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263093994624:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788390916.731789:0:30794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:0.0:1788390916.731792:0:30794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb mtime from disk: 1788390916 -> 1788390916 00002000:00010000:0.0:1788390916.731794:0:30794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb atime from disk: 0 -> 1788390915 00002000:00010000:0.0:1788390916.731795:0:30794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb ctime from disk: 1788390916 -> 1788390916 00002000:00010000:0.0:1788390916.731797:0:30794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788390916.731842:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2356:x1875263093994624:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 244us (556us total) trans 17179869194 rc 0/0 00000100:00100000:0.0:1788390916.731847:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390916.734168:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093994880 00000100:00100000:0.0:1788390916.734181:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093994880 00000100:00100000:0.0:1788390916.734233:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788390916.734243:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:23169:x1875263093994880:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788390916.734311:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.734327:0:30108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff65b expref: 17 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.734336:0:30108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.734516:0:30108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff65b expref: 17 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.734530:0:30108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd34d6e lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff65b expref: 17 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.734545:0:30108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103371392:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390916.734733:0:30108:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390916.737892:0:30108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103371392:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390916.737923:0:30108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.743474:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995008 00000100:00100000:3.0:1788390916.743482:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995008 00010000:00010000:3.0:1788390916.743918:0:30108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.743926:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.743954:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.743978:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.743986:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.743992:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390916.743996:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.744003:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.744022:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390916.744025:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788390916.744029:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.744035:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd34dad lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.744099:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23169:x1875263093994880:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 9856us (10023us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788390916.744108:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788390916.747679:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995136 00000100:00100000:0.0:1788390916.747690:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995136 00000100:00100000:0.0:1788390916.747754:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788390916.747765:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093995136:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788390916.747807:0:30793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.747837:0:30793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.747843:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390916.747846:0:30793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390916.747849:0:30793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.747876:0:30793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 7 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.747889:0:30793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 7 pid: 30793 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.747903:0:30793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103371520:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390916.748258:0:30793:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92180 going to sleep for 11 seconds 00000100:00100000:0.0:1788390916.750234:0:30793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:30793:1875263103371520:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390916.750262:0:30793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.753719:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995264 00000100:00100000:0.0:1788390916.753729:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995264 00010000:00010000:0.0:1788390916.753775:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 8 pid: 30793 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.753867:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390916.753878:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+8:2356:x1875263093995264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390916.753893:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390916.753927:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 8 pid: 30793 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.753941:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 8 pid: 30793 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.753992:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd34d9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff677 expref: 8 pid: 30793 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.754008:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390916.754022:0:30092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390916.754029:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.754039:0:30092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.754070:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390916.754127:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2356:x1875263093995264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 250us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.754135:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00010000:00010000:1.0:1788390916.754189:0:30793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754210:0:30793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754233:0:30793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754242:0:30793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754250:0:30793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754257:0:30793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390916.754261:0:30793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754270:0:30793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754282:0:30793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.754289:0:30793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd34db4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.754357:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2357:x1875263093995136:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 6594us (6789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390916.754365:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1788390916.759567:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995520 00000100:00100000:1.0:1788390916.759580:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995520 00000100:00100000:1.0:1788390916.759652:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1788390916.759665:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23169:x1875263093995520:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390916.759747:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.759767:0:30107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 16 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.759778:0:30107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.759816:0:30107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 16 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.759832:0:30107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 16 pid: 30107 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.759848:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103371648:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390916.759945:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1c78000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390916.761761:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103371648:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390916.761801:0:30107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.762158:0:30093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995648 00000100:00100000:1.0:1788390916.762165:0:30093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995648 00010000:00010000:1.0:1788390916.762195:0:30093:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 17 pid: 30107 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.762232:0:30093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788390916.762241:0:30093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:2357:x1875263093995648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390916.762252:0:30093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390916.762256:0:30093:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 17 pid: 30107 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762265:0:30093:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 17 pid: 30107 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762281:0:30093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd34cbf lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff62a expref: 17 pid: 30107 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762292:0:30093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390916.762296:0:30093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 16 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762302:0:30093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762306:0:30093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762316:0:30093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.762377:0:30093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390916.762425:0:30093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:2357:x1875263093995648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390916.762433:0:30093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00010000:00010000:3.0:1788390916.762873:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.762881:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.763233:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.763246:0:30107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 16 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.763253:0:30107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.763278:0:30107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 16 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.763289:0:30107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 16 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.763300:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103371776:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390916.763393:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390916.769752:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995776 00000100:00100000:0.0:1788390916.769761:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995776 00010000:00010000:0.0:1788390916.769798:0:30092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 17 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390916.769836:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390916.769844:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:2356:x1875263093995776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390916.769854:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390916.769859:0:30092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 5/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 17 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.769870:0:30092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 17 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.769892:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390916.769897:0:30092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.769907:0:30092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.769915:0:30092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.769932:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390916.770096:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd34d7c lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff662 expref: 17 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.770133:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103371776:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390916.770152:0:30107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.770161:0:30107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.770167:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788390916.770342:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869258 00000001:00080000:3.0:1788390916.770493:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869259 00000100:00100000:0.0:1788390916.771330:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:2356:x1875263093995776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1482us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.771340:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000001:00080000:3.0:1788390916.772236:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869260 00000100:00100000:3.0:1788390916.772345:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103371904:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788390916.772409:0:30107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390916.772445:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390916.772726:0:30107:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869193 gen 2 00000004:00080000:3.0:1788390916.772732:0:30107:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bbcf0700, transno 17179869193 00000100:00100000:3.0:1788390916.772749:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103371904:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788390916.773253:0:30107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869261 00000100:00100000:3.0:1788390916.773292:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103372032:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788390916.773315:0:30107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390916.773343:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788390916.773442:0:30113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372032 00000100:00100000:0.0:1788390916.773454:0:30113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372032 00000100:00100000:0.0:1788390916.773489:0:30113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390916.773496:0:30113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:30107:x1875263103372032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788390916.774629:0:30113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:30107:x1875263103372032:12345-0@lo:1000:mdt00_000.0 Request processed in 1130us (1308us total) trans 17179869195 rc 0/0 00000100:00100000:0.0:1788390916.774638:0:30113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788390916.775075:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:30107:1875263103372032:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788390916.775115:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775126:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775133:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775139:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.775143:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775150:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775166:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390916.775169:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390916.775175:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775181:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd34dc2 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775226:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775233:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775239:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775245:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.775247:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775254:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775262:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390916.775265:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788390916.775272:0:30107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775283:0:30107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775292:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.775328:0:30107:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 19 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.775353:0:30107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103372160:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788390916.775681:0:30107:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a1c78000 going to sleep for 11 seconds 00000100:00100000:1.0:1788390916.779126:0:30107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:30107:1875263103372160:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788390916.779156:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779165:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd34cfe lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779196:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779211:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779220:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779228:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779232:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779236:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779239:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.779241:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779257:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779266:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390916.779268:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390916.779270:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779273:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62800/0x9aafc5f04cd34dc9 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779280:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779283:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779287:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779290:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390916.779291:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779294:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779298:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390916.779299:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390916.779300:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.779309:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63400/0x9aafc5f04cd34dbb lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390916.779648:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:23169:x1875263093995520:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 19985us (20187us total) trans 17179869262 rc 0/0 00000100:00100000:1.0:1788390916.779658:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000020:00080000:1.0:1788390916.779663:0:30107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788390916.782423:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.782622:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093995904 00000100:00100000:0.0:1788390916.782631:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093995904 00000100:00100000:0.0:1788390916.782690:0:32236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390916.782700:0:32236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:23168:x1875263093995904:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:0.0:1788390916.783336:0:32236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:23168:x1875263093995904:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 635us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.783345:0:32236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390916.785067:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390916.785139:0:30111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093996160 00000100:00100000:1.0:1788390916.785147:0:30111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093996160 00000100:00100000:1.0:1788390916.785197:0:30111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390916.785207:0:30111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+19:23169:x1875263093996160:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788390916.785873:0:30111:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788390916.786311:0:30111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869263 00010000:00010000:1.0:1788390916.786359:0:30111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786374:0:30111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786385:0:30111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786394:0:30111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786400:0:30111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786405:0:30111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390916.786474:0:30111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788390916.786604:0:30111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+21:23169:x1875263093996160:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1396us (1539us total) trans 17179869264 rc 0/0 00000100:00100000:1.0:1788390916.786613:0:30111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000020:00080000:1.0:1788390916.786617:0:30111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788390916.787675:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390916.787684:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.787702:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390916.787706:0:30096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.787713:0:30096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.787727:0:30096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788390916.787730:0:30096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788390916.787734:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.787739:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62400/0x9aafc5f04cd34dd0 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.787759:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390916.787761:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390916.787762:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390916.788385:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.788455:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093996416 00000100:00100000:0.0:1788390916.788463:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093996416 00000100:00100000:0.0:1788390916.788555:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788390916.788564:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+21:23168:x1875263093996416:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:0.0:1788390916.788869:0:30817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].4, 136 off8736 00000100:00100000:0.0:1788390916.789162:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+21:23168:x1875263093996416:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 599us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.789170:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788390916.791805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390916.791914:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093996672 00000100:00100000:3.0:1788390916.791923:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093996672 00000100:00100000:1.0:1788390916.814361:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.814457:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093996800 00000100:00100000:0.0:1788390916.814468:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093996800 00000100:00100000:0.0:1788390916.814527:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788390916.814539:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+22:23171:x1875263093996800:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788390916.814593:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390916.814616:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34dd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff67e expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814680:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814695:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814707:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390916.814742:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390916.814747:0:30109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390916.814764:0:30109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814788:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff67e expref: 24 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814811:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff67e expref: 23 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390916.814820:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390916.814823:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390916.814827:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:0.0:1788390916.814892:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:23171:x1875263093996800:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 355us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390916.814899:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788390916.819324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390916.819510:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093996928 00000100:00100000:3.0:1788390916.819521:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093996928 00000100:00100000:3.0:1788390916.819668:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390916.819680:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:23171:x1875263093996928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390916.819701:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390916.819721:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34de5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff685 expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819805:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819817:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819828:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819841:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819847:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.819852:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.820118:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.820129:0:30108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff638 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.820138:0:30108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 4/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.820169:0:30108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff638 expref: 24 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.820206:0:30108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34cf0 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff638 expref: 24 pid: 30817 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390916.820221:0:30108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103372288:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390916.820295:0:30108:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390916.824451:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390916.824537:0:30108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:30108:1875263103372288:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390916.824565:0:30108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825139:0:30108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825147:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390916.825200:0:30108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1788390916.825205:0:30108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390916.825225:0:30108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825237:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825247:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825254:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825261:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825268:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390916.825278:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825286:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825297:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788390916.825300:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390916.825304:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825311:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd34dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825325:0:30108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825332:0:30108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825338:0:30108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825344:0:30108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390916.825347:0:30108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825354:0:30108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825361:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff95d6a704c300) 00010000:00010000:3.0:1788390916.825364:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390916.825372:0:30108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825379:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd34df3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825415:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd34de5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff685 expref: 24 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825430:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff685 expref: 23 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390916.825438:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390916.825441:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390916.825443:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1a00, rc 0) 00000100:00100000:3.0:1788390916.825469:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:23171:x1875263093996928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 5792us (6156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390916.825475:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788390917.070334:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372416 00000100:00100000:3.0:1788390917.070342:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372416 00000100:00100000:3.0:1788390917.070397:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390917.070408:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103372416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390917.070442:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390917.070485:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103372416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390917.070493:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788390917.070523:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390917.075370:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103372672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075438:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390917.075480:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788390917.075485:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103372544:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075509:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390917.075526:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103373056:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075545:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390917.075570:0:31088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372672 00000100:00100000:0.0:1788390917.075576:0:31088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372672 00000100:00100000:0.0:1788390917.075625:0:31088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390917.075633:0:31088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103372672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075678:0:31088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103372672:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.075685:0:31088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788390917.075705:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373056 00000100:00100000:0.0:1788390917.075708:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373056 00000100:00100000:0.0:1788390917.075732:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390917.075738:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103373056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075766:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103373056:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.075771:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788390917.075819:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103373056:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.075830:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103372672:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076209:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372544 00000100:00100000:0.0:1788390917.076214:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372544 00000100:00100000:0.0:1788390917.076236:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788390917.076242:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3289:x1875263103372544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076278:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3289:x1875263103372544:12345-0@lo:400:kworker.0 Request processed in 36us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.076284:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788390917.076312:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103372928:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076335:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390917.076353:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390917.076359:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076378:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390917.076403:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372928 00000100:00100000:0.0:1788390917.076406:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372928 00000100:00100000:0.0:1788390917.076427:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103372800 00000100:00100000:0.0:1788390917.076430:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103372800 00000100:00100000:0.0:1788390917.076443:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390917.076449:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103372928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076478:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103372928:12345-0@lo:400:kworker.0 Request processed in 29us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.076484:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390917.076494:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390917.076499:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103372800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076521:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103372800:12345-0@lo:400:kworker.0 Request processed in 22us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.076534:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390917.076566:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076574:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103372928:0@lo:400:kworker.0 00000100:00100000:0.0:1788390917.076594:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103372544:0@lo:400:kworker.0 00000100:00080000:0.0:1788390917.076620:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788390917.076625:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390917.079892:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390917.840489:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390917.840558:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093997184 00000100:00100000:0.0:1788390917.840568:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093997184 00000100:00100000:0.0:1788390917.840688:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788390917.840700:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+24:23184:x1875263093997184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390917.840732:0:30817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390917.840828:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+24:23184:x1875263093997184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 129us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.840836:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1788390917.846361:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390917.846462:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093997440 00000100:00100000:0.0:1788390917.846472:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093997440 00000100:00100000:0.0:1788390917.846590:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788390917.846602:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+23:23184:x1875263093997440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390917.846622:0:30109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390917.846642:0:30109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34e01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff68c expref: -99 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.846749:0:30109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34e08 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.846790:0:30109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34e08 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.846800:0:30109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34e08 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390917.846813:0:30109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:0.0:1788390917.846943:0:30109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd34e01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff68c expref: 26 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.846994:0:30109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34e08 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff68c expref: 25 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.847013:0:30109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390917.847016:0:30109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390917.847020:0:30109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92e00, rc 0) 00000100:00100000:0.0:1788390917.847075:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:23184:x1875263093997440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 476us (724us total) trans 17179869266 rc 0/0 00000100:00100000:0.0:1788390917.847082:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788390917.850847:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390917.850994:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093997696 00000100:00100000:1.0:1788390917.851015:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093997696 00000100:00100000:1.0:1788390917.851080:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788390917.851091:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:23184:x1875263093997696:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390917.851171:0:30107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851190:0:30107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851202:0:30107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851397:0:30107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851406:0:30107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851412:0:30107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851433:0:30107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390917.851438:0:30107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851445:0:30107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851458:0:30107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390917.851461:0:30107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788390917.851467:0:30107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390917.851474:0:30107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62e00/0x9aafc5f04cd34e16 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30107 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390917.851633:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+26:23184:x1875263093997696:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 542us (789us total) trans 17179869267 rc 0/0 00000100:00100000:1.0:1788390917.851641:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000040:00080000:3.0:1788390917.852724:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390917.852731:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390917.852764:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1788390917.852771:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788390917.854236:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390917.854749:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093997824 00000100:00100000:0.0:1788390917.854759:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093997824 00000100:00100000:0.0:1788390917.854832:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390917.854914:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+26:2356:x1875263093997824:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390917.854929:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390917.854951:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd34e08 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff68c expref: 26 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390917.855035:0:30092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788390917.855040:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390917.855089:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+25:2356:x1875263093997824:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 248us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390917.855097:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788390917.855300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390918.093233:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390919.118366:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390919.122949:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788390919.123817:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390919.128830:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390919.129035:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093998464 00000100:00100000:1.0:1788390919.129046:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093998464 00000100:00080000:0.0:1788390919.129156:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390919.129198:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788390919.129210:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:23207:x1875263093998464:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788390919.129227:0:30795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390919.129248:0:30795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd34e32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff69a expref: -99 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390919.129277:0:30795:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x63:0x0] initial LVB size: 1024, mtime: 0x6a98ae04, atime: 0x6a98ae03, ctime: 0x6a98ae04, blocks: 0xb 00010000:00010000:1.0:1788390919.129299:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788390919.129319:0:30795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390919.129340:0:30795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd34e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff69a expref: 7 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390919.129358:0:30795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd34e32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff69a expref: 7 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390919.129372:0:30795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390919.129431:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:23207:x1875263093998464:12345-192.168.202.1@tcp:101:dd.500 Request processed in 224us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390919.129438:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788390919.131259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.131340:0:30799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093998592 00000100:00100000:3.0:1788390919.131348:0:30799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093998592 00002000:00100000:3.0:1788390919.131389:0:30799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x63:0x0] (0->4095) req@ffff95d6bc68ea00 x1875263093998592/t0(0) o3->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:535/0 lens 488/0 e 0 to 0 dl 1788390930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788390919.131400:0:30799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ea00 with x1875263093998592 ext(0->4095) 00002000:00010000:3.0:1788390919.131405:0:30799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ea00 00000100:00100000:3.0:1788390919.131426:0:30799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390919.131434:0:30799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093998592:12345-192.168.202.1@tcp:3:dd.500 00000100:00100000:3.0:1788390919.131704:0:30799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2357:x1875263093998592:12345-192.168.202.1@tcp:3:dd.500 Request processed in 270us (450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788390919.131716:0:30799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:3.0:1788390919.131722:0:30799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x63:0x0] (0->4095) req@ffff95d6bc68ea00 x1875263093998592/t0(0) o3->689ef09a-3944-4d2a-a8ee-4e7b3c142dac@192.168.202.1@tcp:535/0 lens 488/4536 e 0 to 0 dl 1788390930 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788390919.131731:0:30799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ea00 with x1875263093998592 ext(0->4095) 00002000:00010000:3.0:1788390919.131735:0:30799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ea00 00000100:00100000:3.0:1788390919.803284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.803405:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.803507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.803543:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.803571:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390919.803600:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093999104 00000100:00100000:3.0:1788390919.803608:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093999104 00000100:00100000:3.0:1788390919.803666:0:30794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093998976 00000100:00100000:3.0:1788390919.803669:0:30794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093998976 00000100:00100000:3.0:1788390919.803689:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390919.803698:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093999104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390919.803769:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2358:x1875263093999104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390919.803777:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390919.803793:0:30794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390919.803812:0:30794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2358:x1875263093998976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390919.803840:0:30794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+7:2358:x1875263093998976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390919.803846:0:30794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:3.0:1788390919.803861:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390919.804454:0:30100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093998720 00000100:00100000:1.0:1788390919.804459:0:30100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093998720 00000100:00100000:1.0:1788390919.804495:0:30100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1788390919.804502:0:30100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:2358:x1875263093998720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390919.804539:0:30100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6264aaa7-f441-4011-80bc-026a652f837f+13:2358:x1875263093998720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 37us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390919.804546:0:30100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00080000:3.0:1788390919.806223:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390919.806321:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390919.806364:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788390919.808208:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390919.808227:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390919.808638:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390919.808644:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788390920.141331:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390920.653434:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103373312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390920.653503:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390920.653645:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373312 00000100:00100000:3.0:1788390920.653654:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373312 00000100:00100000:3.0:1788390920.653723:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390920.653733:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103373312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788390920.653776:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788390920.654197:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103373312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 464us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390920.654206:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390920.654319:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103373312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390921.174092:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788390921.732900:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869266 is committed 00000001:00080000:3.0:1788390921.732919:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869267 is committed 00000001:00080000:3.0:1788390921.732925:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869269 is committed 00000020:00080000:3.0:1788390921.732939:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a69259c0 refcount 2 committed 0 result 0 batchid 12884902008 00000020:00080000:3.0:1788390921.732944:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6925e40 00000020:00080000:3.0:1788390921.732946:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4c10500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d586b79c00 00000020:00080000:0.0:1788390921.733099:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902008 committed batchid 12884902007 00000020:00080000:0.0:1788390921.733267:0:30147:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902007 00010000:00010000:1.0:1788390922.189073:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390922.189109:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103373568:0@lo:400:kworker.0 00000100:00100000:1.0:1788390922.189180:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390922.189235:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788390922.189243:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390922.189272:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390922.189307:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373568 00000100:00100000:1.0:1788390922.189315:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373568 00000100:00100000:1.0:1788390922.189384:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390922.189395:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103373568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390922.189446:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103373568:12345-0@lo:400:kworker.0 Request processed in 53us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390922.189452:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788390922.189475:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373440 00000100:00100000:1.0:1788390922.189478:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373440 00000100:00100000:1.0:1788390922.189504:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788390922.189510:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390922.189540:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3287:x1875263103373440:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390922.189547:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788390922.189569:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390922.189598:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3287:1875263103373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788390922.189610:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103373568:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.192629:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103373824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.192690:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390922.192733:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390922.192740:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103373696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.192761:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390922.192812:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103374080:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.192847:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390922.192862:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390922.192867:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.192883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390922.192912:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373824 00000100:00100000:0.0:1788390922.192918:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373824 00000100:00100000:0.0:1788390922.192957:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103374080 00000100:00100000:0.0:1788390922.192988:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103374080 00000100:00100000:0.0:1788390922.193011:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373952 00000100:00100000:0.0:1788390922.193013:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373952 00000100:00100000:0.0:1788390922.193029:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390922.193037:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103373824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.193083:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103373824:12345-0@lo:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.193091:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788390922.193105:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390922.193110:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103374080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.193138:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103374080:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.193145:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390922.193154:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390922.193159:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103373952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.193181:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103373952:12345-0@lo:400:kworker.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.193187:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390922.193204:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103373696 00000100:00100000:0.0:1788390922.193207:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103373696 00000100:00100000:0.0:1788390922.193240:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390922.193246:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103373696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.193274:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103373696:12345-0@lo:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.193279:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390922.193308:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 2 00000004:00080000:0.0:1788390922.193314:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869188 committed transno 17179869189 00000004:00080000:0.0:1788390922.193333:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bbcf2d80, transno 17179869189 00000100:00100000:0.0:1788390922.193343:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103373696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.193355:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103373824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.194748:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788390922.194762:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103374080:0@lo:400:kworker.0 00000100:00080000:0.0:1788390922.194819:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390922.194824:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788390922.237146:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869195 is committed 00000001:00080000:1.0:1788390922.237162:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869194 is committed 00000001:00100000:1.0:1788390922.237170:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d0a7814-65be-4163-903b-0e55692238e5 00000020:00000080:1.0:1788390922.237174:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6bcb44800/5d0a7814-65be-4163-903b-0e55692238e5 00000001:00100000:0.0:1788390922.238557:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d0a7814-65be-4163-903b-0e55692238e5 00000020:00000080:0.0:1788390922.238564:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6b6530000/5d0a7814-65be-4163-903b-0e55692238e5 00000020:00000080:3.0:1788390922.238639:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6530000/5d0a7814-65be-4163-903b-0e55692238e5 for lustre-OST0001 00000020:00000080:3.0:1788390922.238738:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6b6537000 for lustre-OST0001 00000100:00100000:0.0:1788390922.395704:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093999616 00000100:00100000:0.0:1788390922.395715:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093999616 00000100:00100000:0.0:1788390922.395798:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390922.395810:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093999616:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788390922.396033:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390922.396167:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093999616:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 358us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.396174:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788390922.404780:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390922.404885:0:32236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263093999872 00000100:00100000:3.0:1788390922.404895:0:32236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263093999872 00000100:00100000:3.0:1788390922.405005:0:32236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390922.405017:0:32236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+15:23098:x1875263093999872:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788390922.405259:0:32236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:23098:x1875263093999872:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 243us (488us total) trans 17179869270 rc 0/0 00000100:00100000:3.0:1788390922.405267:0:32236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390922.662504:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390922.662629:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094000000 00000100:00100000:0.0:1788390922.662653:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094000000 00000100:00100000:0.0:1788390922.662734:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788390922.662745:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+5:23647:x1875263094000000:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:0.0:1788390922.662767:0:30108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390922.662789:0:30108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff6a1 expref: -99 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.662858:0:30108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.662884:0:30108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.662896:0:30108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390922.662933:0:30108:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390922.662936:0:30108:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390922.663000:0:30108:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.663028:0:30108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd34e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6a1 expref: 7 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.663050:0:30108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6a1 expref: 6 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390922.663059:0:30108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788390922.663062:0:30108:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390922.663065:0:30108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00080000:1.0:1788390922.663231:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390922.663272:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d0a7814-65be-4163-903b-0e55692238e5+6:23647:x1875263094000000:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 527us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390922.663281:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00010000:00010000:3.0:1788390923.213461:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390924.239146:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390924.622680:0:32832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2a: Test multi open when creating ===== 19:15:23 (1788390923) 00000100:00100000:0.0:1788390924.917782:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390924.917879:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390924.917912:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390924.917956:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390924.918007:0:30107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094000256 00000100:00100000:0.0:1788390924.918017:0:30107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094000256 00000100:00100000:1.0:1788390924.918073:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094000384 00000100:00100000:1.0:1788390924.918077:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094000384 00000100:00100000:0.0:1788390924.918158:0:30107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390924.918279:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094000128 00000100:00100000:3.0:1788390924.918291:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094000128 00000100:00100000:3.0:1788390924.918344:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1788390924.918353:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:2356:x1875263094000128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390924.918435:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6264aaa7-f441-4011-80bc-026a652f837f+13:2356:x1875263094000128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390924.918442:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1788390924.918539:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390924.918997:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094000512 00000100:00100000:1.0:1788390924.919001:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094000512 00000100:00100000:1.0:1788390924.919029:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788390924.919037:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263094000384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390924.919519:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2356:x1875263094000384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 481us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390924.919528:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788390924.919544:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788390924.919551:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263094000512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390924.919578:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2356:x1875263094000512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390924.919584:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00080000:3.0:1788390924.919726:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390924.919731:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390924.919734:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390924.923531:0:30107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:2356:x1875263094000256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390924.923642:0:30107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+16:2356:x1875263094000256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 5474us (5684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390924.923653:0:30107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788390925.773204:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103374336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390925.773279:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390925.773415:0:30797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103374336 00000100:00100000:1.0:1788390925.773424:0:30797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103374336 00000100:00100000:1.0:1788390925.773500:0:30797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390925.773510:0:30797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103374336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390925.773545:0:30797:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788390925.774041:0:30797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103374336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 532us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390925.774050:0:30797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390925.774899:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 2 00000004:00080000:0.0:1788390925.774905:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869195 committed transno 17179869195 00000100:00100000:0.0:1788390925.775025:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103374336:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788390926.030189:0:30144:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788390926.030201:0:30144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390926.030240:0:30144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1788390926.030246:0:30144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:1.0:1788390926.286101:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390926.784304:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788390926.784784:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390926.787556:0:30110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094001152 00000100:00100000:3.0:1788390926.787567:0:30110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094001152 00000100:00100000:3.0:1788390926.787659:0:30110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788390926.787670:0:30110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:23871:x1875263094001152:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:3.0:1788390926.787884:0:30110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:23871:x1875263094001152:12345-192.168.202.1@tcp:35:umount.0 Request processed in 215us (406us total) trans 17179869272 rc 0/0 00000100:00100000:3.0:1788390926.787891:0:30110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1788390926.791240:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390926.791327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390926.791414:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390926.791533:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094001408 00000100:00100000:0.0:1788390926.791543:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094001408 00000100:00100000:0.0:1788390926.791599:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094001536 00000100:00100000:0.0:1788390926.791602:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094001536 00000100:00100000:0.0:1788390926.791616:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390926.791623:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6264aaa7-f441-4011-80bc-026a652f837f+14:2358:x1875263094001408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390926.791633:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390926.791661:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79b200/0x9aafc5f04cd346ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff416 expref: 14 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390926.791674:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390926.791717:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6264aaa7-f441-4011-80bc-026a652f837f+13:2358:x1875263094001408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 93us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390926.791725:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390926.791742:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390926.791749:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6264aaa7-f441-4011-80bc-026a652f837f+12:2358:x1875263094001536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788390926.791755:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390926.791765:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd348ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff50b expref: 12 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390926.791773:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390926.791799:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6264aaa7-f441-4011-80bc-026a652f837f+11:2358:x1875263094001536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390926.791805:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390926.792298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390926.792320:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094001664 00000100:00100000:1.0:1788390926.792325:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094001664 00000100:00100000:1.0:1788390926.792364:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788390926.792372:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+5:2355:x1875263094001664:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1788390926.792418:0:30793:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34701 00000100:00080000:1.0:1788390926.792426:0:30793:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb40000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390926.792454:0:30793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869189 00000100:00100000:1.0:1788390926.792643:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+2:2355:x1875263094001664:12345-192.168.202.1@tcp:9:umount.0 Request processed in 273us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390926.792648:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00010000:00010000:1.0:1788390926.792662:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390926.792703:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390926.795753:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390926.795899:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094001920 00000100:00100000:0.0:1788390926.795908:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094001920 00000100:00080000:1.0:1788390926.795997:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390926.796012:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788390926.796022:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+6:2355:x1875263094001920:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:0.0:1788390926.796208:0:30795:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34708 00000020:00010000:0.0:1788390926.796215:0:30795:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6bc8bd000: total 0 00000100:00080000:0.0:1788390926.796219:0:30795:0:(import.c:65:import_set_state_nolock()) ffff95d6bc8be000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390926.796256:0:30795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869195 00000020:00010000:1.0:1788390926.796258:0:30096:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6bc8bd000: total 0 00010000:00010000:1.0:1788390926.796261:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390926.796291:0:30096:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6bc8bd000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788390926.796343:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd34e32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff69a expref: 5 pid: 30795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390926.796367:0:30096:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6bc8bd000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788390926.796388:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390926.796390:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390926.796392:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390926.796624:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+2:2355:x1875263094001920:12345-192.168.202.1@tcp:9:umount.0 Request processed in 602us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390926.796648:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788390926.806553:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390926.806666:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094002816 00000100:00100000:3.0:1788390926.806677:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094002816 00000100:00100000:3.0:1788390926.806739:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788390926.806750:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+18:2355:x1875263094002816:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1788390926.806783:0:30108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd346fa 00000020:00010000:3.0:1788390926.806798:0:30108:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d585fcb000: total 0 00000100:00080000:3.0:1788390926.806813:0:30108:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb47800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390926.806845:0:30108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869272 00000100:00100000:3.0:1788390926.807781:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:689ef09a-3944-4d2a-a8ee-4e7b3c142dac+17:2355:x1875263094002816:12345-192.168.202.1@tcp:39:umount.0 Request processed in 1027us (1229us total) trans 17179869273 rc 0/0 00000100:00100000:3.0:1788390926.807792:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000020:00010000:3.0:1788390926.808082:0:30095:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d585fcb000: total 0 00010000:00010000:3.0:1788390926.808177:0:30095:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d585fcb000, canceled 0 locks, left on hash table 10. 00010000:00010000:3.0:1788390926.808212:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d684d23000) 00010000:00010000:3.0:1788390926.808216:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390926.808223:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3478d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b7 expref: 16 pid: 30817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808246:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390926.808249:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390926.808252:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd34dfa lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff685 expref: 15 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808265:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788390926.808268:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788390926.808272:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd348c8 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff512 expref: 14 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808297:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390926.808300:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788390926.808304:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd34e24 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff693 expref: 13 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808600:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:3.0:1788390926.808615:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390926.808621:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62c00/0x9aafc5f04cd34a7a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff582 expref: 12 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808637:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390926.808640:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390926.808644:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd34d05 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff63f expref: 11 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808659:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788390926.808663:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390926.808666:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd34dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff67e expref: 10 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808686:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788390926.808688:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390926.808691:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62600/0x9aafc5f04cd34aa4 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff590 expref: 9 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808704:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d684d23200) 00010000:00010000:3.0:1788390926.808706:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390926.808710:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd34771 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff4b0 expref: 8 pid: 30107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808726:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff95d684d23a00) 00010000:00010000:3.0:1788390926.808728:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390926.808731:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd349a8 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff54a expref: 7 pid: 30109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390926.808756:0:30095:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d585fcb000, canceled 10 locks, left on hash table 0. 00010000:00010000:3.0:1788390926.808773:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390926.808775:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390926.808777:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788390926.838497:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902008 batchid updated 00000001:00080000:3.0:1788390926.838528:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869271 is committed 00000001:00080000:3.0:1788390926.838536:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869272 is committed 00000100:00100000:0.0:1788390927.309232:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788390927.309255:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103374464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390927.309325:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788390927.309670:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390927.310542:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103374848:0@lo:400:kworker.0 00000100:00100000:0.0:1788390927.310572:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390927.310599:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390927.310605:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103374720:0@lo:400:kworker.0 00000100:00100000:0.0:1788390927.310631:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390927.310659:0:30793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103374720 00000100:00100000:0.0:1788390927.310663:0:30793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103374720 00000100:00100000:0.0:1788390927.310694:0:30793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390927.310700:0:30793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103374720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390927.310736:0:30793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103374720:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390927.310742:0:30793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390927.310771:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103374720:0@lo:400:kworker.0 00000100:00080000:1.0:1788390927.311445:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390927.311451:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390927.311771:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103374848:0@lo:400:kworker.0 00000100:00100000:0.0:1788390927.312179:0:30796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103374464 00000100:00100000:0.0:1788390927.312186:0:30796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103374464 00000100:00100000:0.0:1788390927.312240:0:30796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788390927.312248:0:30796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103374464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390927.312279:0:30796:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390927.312333:0:30796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103374464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390927.312354:0:30796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788390927.313876:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390927.313987:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103374464:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788390927.360720:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 689ef09a-3944-4d2a-a8ee-4e7b3c142dac 00000020:00000080:0.0:1788390927.360730:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6bc8bd000/689ef09a-3944-4d2a-a8ee-4e7b3c142dac 00000020:00000080:0.0:1788390927.360763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc8bd000/689ef09a-3944-4d2a-a8ee-4e7b3c142dac for lustre-OST0000 00000020:00000080:0.0:1788390927.360813:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bc8be000 for lustre-OST0000 00000020:00000080:0.0:1788390927.390468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb40800/689ef09a-3944-4d2a-a8ee-4e7b3c142dac for lustre-OST0001 00000020:00000080:0.0:1788390927.390522:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bcb40000 for lustre-OST0001 00000100:00100000:1.0:1788390927.853242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390927.853277:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390927.853337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390927.853403:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094002944 00000100:00100000:3.0:1788390927.853413:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094002944 00000100:00100000:3.0:1788390927.853455:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094003200 00000100:00100000:3.0:1788390927.853457:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094003200 00000100:00100000:3.0:1788390927.853467:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094003072 00000100:00100000:3.0:1788390927.853469:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094003072 00000100:00100000:3.0:1788390927.853481:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390927.853489:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+12:2358:x1875263094002944:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390927.853503:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390927.853521:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd3471d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff44e expref: 12 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390927.853538:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390927.853591:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+11:2358:x1875263094002944:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390927.853599:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788390927.853614:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390927.853620:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+10:2358:x1875263094003200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390927.853627:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390927.853641:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd348a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff504 expref: 10 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390927.853649:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390927.853666:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+9:2358:x1875263094003200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390927.853672:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390927.853708:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390927.853732:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+8:2358:x1875263094003072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390927.853740:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390927.853749:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd34724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff478 expref: 8 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390927.853758:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390927.853772:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6264aaa7-f441-4011-80bc-026a652f837f+7:2358:x1875263094003072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 58us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390927.853778:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390927.858478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:1.0:1788390927.859273:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788390927.859430:0:30095:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6bc8bb800: total 0 00010000:00010000:3.0:1788390927.859435:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390927.859473:0:30095:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6bc8bb800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788390927.859498:0:30095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788390927.859500:0:30095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390927.859506:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd34e40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6a1 expref: 4 pid: 30108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390927.859525:0:30095:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6bc8bb800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788390927.859531:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390927.859532:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390927.859544:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390927.869705:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390927.869784:0:30101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094003712 00000100:00100000:3.0:1788390927.869794:0:30101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094003712 00000100:00100000:3.0:1788390927.869850:0:30101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:3.0:1788390927.869859:0:30101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+7:2355:x1875263094003712:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:3.0:1788390927.869901:0:30101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd346d7 00000020:00010000:3.0:1788390927.869909:0:30101:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d691889000: total 0 00000100:00080000:3.0:1788390927.869922:0:30101:0:(import.c:65:import_set_state_nolock()) ffff95d69188a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788390927.870118:0:30101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6264aaa7-f441-4011-80bc-026a652f837f+3:2355:x1875263094003712:12345-192.168.202.1@tcp:251:umount.0 Request processed in 259us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390927.870126:0:30101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000020:00010000:1.0:1788390927.871073:0:30096:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d691889000: total 0 00010000:00010000:1.0:1788390927.871121:0:30096:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d691889000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788390927.871153:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f400/0x9aafc5f04cd346de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff3e5 expref: 2 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390927.871168:0:30096:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d691889000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788390927.871176:0:30096:0:(genops.c:885:class_export_put()) final put ffff95d691889000/6264aaa7-f441-4011-80bc-026a652f837f 00010000:00010000:1.0:1788390927.871226:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390927.871229:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390927.871231:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390928.334143:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390929.020724:0:33031:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788390929.031174:0:33031:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788390929.031216:0:33031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.031228:0:33031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.031233:0:33031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.031237:0:33031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.031253:0:33031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390929.031258:0:33031:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788390929.031280:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390929.031284:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788390929.031298:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788390929.031301:0:33031:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788390929.031305:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.031311:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390929.031315:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.031322:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788390929.031326:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d686d5c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:1.0:1788390929.031336:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390929.031342:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390929.031345:0:30096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788390929.031355:0:30096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788390929.031382:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.031387:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390929.031415:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.031422:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1800/0x9aafc5f04cd343e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd343ea expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390929.031428:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103375360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390929.031432:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390929.031434:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390929.031435:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390929.031492:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390929.031584:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103375232:0@lo:39:umount.0 00000100:00100000:0.0:1788390929.031618:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390929.031723:0:30094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103375360 00000100:00100000:1.0:1788390929.031726:0:30094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103375360 00000100:00100000:1.0:1788390929.031767:0:30094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390929.031773:0:30094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+19:3288:x1875263103375360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390929.031783:0:30094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390929.031797:0:30094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd343ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd343e3 expref: 19 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.031809:0:30094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390929.031841:0:30094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+18:3288:x1875263103375360:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390929.031847:0:30094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390929.031881:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103375360:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788390929.032093:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d686d5c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788390929.032152:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb44000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390929.032198:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bcb45800 for lustre-MDT0000 00000100:00100000:0.0:1788390929.032229:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103375232:0@lo:39:umount.0 00000100:00080000:3.0:1788390929.032259:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390929.032261:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390929.032264:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788390929.033086:0:33031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033095:0:33031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033100:0:33031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033103:0:33031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a600/0x9aafc5f04cd34349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34350 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033115:0:33031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390929.033118:0:33031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033122:0:33031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033126:0:33031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033138:0:33031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd345f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345f7 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033146:0:33031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788390929.033151:0:33031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033157:0:33031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033163:0:33031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033169:0:33031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd34962 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34969 expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033176:0:33031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788390929.033181:0:33031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033187:0:33031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033193:0:33031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033200:0:33031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ae00/0x9aafc5f04cd3433b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34342 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390929.033214:0:33031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788390929.033217:0:33031:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788390929.033237:0:33031:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788390929.033241:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788390929.033244:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390929.033249:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788390929.033254:0:33031:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d69188f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390929.033259:0:33031:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d587044800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788390929.033265:0:33031:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d6bc8bb800 5d0a7814-65be-4163-903b-0e55692238e5 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 17179869244 stale:0 00000020:00080000:3.0:1788390929.033269:0:33031:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d585fcb000 689ef09a-3944-4d2a-a8ee-4e7b3c142dac 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 17179869272 stale:0 00000020:00080000:3.0:1788390929.033274:0:33031:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff95d5873e8000) has exports, disconnecting them 00000020:00080000:3.0:1788390929.033278:0:33031:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d69188f800), last request at 1788390927 00000020:00000080:3.0:1788390929.033283:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd345e2 00000100:00080000:3.0:1788390929.033305:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d69188e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788390929.033346:0:33031:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d69188f800): rc 0 00000020:00000080:3.0:1788390929.033348:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d69188f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788390929.033354:0:33031:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d587044800), last request at 1788390927 00000020:00000080:3.0:1788390929.033357:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34499 00000100:00080000:3.0:1788390929.033362:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d587043000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788390929.033368:0:33031:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d587044800): rc 0 00000020:00000080:3.0:1788390929.033370:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d587044800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788390929.033375:0:33031:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba8587043ae0 00000100:00080000:3.0:1788390929.033391:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390929.033394:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 3 00000004:00080000:3.0:1788390929.033403:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788390929.033460:0:33031:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788390929.033473:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788390929.033482:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390929.033484:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 3 00000004:00080000:3.0:1788390929.033493:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788390929.033558:0:33031:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788390929.033565:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788390929.033590:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d5873e8000) has no exports 00000020:00000080:1.0:1788390929.033655:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69188f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390929.033693:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d587044800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788390929.033716:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69188e800 for lustre-MDT0000 00000020:00000080:1.0:1788390929.033721:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d587043000 for lustre-MDT0000 00010000:00010000:1.0:1788390929.033729:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390929.033776:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103375488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390929.033801:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390929.034105:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103376000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390929.034261:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103375872:0@lo:9:umount.0 00000100:00100000:0.0:1788390929.034396:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390929.034418:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103376128:0@lo:9:umount.0 00000100:00100000:0.0:1788390929.034438:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390929.034467:0:30795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103375872 00000100:00100000:0.0:1788390929.034470:0:30795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103375872 00000100:00100000:0.0:1788390929.034503:0:30795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390929.034509:0:30795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103375872:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788390929.034528:0:30795:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd344b5 00000100:00080000:0.0:1788390929.034533:0:30795:0:(import.c:65:import_set_state_nolock()) ffff95d587f66000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390929.034560:0:30795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869195 00000100:00100000:0.0:1788390929.034839:0:30795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103375872:12345-0@lo:9:umount.0 Request processed in 329us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390929.034846:0:30795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788390929.034879:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788390929.034889:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788390929.034891:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390929.034893:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103375872:0@lo:9:umount.0 00000100:00100000:0.0:1788390929.034927:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390929.034987:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788390929.034990:0:30103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390929.035032:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376000 00000100:00100000:1.0:1788390929.035036:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376000 00000100:00100000:1.0:1788390929.035058:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390929.035064:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+15:3288:x1875263103376000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390929.035071:0:30092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390929.035079:0:30092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62200/0x9aafc5f04cd34342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3433b expref: 15 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390929.035090:0:30092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390929.035118:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:3288:x1875263103376000:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390929.035124:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390929.035145:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103376000:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788390929.035187:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788390929.035198:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788390929.035200:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390929.035203:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103376128:0@lo:9:umount.0 00000020:00080000:3.0:1788390929.040194:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d5873e8000) has no exports 00000020:00000080:3.0:1788390929.071453:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34396 00000020:00000080:3.0:1788390929.071470:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d69fc68800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788390929.071558:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788390929.071569:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390929.071579:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390929.071583:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff95d5873e99b8) has no exports 00000020:00000080:3.0:1788390929.072107:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3438f 00000020:00000080:3.0:1788390929.072112:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6b640b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390929.072275:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390929.072283:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788390929.072415:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d682b28800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788390929.072419:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682b28800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788390929.072429:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1788390931.944113:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d0a7814-65be-4163-903b-0e55692238e5 00000001:00080000:3.0:1788390931.944132:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869274 is committed 00000020:00000080:3.0:1788390931.944137:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d6bc8bb800/5d0a7814-65be-4163-903b-0e55692238e5 00000001:00100000:3.0:1788390931.944158:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 689ef09a-3944-4d2a-a8ee-4e7b3c142dac 00000001:00080000:3.0:1788390931.944163:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869273 is committed 00000020:00000080:3.0:1788390931.944165:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d585fcb000/689ef09a-3944-4d2a-a8ee-4e7b3c142dac 00010000:00010000:1.0:1788390932.429202:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390932.429342:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390932.429361:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788390932.429407:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103376384:0@lo:400:kworker.0 00000100:00100000:1.0:1788390932.429444:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390932.429463:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390932.429497:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103376512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390932.429527:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390932.429651:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376384 00000100:00100000:3.0:1788390932.429659:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376384 00000100:00100000:3.0:1788390932.429696:0:30817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376512 00000100:00100000:3.0:1788390932.429699:0:30817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376512 00000100:00100000:3.0:1788390932.429722:0:30817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788390932.429732:0:30817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3286:x1875263103376384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788390932.429744:0:30817:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788390932.429778:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788390932.429783:0:30102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376256 00000100:00100000:3.0:1788390932.429785:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1875263103376512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390932.429789:0:30102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376256 00000020:00080000:3.0:1788390932.429793:0:30108:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788390932.429826:0:30102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788390932.429835:0:30102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:3288:x1875263103376256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390932.429839:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1875263103376512:12345-0@lo:400:kworker.0 Request processed in 52us (311us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788390932.429853:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788390932.429907:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788390932.429913:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d585fc9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788390932.429919:0:3287:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788390932.429926:0:30102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88fdb212-e2bb-4a0f-abe2-1cb76d00c478+14:3288:x1875263103376256:12345-0@lo:400:kworker.0 Request processed in 92us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390932.429936:0:30102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788390932.429999:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3288:1875263103376256:0@lo:400:kworker.0 00000100:00100000:1.0:1788390932.430900:0:30817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3286:x1875263103376384:12345-0@lo:400:kworker.0 Request processed in 1166us (1436us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390932.430909:0:30817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1788390932.430956:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390932.430982:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d69188a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788390932.430986:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788390932.430992:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d69188a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390932.430996:0:3286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 698 00000100:00080000:1.0:1788390932.431001:0:3286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d69188a800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390932.431025:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc7c9180 x1875263103376640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390932.431052:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103376384:0@lo:400:kworker.0 00000100:00100000:0.0:1788390932.431681:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103376640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788390932.431719:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390932.433443:0:30108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376640 00000100:00100000:0.0:1788390932.433453:0:30108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376640 00000100:00100000:0.0:1788390932.433489:0:30108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788390932.433496:0:30108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103376640:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788390932.433514:0:30108:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788390932.436293:0:3287:0:(import.c:65:import_set_state_nolock()) ffff95d585fc9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390932.436303:0:3287:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 708 00000100:00080000:3.0:1788390932.436311:0:3287:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d585fc9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390932.437647:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68f55f100 x1875263103376768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390932.437679:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103376512:0@lo:400:kworker.0 00000100:00100000:3.0:1788390932.437716:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103376768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788390932.437785:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390932.437847:0:30109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376768 00000100:00100000:3.0:1788390932.437853:0:30109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376768 00000100:00100000:3.0:1788390932.440060:0:30109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788390932.440073:0:30109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103376768:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788390932.440093:0:30109:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788390932.440172:0:30109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103376768:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 99us (2385us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788390932.440180:0:30109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788390932.440236:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d585fc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390932.440241:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788390932.440245:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103376768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788390932.451359:0:30108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103376640:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 17854us (19631us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390932.451374:0:30108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788390932.451429:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d69188a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390932.451435:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390932.451438:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103376640:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:1.0:1788390932.467198:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d587f63800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788390932.467244:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d587f66000 for lustre-OST0000 00000001:00100000:0.0:1788390932.474928:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390932.474975:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6bc8bc800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788390934.477126:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788390935.117085:0:33031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d68ecfff60 - data ffff95d6b8f675e8/ffff95d585fc0400 00000020:01000000:3.0:1788390935.117182:0:33031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d68ecfb960 - data ffff95d6b5e6f000/ffff95d6a14bbc00 00000001:00000004:3.0:1788390935.123321:0:33031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869274 00000100:00080000:3.0:1788390935.186863:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788390935.186872:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 4 00000004:00080000:3.0:1788390935.187043:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390935.187047:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788390935.187707:0:30130:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788390935.187713:0:30130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 3 count 1 00000040:00080000:0.0:1788390935.187723:0:30130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000100:00080000:3.0:1788390935.189118:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788390935.189124:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 4 00000004:00080000:3.0:1788390935.189170:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788390935.189173:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788390935.189519:0:30132:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788390935.189523:0:30132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 1 00000040:00080000:0.0:1788390935.189534:0:30132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 4 count 2 00000020:00000080:1.0:1788390935.248127:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3435e 00000020:00000080:1.0:1788390935.248139:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390935.249291:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390935.249484:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34373 00000020:00000080:1.0:1788390935.249493:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d688579000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788390935.249540:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788390935.249548:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.249568:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788390935.249572:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff95d5873ecd28) has no exports 00000004:01000000:1.0:1788390935.249732:0:33031:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788390935.249741:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd343c0 00000020:00000080:1.0:1788390935.249758:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbed2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390935.250056:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d688579000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788390935.250159:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788390935.250163:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.250168:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788390935.250171:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff95d68a8eb370) has no exports 00000020:00000080:1.0:1788390935.250176:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd343b9 00000020:00000080:1.0:1788390935.250180:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d682b2b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390935.250287:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788390935.250714:0:33031:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788390935.250718:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788390935.250722:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 5 00000004:00080000:1.0:1788390935.250728:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390935.250731:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390935.250820:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682b2b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390935.251041:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.251048:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390935.251054:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd343ab 00000020:00000080:1.0:1788390935.251060:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbed6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390935.251091:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d682b29800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788390935.251098:0:38:0:(genops.c:885:class_export_put()) final put ffff95d6bbed2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390935.251108:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788390935.251113:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788390935.251569:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788390935.251574:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.251580:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788390935.251583:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff95d68a8e8000) has no exports 00000020:00000080:1.0:1788390935.251588:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd343a4 00000020:00000080:1.0:1788390935.251592:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390935.251615:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788390935.252048:0:33031:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788390935.252052:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788390935.252055:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 5 00000004:00080000:1.0:1788390935.252059:0:33031:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390935.252061:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390935.252279:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788390935.252422:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.252437:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390935.252474:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.252478:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390935.252482:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390935.252485:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788390935.252489:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788390935.252621:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3437a 00000020:00000080:1.0:1788390935.252626:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee5000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788390935.252648:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbee5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788390935.252654:0:38:0:(genops.c:885:class_export_put()) final put ffff95d6bbed6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390935.252656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788390935.252660:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788390935.252828:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788390935.252833:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.252851:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788390935.252855:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff95d5873eb370) has no exports 00000020:00000080:1.0:1788390935.252880:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.252884:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788390935.252888:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34381 00000020:00000080:1.0:1788390935.252892:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390935.252982:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788390935.252986:0:38:0:(genops.c:885:class_export_put()) final put ffff95d6bbee1000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788390935.252988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788390935.252993:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788390935.253263:0:33031:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d587662000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788390935.253267:0:33031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d587662000 3 00000020:01000004:1.0:1788390935.253270:0:33031:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d587662000 from lustre-MDT0000 00000020:00000080:1.0:1788390935.253289:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.253293:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788390935.253295:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbee1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788390935.253298:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788390935.253315:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788390935.253343:0:33031:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788390935.253346:0:33031:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788390935.253348:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788390935.253352:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.253355:0:33031:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788390935.253360:0:33031:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff95d6bbed4000 88fdb212-e2bb-4a0f-abe2-1cb76d00c478 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788390935.253365:0:33031:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff95d68a8e99b8) has exports, disconnecting them 00000020:00080000:1.0:1788390935.253370:0:33031:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95d6bbed4000), last request at 1788390874 00000020:00000080:1.0:1788390935.253391:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34326 00000020:00010000:1.0:1788390935.253395:0:33031:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6bbed4000: total 1 00000100:00080000:1.0:1788390935.253399:0:33031:0:(import.c:65:import_set_state_nolock()) ffff95d6bbed7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788390935.253527:0:33031:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6bbed4000): rc 0 00000020:00080000:1.0:1788390935.253531:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff95d68a8e99b8) has no exports 00000100:00100000:1.0:1788390935.253579:0:30101:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff95d682f05200:30101] 1 exiting: rc = 0 00000100:00100000:1.0:1788390935.253698:0:30102:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff95d682f05600:30102] 2 exiting: rc = 0 00000020:00010000:0.0:1788390935.253765:0:30096:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6bbed4000: total 1 00010000:00010000:0.0:1788390935.253769:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390935.253800:0:30096:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6bbed4000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788390935.253828:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd345a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3459c expref: 9 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.253994:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd3494d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34946 expref: 8 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254006:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63600/0x9aafc5f04cd34484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3447d expref: 7 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254017:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1c00/0x9aafc5f04cd345cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd345c6 expref: 6 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254027:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63800/0x9aafc5f04cd34334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3432d expref: 5 pid: 30101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254037:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd3495b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34954 expref: 4 pid: 30102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254055:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92000/0x9aafc5f04cd3444c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34445 expref: 3 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254068:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93800/0x9aafc5f04cd3445a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34453 expref: 2 pid: 30100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390935.254090:0:30096:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6bbed4000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788390935.254104:0:30096:0:(genops.c:885:class_export_put()) final put ffff95d6bbed4000/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 00000100:00100000:1.0:1788390935.254181:0:30100:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff95d6bc8c8a00:30100] 0 exiting: rc = 1 00000100:00100000:1.0:1788390935.254256:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254265:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254271:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254277:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254282:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254290:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254295:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254313:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254320:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254325:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254331:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254338:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254344:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254350:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254355:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254361:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254367:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254372:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254378:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254383:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254388:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254393:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254399:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254405:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254410:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254425:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254430:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254436:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254442:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254447:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254452:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254459:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254464:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254468:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254474:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254479:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254485:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254489:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254495:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254500:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254505:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254511:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254516:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254522:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254527:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254532:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254537:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254543:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254548:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254554:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254559:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254564:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254569:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254574:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254578:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254583:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254588:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254593:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254598:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254603:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254616:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254622:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254628:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.254634:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788390935.255268:0:33031:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788390935.255271:0:33031:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1788390935.255833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788390935.256037:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390935.256040:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390935.256043:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390935.256117:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed4000/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 for MGS 00000020:00000080:3.0:1788390935.256283:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbed7800 for MGS 00000020:01000000:1.0:1788390935.257221:0:33031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d692210c00 - data ffff95d68b05f948/ffff95d586b7d400 00000020:01000000:1.0:1788390935.257498:0:33031:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6b3278b40 - data ffff95d6b5e8ce58/ffff95d6b55ed400 00000020:00000080:1.0:1788390935.258029:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3430a 00000020:00000080:1.0:1788390935.258036:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbed5800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788390935.258051:0:33031:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d587662000 from MGS, refs=2 00000020:01000004:1.0:1788390935.258055:0:33031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d587662000 2 00000020:01000004:1.0:1788390935.258058:0:33031:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d587662000 from MGS 00000020:00000080:1.0:1788390935.258077:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390935.258084:0:33031:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788390935.258087:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbed0800/MGS 00000020:00000080:1.0:1788390935.258089:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed0800/MGS for MGS 00000020:01000000:1.0:1788390935.258095:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788390935.258144:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788390935.258149:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390935.258155:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788390935.258161:0:33031:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95d686d5d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788390935.258166:0:33031:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff95d6bc7599b8) has exports, disconnecting them 00000020:00080000:1.0:1788390935.258171:0:33031:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95d686d5d000), last request at 1788390874 00000020:00000080:1.0:1788390935.258176:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd343f8 00000020:00080000:1.0:1788390935.258196:0:33031:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d686d5d000): rc 0 00000020:00000080:1.0:1788390935.258202:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d686d5d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788390935.259482:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788390935.259494:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d686d5d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788390935.260012:0:33031:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788390935.260017:0:33031:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390935.260021:0:33031:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390935.260027:0:33031:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390935.260203:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390935.260211:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788390935.260216:0:33031:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d587662000 1 00000020:00000080:0.0:1788390935.260221:0:33031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd342fc 00000020:00000080:0.0:1788390935.260227:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6bbed4800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788390935.260232:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788390935.260237:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390935.260240:0:33031:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390935.260243:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff95d69131cd28) has no exports 00000020:00000080:3.0:1788390935.260557:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d686d5c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788390935.260566:0:38:0:(genops.c:885:class_export_put()) final put ffff95d69052f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788390935.260568:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69052f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788390935.260573:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788390935.260639:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbed4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390935.274765:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390935.274781:0:33031:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788390935.274786:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d587662800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390935.274791:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d587662800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788390935.274798:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788390935.274944:0:33031:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d587665000 00000020:01000000:0.0:1788390935.274983:0:33031:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788390935.274989:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390935.274993:0:33031:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390935.274998:0:33031:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff95d691318000) has no exports 00000100:00100000:0.0:1788390935.275074:0:30108:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff95d682e48000:30108] 1 exiting: rc = 0 00000100:00100000:0.0:1788390935.278059:0:30817:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff95d585265200:30817] 3 exiting: rc = 0 00000100:00100000:0.0:1788390935.278150:0:30109:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff95d682e49e00:30109] 2 exiting: rc = 0 00000100:00100000:0.0:1788390935.278226:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278235:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278241:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278247:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278255:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278262:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278268:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278273:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278281:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278289:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278295:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278301:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278321:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278328:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278335:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278340:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278346:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278352:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278358:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278364:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278370:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278377:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278383:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278388:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278395:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278400:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278406:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278412:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278418:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278424:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278429:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278434:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278439:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278445:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278458:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278468:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278475:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278480:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278486:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278493:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278499:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278506:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278512:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278517:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278523:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278529:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278535:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278546:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278551:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278557:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278563:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278569:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278574:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278580:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278588:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278595:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278601:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278608:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278614:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278623:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278630:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278635:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278641:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.278647:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.281788:0:32236:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff95d684c37c00:32236] 2 exiting: rc = 0 00000100:00100000:3.0:1788390935.282117:0:30110:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95d6bbd58c00:30110] 0 exiting: rc = 1 00000100:00100000:3.0:1788390935.284129:0:30111:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95d6bbd59e00:30111] 1 exiting: rc = 0 00000100:00100000:0.0:1788390935.284457:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284468:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284474:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284481:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284500:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284509:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284515:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284520:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284524:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284529:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284534:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284540:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284549:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284555:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284560:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284565:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284569:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284574:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284580:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284585:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284591:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284597:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284602:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284608:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284613:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284618:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284623:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284628:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284633:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284638:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284644:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284650:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284655:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284660:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284665:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284671:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284676:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284681:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284686:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284698:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284704:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284710:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284715:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284720:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284726:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284731:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284736:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284742:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284747:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284753:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284757:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284762:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284768:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284774:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284779:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284785:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284791:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284796:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284802:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284808:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284813:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284819:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284824:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.284830:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.285450:0:30113:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff95d682e6f000:30113] 1 exiting: rc = 0 00000100:00100000:3.0:1788390935.285581:0:32240:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff95d6b4ddc800:32240] 2 exiting: rc = 0 00000100:00100000:1.0:1788390935.296472:0:30112:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff95d585f26800:30112] 0 exiting: rc = 1 00000100:00100000:0.0:1788390935.296709:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296718:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296725:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296730:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296738:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296744:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296750:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296756:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296764:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296782:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296788:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296795:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296801:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296807:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296832:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296839:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296855:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296862:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296869:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296874:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296880:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296886:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296894:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296901:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296907:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296913:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296935:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296943:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296950:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.296956:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297145:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297151:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297157:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297163:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297169:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297175:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297181:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297251:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297277:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297284:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297289:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297296:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297302:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297379:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297393:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297400:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297406:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297412:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297417:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297423:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297442:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297449:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297455:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297461:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297466:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297472:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297477:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297483:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297489:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297495:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297503:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297509:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297514:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.297520:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.306127:0:30114:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95d584a8c600:30114] 0 exiting: rc = 1 00000100:00100000:3.0:1788390935.306380:0:30115:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95d682eb3400:30115] 1 exiting: rc = 0 00000100:00100000:0.0:1788390935.306500:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306508:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306512:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306518:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306524:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306528:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306533:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306538:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306544:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306549:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306555:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306560:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306566:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306570:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306576:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306592:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306598:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306603:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306609:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306614:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306619:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306624:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306629:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306634:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306639:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306643:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306648:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306653:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306657:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306661:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306666:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306672:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306677:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306682:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306688:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306694:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306700:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306705:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306709:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306714:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306719:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306724:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306730:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306735:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306740:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306745:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306750:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306755:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306760:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306765:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306777:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306782:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306787:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306792:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306796:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306801:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306806:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306811:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306816:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306820:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306825:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306830:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306834:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.306839:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390935.309934:0:30116:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95d682eb3c00:30116] 0 exiting: rc = 1 00000100:00100000:3.0:1788390935.310141:0:30117:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95d6885e0600:30117] 1 exiting: rc = 0 00000100:00100000:0.0:1788390935.310332:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310339:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310344:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310350:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310355:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310360:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310365:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310370:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310375:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310379:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310384:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310389:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310394:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310398:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310403:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310408:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310413:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310418:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310423:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310428:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310433:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310446:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310451:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310456:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310461:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310466:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310471:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310476:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310481:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310486:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310491:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310496:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310501:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310506:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310512:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310516:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310522:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310527:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310532:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310537:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310542:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310547:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310553:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310558:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310563:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310568:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310574:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310579:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310590:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310598:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310606:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310611:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310620:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310628:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310633:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310640:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310655:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310663:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310671:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310677:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310684:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310692:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310697:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.310706:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390935.311318:0:30118:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff95d6885e1000:30118] 0 exiting: rc = 1 00000100:00100000:1.0:1788390935.311494:0:30119:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff95d6885e0a00:30119] 1 exiting: rc = 0 00000100:00100000:0.0:1788390935.311635:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311641:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311646:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311651:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311656:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311661:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311665:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311670:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311675:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311680:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311686:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311696:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311702:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.311733:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312139:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312149:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312154:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312161:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312169:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312175:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312183:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312196:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312204:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312212:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312217:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312228:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312233:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312251:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312256:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312382:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312391:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312415:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312421:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312434:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312439:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312444:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312449:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312453:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312458:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312463:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312468:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312472:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312477:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312482:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312486:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312490:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312495:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312499:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312504:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312508:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312512:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312517:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312521:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312525:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312529:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312534:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312539:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312543:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312548:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312552:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312556:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312561:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312571:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.312576:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390935.313699:0:30120:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff95d6922a9200:30120] 0 exiting: rc = 1 00000100:00100000:1.0:1788390935.313711:0:30121:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff95d6922a9600:30121] 1 exiting: rc = 0 00000100:00100000:3.0:1788390935.318657:0:30122:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff95d6922a9c00:30122] 2 exiting: rc = 0 00000100:00100000:0.0:1788390935.318833:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318905:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318911:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318917:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318923:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318935:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.318942:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319045:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319051:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319056:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319061:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319067:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319072:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319079:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319085:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319092:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319098:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319103:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319109:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319115:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319121:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319155:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319163:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319168:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319173:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319180:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319246:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319254:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319259:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319264:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319269:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319275:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319280:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319409:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319416:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319422:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319427:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319432:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319438:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319443:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319448:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319452:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319457:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319462:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319467:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319473:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319478:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319483:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319487:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319492:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319497:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319502:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319507:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319512:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319517:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319534:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319541:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319547:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319553:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319558:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319589:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319596:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319601:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390935.319617:0:33031:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788390935.330503:0:33031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390935.330515:0:33031:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788390935.330520:0:33031:0:(genops.c:885:class_export_put()) final put ffff95d6853bf800/MDS_uuid 00000020:00000080:0.0:1788390935.330526:0:33031:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853bf800/MDS_uuid for MDS 00000020:01000000:0.0:1788390935.330547:0:33031:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788390935.330663:0:33031:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788390935.502117:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390936.528800:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390937.111450:0:33185:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788390937.126164:0:33185:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788390937.126212:0:33185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.126226:0:33185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.126233:0:33185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.126241:0:33185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.126262:0:33185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788390937.126267:0:33185:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788390937.126289:0:33185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788390937.126294:0:33185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788390937.126301:0:33185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390937.126306:0:33185:0:(import.c:65:import_set_state_nolock()) ffff95d69188a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788390937.126311:0:33185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788390937.126314:0:33185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788390937.126316:0:33185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788390937.127635:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390937.127656:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390937.127666:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390937.127671:0:30095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390937.127686:0:30095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390937.127696:0:30095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390937.127701:0:30095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390937.127705:0:30095:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788390937.127708:0:30095:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788390937.127750:0:30095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390937.127762:0:30095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390937.127787:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390937.127795:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3447d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34484 expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390937.127823:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390937.127825:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390937.127836:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390937.128445:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103376896 00000100:00100000:3.0:1788390937.128452:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103376896 00000100:00100000:3.0:1788390937.128648:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390937.128655:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1875263103376896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788390937.128661:0:30092:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390937 with bad export cookie 11146345238637003558 00010000:00010000:1.0:1788390937.132480:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390937.132489:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132500:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390937.132504:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132527:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390937.132535:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390937.132541:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390937.132544:0:30096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788390937.132547:0:30096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788390937.132586:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132593:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390937.132625:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132633:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3445a expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132647:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390937.132651:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132657:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390937.132659:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132666:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390937.132686:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390937.132691:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788390937.132693:0:30096:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788390937.132695:0:30096:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788390937.132708:0:30096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132713:0:30096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390937.132729:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132736:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93600/0x9aafc5f04cd34954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3495b expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390937.132745:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390937.132747:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390937.132749:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390937.132769:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103377024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390937.132845:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390937.134713:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1875263103376896:12345-0@lo:103:ldlm_bl.0 Request processed in 6045us (6600us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788390937.134734:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3286:1875263103377152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390937.134796:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390937.134804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390937.134915:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103377024 00000100:00100000:3.0:1788390937.134926:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103377024 00000100:00100000:3.0:1788390937.134955:0:30092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103377152 00000100:00100000:3.0:1788390937.134958:0:30092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103377152 00000100:00100000:3.0:1788390937.135006:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390937.135014:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1875263103377024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788390937.135022:0:30092:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390937 with bad export cookie 11146345238637003558 00000100:00100000:3.0:1788390937.135054:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3289:x1875263103377024:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (2209us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788390937.135061:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390937.135146:0:30092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788390937.135151:0:30092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3286:x1875263103377152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788390937.135155:0:30092:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390937 with bad export cookie 11146345238637003558 00000100:00100000:3.0:1788390937.135193:0:30092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3286:x1875263103377152:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (392us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788390937.135220:0:30092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788390937.135246:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788390937.135371:0:3289:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390937.135377:0:3289:0:(import.c:65:import_set_state_nolock()) ffff95d6853bd800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788390937.135381:0:3289:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788390937.136972:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788390937.140638:0:3289:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788390937.140660:0:3289:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788390937.140668:0:3289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d68f55f100 x1875263103376896/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390953 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390937.140693:0:3289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc7c8000 x1875263103377024/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390953 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390937.140702:0:3289:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc7cad80 x1875263103377152/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788390953 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788390937.140712:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788390937.140715:0:3289:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788390937.140716:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788390937.140999:0:3286:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff95d6853bd800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788390937.141022:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3286:1875263103377152:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788390937.141116:0:3289:0:(import.c:65:import_set_state_nolock()) ffff95d6853bd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390937.141122:0:3289:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1788390937.141129:0:3289:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d6853bd800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390937.141155:0:3289:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc7c8e00 x1875263103377280/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390937.141190:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103376896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390937.141204:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3289:1875263103377024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390937.141227:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88fdb212-e2bb-4a0f-abe2-1cb76d00c478:3285:1875263103377280:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788390937.141378:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103377280 offset 0 length 520: 4 00100000:10000000:0.0:1788390937.151910:0:33185:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788390937.169146:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b04000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788390937.169159:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69188d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788390937.172200:0:33185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788390937.172212:0:33185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390937.172218:0:33185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788390937.172230:0:33185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788390937.172396:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69188a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788390937.172569:0:33185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390937.172580:0:33185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788390937.172587:0:33185:0:(genops.c:885:class_export_put()) final put ffff95d684547800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788390937.172592:0:33185:0:(genops.c:844:class_export_destroy()) destroying export ffff95d684547800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788390937.172602:0:33185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788390937.172671:0:33185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bc63a000 1 00000020:00000080:3.0:1788390937.172677:0:33185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34437 00000020:00000080:3.0:1788390937.172683:0:33185:0:(genops.c:885:class_export_put()) final put ffff95d6b6532800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788390937.172697:0:33185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788390937.172701:0:33185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390937.172706:0:33185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788390937.172710:0:33185:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff95d6913199b8) has no exports 00000020:00000080:1.0:1788390937.172838:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6532800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788390937.184329:0:33185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390937.184349:0:33185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788390937.184354:0:33185:0:(genops.c:885:class_export_put()) final put ffff95d6bbee6000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788390937.184359:0:33185:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788390937.184367:0:33185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788390937.184495:0:33185:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d6bbee3000 00000020:02000400:3.0:1788390937.184550:0:33185:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788390937.552992:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390937.553336:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103377408:0@lo:38:kworker.0 00000400:00000100:1.0:1788390937.553408:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103377408 offset 0 length 520: 4 00010000:00010000:3.0:1788390938.575423:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390938.881273:0:33336:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788390938.891176:0:33336:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788390938.891331:0:33336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.891345:0:33336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.891352:0:33336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.891359:0:33336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.891380:0:33336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788390938.891385:0:33336:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788390938.891408:0:33336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390938.891419:0:33336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc648a80 x1875263103377408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390952 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788390938.891493:0:33336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788390938.891500:0:33336:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788390938.891506:0:33336:0:(import.c:65:import_set_state_nolock()) ffff95d585fc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788390938.891511:0:33336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788390938.891516:0:33336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc648a80 x1875263103377408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788390952 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788390938.891551:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390938.891559:0:30096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390938.891567:0:30096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390938.891583:0:30096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390938.891593:0:30096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390938.891601:0:30096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390938.891607:0:30096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788390938.891610:0:30096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788390938.891612:0:30096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788390938.891625:0:30096:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d6853bd800 00010000:00010000:1.0:1788390938.891628:0:30096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390938.891632:0:30096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d5877ab200/0x9aafc5f04cd345c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd345cd expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390938.891639:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390938.891640:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390938.891642:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390938.892207:0:33336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788390938.892385:0:33336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788390938.893800:0:33336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.893838:0:33336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.893845:0:33336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.893853:0:33336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.894033:0:33336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390938.894042:0:33336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.894049:0:33336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.894054:0:33336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390938.894061:0:33336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894124:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390938.894131:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894138:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390938.894141:0:30095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894149:0:30095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390938.894157:0:30095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390938.894163:0:30095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390938.894166:0:30095:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788390938.894176:0:30095:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d6853bd800 00010000:00010000:0.0:1788390938.894179:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894186:0:30095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd3459c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd345a3 expref: -99 pid: 31515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894208:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390938.894211:0:30095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894217:0:30095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390938.894219:0:30095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894225:0:30095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390938.894231:0:30095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390938.894235:0:30095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788390938.894236:0:30095:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788390938.894307:0:30095:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d6853bd800 00010000:00010000:0.0:1788390938.894311:0:30095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.894318:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390938.894320:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390938.894322:0:30095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390938.894388:0:33336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788390938.894393:0:33336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93000/0x9aafc5f04cd34946 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3494d expref: -99 pid: 30105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390938.894408:0:33336:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788390938.894412:0:33336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788390938.894414:0:33336:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788390938.894444:0:33336:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788390938.894448:0:33336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788390938.894451:0:33336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788390938.894456:0:33336:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788390938.894460:0:33336:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d69180cd28) has no exports 00000020:00080000:3.0:1788390938.894484:0:33336:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d69180cd28) has no exports 00010000:00010000:1.0:1788390938.896467:0:30096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390938.934695:0:33336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd345b1 00000020:00000080:0.0:1788390938.934706:0:33336:0:(genops.c:885:class_export_put()) final put ffff95d6bc63b000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788390938.934763:0:33336:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d587f66800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788390938.934767:0:33336:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d587f66800 2 00000020:01000004:0.0:1788390938.934771:0:33336:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d587f66800 from lustre-OST0001 00000020:00000080:0.0:1788390938.934797:0:33336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390938.934825:0:33336:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788390938.934828:0:33336:0:(genops.c:885:class_export_put()) final put ffff95d6bcb42800/lustre-OST0001_UUID 00000020:00000080:0.0:1788390938.934831:0:33336:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb42800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788390938.934838:0:33336:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788390938.934924:0:33336:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 88fdb212-e2bb-4a0f-abe2-1cb76d00c478->MGS 00010000:00010000:0.0:1788390938.934938:0:33336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390938.934950:0:33336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390938.935062:0:33336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788390938.935065:0:33336:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788390938.935069:0:33336:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788390938.935082:0:33336:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d6853bd800 00010000:00010000:0.0:1788390938.935085:0:33336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0600/0x9aafc5f04cd34445 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3444c expref: -99 pid: 30791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390938.935102:0:33336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390938.935108:0:33336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390938.935113:0:33336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390938.935115:0:33336:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788390938.935116:0:33336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788390938.935123:0:33336:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d6853bd800 00010000:00010000:0.0:1788390938.935125:0:33336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd3432d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd34334 expref: -99 pid: 30089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788390938.935138:0:33336:0:(import.c:65:import_set_state_nolock()) ffff95d6853bd800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788390938.935146:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788390938.935149:0:33336:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788390938.935150:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788390938.935154:0:33336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788390938.935163:0:33336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bc7c8e00 x1875263103377280/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788390947 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788390938.935174:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788390938.935176:0:33336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 10000000:01000000:0.0:1788390938.935347:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788390938.935354:0:33336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34318 00000020:00000080:0.0:1788390938.935359:0:33336:0:(genops.c:885:class_export_put()) final put ffff95d6853ba800/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 00000020:00000080:1.0:1788390938.935399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc63b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788390938.935472:0:33336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:0.0:1788390938.935477:0:33336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390938.935482:0:33336:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390938.935486:0:33336:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff95d69131b370) has no exports 10000000:01000000:0.0:1788390938.935611:0:33336:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:0.0:1788390938.935614:0:33336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788390938.935616:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788390938.935618:0:33336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788390938.935619:0:33336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788390938.935642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853ba800/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 for MGC192.168.202.101@tcp 00000020:00000080:0.0:1788390938.935733:0:33336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390938.935738:0:33336:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid 88fdb212-e2bb-4a0f-abe2-1cb76d00c478) 00000020:01000000:0.0:1788390938.935743:0:33336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788390938.935747:0:33336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390938.935750:0:33336:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390938.935754:0:33336:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95d587043800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390938.935759:0:33336:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff95d69180b370) has exports, disconnecting them 00000020:00080000:0.0:1788390938.935764:0:33336:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95d587043800), last request at 1788390891 00000020:00000080:0.0:1788390938.935767:0:33336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd345db 00000020:00080000:0.0:1788390938.935777:0:33336:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d587043800): rc 0 00000020:00000080:0.0:1788390938.935781:0:33336:0:(genops.c:885:class_export_put()) final put ffff95d587043800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788390938.935805:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6853bd800 for MGC192.168.202.101@tcp 00000020:00000080:1.0:1788390938.935818:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6a0d92000/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 00000020:00000080:1.0:1788390938.935821:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a0d92000/88fdb212-e2bb-4a0f-abe2-1cb76d00c478 for MGC192.168.202.101@tcp 00000020:01000000:1.0:1788390938.935825:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (88fdb212-e2bb-4a0f-abe2-1cb76d00c478) 00000020:00000080:1.0:1788390938.936307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d587043800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788390938.937101:0:33336:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788390938.937106:0:33336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788390938.937110:0:33336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788390938.937115:0:33336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788390938.941039:0:30095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788390938.941216:0:30096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788390938.941484:0:30090:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95d585f27a00:30090] 0 exiting: rc = 1 00000100:00100000:3.0:1788390938.942808:0:30091:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95d585f27400:30091] 1 exiting: rc = 0 00000100:00100000:1.0:1788390938.943208:0:30094:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95d585f26200:30094] 2 exiting: rc = 0 00000100:00100000:1.0:1788390938.943276:0:30093:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95d585f27c00:30093] 1 exiting: rc = 0 00000100:00100000:3.0:1788390938.943623:0:30092:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95d585f27000:30092] 0 exiting: rc = 1 00000020:00000080:1.0:1788390938.944807:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc8bd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788390938.956653:0:30103:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788390938.956745:0:30793:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff95d586c93800:30793] 0 exiting: rc = 1 00000100:00100000:0.0:1788390938.957421:0:30795:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff95d5852ee000:30795] 2 exiting: rc = 0 00000100:00100000:0.0:1788390938.959128:0:30797:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95d68a6f4800:30797] 1 exiting: rc = 0 00000100:00100000:3.0:1788390938.959364:0:30796:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95d6a6867000:30796] 0 exiting: rc = 1 00000100:00100000:0.0:1788390938.960690:0:30800:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95d585f26a00:30800] 2 exiting: rc = 0 00000100:00100000:0.0:1788390938.961204:0:30798:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95d58719f000:30798] 0 exiting: rc = 1 00000100:00100000:0.0:1788390938.964796:0:30801:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95d68120a600:30801] 0 exiting: rc = 1 00000100:00100000:3.0:1788390938.964821:0:30802:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95d68385ea00:30802] 1 exiting: rc = 0 00000100:00100000:1.0:1788390938.965759:0:30803:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95d68385e000:30803] 0 exiting: rc = 1 00000100:00100000:0.0:1788390938.965759:0:30804:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95d68385e200:30804] 1 exiting: rc = 0 00000020:02000400:3.0:1788390938.972821:0:33336:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788390949.321859:0:33950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000100:00100000:0.0:1788390954.439181:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390954.439320:0:34412:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788390954.439325:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00010000:00010000:0.0:1788390954.442345:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.442350:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.442352:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.442587:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.442589:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.442590:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.447131:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788390954.455372:0:34422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788390954.455550:0:34412:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788390954.455655:0:34412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788390954.456156:0:34412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788390954.456399:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390954.456539:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788390954.456544:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788390954.456985:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788390954.456992:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788390954.457288:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788390954.457295:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788390954.459472:0:34412:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788390954.459491:0:34412:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:0.0:1788390954.459493:0:34412:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788390954.459514:0:34412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:0.0:1788390954.459524:0:34412:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff95d691318000) 00000020:00000080:0.0:1788390954.459534:0:34412:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788390954.459607:0:34412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d586121000@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788390954.459735:0:34412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:0.0:1788390954.459743:0:34412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788390954.461492:0:34427:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788390954.461563:0:34412:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid c069eaf9-b959-44c7-ac7c-ecadb48df3a5) 00000020:00000080:1.0:1788390954.461586:0:34412:0:(genops.c:1385:class_connect()) connect: client c069eaf9-b959-44c7-ac7c-ecadb48df3a5, cookie 0x9aafc5f04cd34e6a 00000100:00080000:1.0:1788390954.461599:0:34412:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788390954.461606:0:34412:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d586121000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390954.461638:0:34412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc7c8000 x1875263103377536/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788390954.461665:0:34412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS 00000020:01000004:1.0:1788390954.461698:0:34412:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788390954.461703:0:34412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788390954.461715:0:34412:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95d683d48000) 00000020:00000080:1.0:1788390954.461728:0:34412:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788390954.468233:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.468433:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390954.468440:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788390954.473950:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788390954.473981:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788390954.474293:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390954.474300:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788390954.474849:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390954.475034:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788390954.475038:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788390954.475310:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788390954.475316:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788390954.502460:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.502643:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788390954.502649:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788390954.504570:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788390954.504582:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788390954.505694:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.505856:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788390954.505861:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788390954.506539:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390954.506548:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788390954.507018:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.507154:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788390954.507159:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788390954.507914:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390954.507921:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788390954.511663:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.511839:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788390954.511845:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788390954.512340:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788390954.512350:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788390954.530895:0:34412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390954.531117:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390954.531124:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788390954.532484:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390954.532495:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788390954.533213:0:34412:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390954.533221:0:34412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788390954.533878:0:34412:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788390954.533900:0:34412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788390954.533906:0:34412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788390954.534305:0:34412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390954.534348:0:34412:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788390954.534353:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390954.534354:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390954.534356:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390954.534357:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390954.534359:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390954.534360:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390954.534361:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390954.534363:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390954.534365:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390954.534367:0:34412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390954.534374:0:34412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788390954.534376:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390954.534377:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390954.534378:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390954.534379:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390954.534380:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390954.534381:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390954.534382:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390954.534383:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390954.534384:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390954.534385:0:34412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390954.534409:0:34412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788390954.534427:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390954.534500:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390954.534547:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103377664 00000100:00100000:0.0:1788390954.534548:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390954.534555:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103377664 00000100:00100000:1.0:1788390954.534602:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390954.534613:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+5:34412:x1875263103377664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390954.534657:0:34425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788390954.534660:0:34425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788390954.534664:0:34425:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788390954.535123:0:34446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788390954.535432:0:34425:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 14 20000000:01000000:1.0:1788390954.538645:0:34447:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788390954.538652:0:34447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788390954.538655:0:34447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788390954.538706:0:34447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788390954.539030:0:34425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788390954.539040:0:34425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788390954.543031:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+5:34412:x1875263103377664:12345-0@lo:253:mount.lustre.0 Request processed in 8411us (8522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390954.543047:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390954.543048:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:0.0:1788390954.543069:0:34412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788390954.543071:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390954.543073:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788390954.543074:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390954.543075:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390954.543076:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390954.543077:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390954.543078:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788390954.543080:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788390954.543081:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390954.543082:0:34412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390954.543104:0:34412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d586120800 from lustre-MDT0000 10000000:01000000:0.0:1788390954.543138:0:34412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788390954.543141:0:34412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788390954.543145:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d691318000 10000000:01000000:0.0:1788390954.543149:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390954.543157:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d691318000 from 1 10000000:01000000:0.0:1788390954.543160:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788390954.543198:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.543220:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.543230:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.543249:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390954.543276:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.543318:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390954.543383:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103377792 00000100:00100000:1.0:1788390954.543390:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103377792 00000100:00100000:1.0:1788390954.543441:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390954.543448:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68646ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+5:34412:x1875263103377792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390954.543458:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390954.543469:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34e86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34e7f expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.543490:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34e7f expref: 6 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.543500:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34e7f expref: 6 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.543509:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788390954.543552:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68646ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+6:34412:x1875263103377792:12345-0@lo:101:mount.lustre.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390954.543558:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390954.543562:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390954.543584:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.543593:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.543635:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390954.543660:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.543687:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.543718:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103377920 00000100:00100000:3.0:1788390954.543723:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103377920 00000100:00100000:3.0:1788390954.543755:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390954.543763:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+6:34412:x1875263103377920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.543996:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+6:34412:x1875263103377920:12345-0@lo:501:mount.lustre.0 Request processed in 234us (334us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788390954.544009:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390954.544149:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103377920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788390954.544173:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788390954.544189:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544198:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390954.544217:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d586120800 10000000:01000000:0.0:1788390954.544221:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788390954.544225:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d586120800 10000000:01000000:0.0:1788390954.544227:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788390954.544230:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d586120800 from 1 10000000:01000000:0.0:1788390954.544232:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788390954.544249:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544256:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544263:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.544274:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390954.544296:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.544318:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390954.544572:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390954.544588:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544596:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390954.544607:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788390954.544617:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544635:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390954.544643:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788390954.544646:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788390954.544651:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d586120800 10000000:01000000:0.0:1788390954.544655:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788390954.544658:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788390954.544660:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788390954.544687:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544694:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.544702:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.544714:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390954.544739:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.544764:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.544814:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103378176 00000100:00100000:3.0:1788390954.544818:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103378176 00000100:00100000:3.0:1788390954.544847:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390954.544853:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+7:34412:x1875263103378176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.544865:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390954.544874:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1a00/0x9aafc5f04cd34ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34e9b expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.544886:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1a00/0x9aafc5f04cd34ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34e9b expref: 8 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.544895:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1a00/0x9aafc5f04cd34ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34e9b expref: 8 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.544902:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1a00, rc 0) 00000100:00100000:3.0:1788390954.544935:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+8:34412:x1875263103378176:12345-0@lo:101:mount.lustre.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.544941:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390954.545068:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390954.545078:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.545085:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.545131:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390954.545154:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.545179:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390954.545952:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390954.546022:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390954.546063:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.546094:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390954.546138:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103378432 00000100:00100000:1.0:1788390954.546142:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103378432 00000100:00100000:1.0:1788390954.546171:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390954.546177:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34412:x1875263103378432:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390954.546537:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34412:x1875263103378432:12345-0@lo:503:mount.lustre.0 Request processed in 359us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390954.546544:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390954.546628:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103378432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390954.547086:0:34448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34448:1875263103378560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390954.547124:0:34448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.547153:0:34448:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.547170:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103378560 00000100:00100000:3.0:1788390954.547176:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103378560 00000100:00100000:3.0:1788390954.547248:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788390954.547258:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34448:x1875263103378560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390954.547498:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34448:x1875263103378560:12345-0@lo:502:llog_process_th.0 Request processed in 242us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.547506:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390954.547535:0:34448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34448:1875263103378560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788390954.547557:0:34448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390954.547568:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390954.547571:0:34448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788390954.547576:0:34448:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788390954.547578:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390954.547592:0:34448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95d69131cd28) 00000020:00000080:0.0:1788390954.547610:0:34448:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788390954.547615:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788390954.547683:0:34448:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788390954.547690:0:34448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd34eb0 00000020:00000080:0.0:1788390954.547900:0:34448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788390954.547904:0:34448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390954.547908:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390954.547915:0:34448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788390954.547918:0:34448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390954.547921:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390954.547923:0:34448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788390954.547926:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788390954.547933:0:34448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95d69131b370) 00000020:00000080:0.0:1788390954.547942:0:34448:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788390954.547946:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788390954.547948:0:34448:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788390954.547951:0:34448:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788390954.547956:0:34448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788390954.548033:0:34448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d586120800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788390954.548046:0:34448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95d6913199b8) 00000020:00000080:0.0:1788390954.548056:0:34448:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788390954.548093:0:34448:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788390954.548100:0:34448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd34ec5 00000020:00000080:0.0:1788390954.548186:0:34448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788390954.548192:0:34448:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788390954.548196:0:34448:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aafc5f04cd34ecc 00080000:01000000:0.0:1788390954.548200:0:34448:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788390954.548205:0:34448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd34ed3 00010000:00010000:1.0:1788390954.596652:0:34448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788390954.597264:0:34448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 17179869274 00000001:00080000:1.0:1788390954.597590:0:34448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788390954.598206:0:34448:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95d683d4b370) 00000020:00000080:1.0:1788390954.598224:0:34448:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788390954.598294:0:34448:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788390954.598301:0:34448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd34ee1 00000100:00100000:1.0:1788390954.609635:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103378688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788390954.609698:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103378688 offset 0 length 520: 4 00000040:00080000:1.0:1788390954.614226:0:34454:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788390954.614231:0:34454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788390954.615299:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103378816:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788390954.615409:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103378816 offset 0 length 520: 4 00000100:00100000:3.0:1788390954.615775:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103378944 00000100:00100000:3.0:1788390954.615782:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103378944 00000100:00100000:3.0:1788390954.615821:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788390954.615830:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34448:x1875263103378944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390954.616069:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34448:x1875263103378944:12345-0@lo:502:llog_process_th.0 Request processed in 239us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.616085:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1788390954.616343:0:34412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788390954.616361:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788390954.616381:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616391:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390954.616398:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586120800 from 1 10000000:01000000:3.0:1788390954.616401:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390954.616427:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616435:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616443:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.616456:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390954.616484:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.616507:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.616526:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379072 00000100:00100000:3.0:1788390954.616529:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379072 00000100:00100000:3.0:1788390954.616551:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390954.616557:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+9:34412:x1875263103379072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.616565:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390954.616581:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f19 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616601:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 10 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616611:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 10 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616620:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788390954.616647:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+10:34412:x1875263103379072:12345-0@lo:101:mount.lustre.0 Request processed in 90us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.616653:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390954.616691:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.616702:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.616711:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.617214:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379200:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788390954.617248:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.617266:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.617280:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379200 00000100:00100000:3.0:1788390954.617284:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379200 00000100:00100000:3.0:1788390954.617309:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390954.617316:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+10:34412:x1875263103379200:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788390954.617327:0:34424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788390954.617357:0:34424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788390954.617413:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+10:34412:x1875263103379200:12345-0@lo:256:mount.lustre.0 Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.617420:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390954.617450:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379200:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788390954.617981:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390954.617988:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.617997:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390954.618004:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586120800 from 1 10000000:01000000:3.0:1788390954.618006:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390954.618024:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618030:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618037:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.618049:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390954.618075:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.618095:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.618108:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379328 00000100:00100000:3.0:1788390954.618112:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379328 00000100:00100000:3.0:1788390954.618129:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390954.618134:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+10:34412:x1875263103379328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.618148:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390954.618158:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f27 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618172:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618179:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618187:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0e00, rc 0) 00000100:00100000:3.0:1788390954.618214:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379328:12345-0@lo:101:mount.lustre.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.618220:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788390954.618246:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.618255:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.618262:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.618298:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.618318:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.618331:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.618342:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379456 00000100:00100000:3.0:1788390954.618345:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379456 00000100:00100000:3.0:1788390954.618361:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390954.618366:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6885f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.618683:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6885f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379456:12345-0@lo:501:mount.lustre.0 Request processed in 315us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.618689:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390954.618714:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.618733:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390954.618760:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.618770:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.618779:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379584 00000100:00100000:3.0:1788390954.618782:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379584 00000100:00100000:3.0:1788390954.618795:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390954.618799:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68643f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390954.618910:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68643f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379584:12345-0@lo:503:mount.lustre.0 Request processed in 109us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.618916:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390954.618947:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390954.619631:0:34456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34456:1875263103379712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788390954.619664:0:34456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390954.619728:0:34456:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.619756:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379712 00000100:00100000:3.0:1788390954.619760:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379712 00000100:00100000:3.0:1788390954.619814:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788390954.619820:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68643e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34456:x1875263103379712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390954.620082:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68643e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34456:x1875263103379712:12345-0@lo:502:llog_process_th.0 Request processed in 261us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.620089:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390954.620260:0:34456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34456:1875263103379712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390954.620282:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390954.620290:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.620292:0:34456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390954.620298:0:34456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d586120800 00000020:00000080:1.0:1788390954.620301:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390954.620308:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390954.620311:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.620312:0:34456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390954.620314:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390954.620316:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.620317:0:34456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390954.620320:0:34456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d586120800 00000020:00000080:1.0:1788390954.620322:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390954.620475:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390954.620479:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.620481:0:34456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390954.620483:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390954.620486:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.620488:0:34456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390954.620492:0:34456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d586120800 00000020:00000080:1.0:1788390954.620494:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788390954.622469:0:34456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34456:1875263103379840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390954.622536:0:34456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390954.622578:0:34456:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390954.623045:0:34456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34456:1875263103379840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788390954.623069:0:34456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390954.623075:0:34456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390954.623077:0:34456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390954.623080:0:34456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788390954.629018:0:34412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390954.629051:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390954.629067:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629086:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390954.629133:0:34412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390954.629136:0:34412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d586120800 10000000:01000000:3.0:1788390954.629139:0:34412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d586120800 10000000:01000000:3.0:1788390954.629143:0:34412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390954.629148:0:34412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d586120800 from 1 10000000:01000000:3.0:1788390954.629150:0:34412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390954.629183:0:34412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629190:0:34412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629201:0:34412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.629224:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390954.629286:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.629323:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.629485:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103379968 00000100:00100000:3.0:1788390954.629492:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103379968 00000100:00100000:3.0:1788390954.629532:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390954.629540:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103379968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.629551:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390954.629563:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd34f3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f35 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629591:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd34f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f35 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629601:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd34f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f35 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.629610:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788390954.629644:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103379968:12345-0@lo:101:mount.lustre.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.629650:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390954.630453:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103379968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390954.630471:0:34412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.630480:0:34412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390954.630536:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.630570:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.630599:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.630616:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380096 00000100:00100000:3.0:1788390954.630620:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380096 00000100:00100000:3.0:1788390954.630643:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390954.630650:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103380096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.630905:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103380096:12345-0@lo:501:mount.lustre.0 Request processed in 254us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.630920:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788390954.630985:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390954.631010:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390954.631045:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.631064:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.631086:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380224 00000100:00100000:3.0:1788390954.631090:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380224 00000100:00100000:3.0:1788390954.631111:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390954.631117:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103380224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390954.631244:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103380224:12345-0@lo:503:mount.lustre.0 Request processed in 127us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.631251:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788390954.631287:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390954.632168:0:34461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34461:1875263103380352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788390954.632210:0:34461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390954.632267:0:34461:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788390954.632296:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380352 00000100:00100000:3.0:1788390954.632301:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380352 00000100:00100000:3.0:1788390954.632415:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390954.632423:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34461:x1875263103380352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788390954.632599:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34461:x1875263103380352:12345-0@lo:502:llog_process_th.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390954.632606:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788390954.637716:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380480 00000100:00100000:3.0:1788390954.637723:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380480 00000100:00100000:3.0:1788390954.637758:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390954.637766:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103380480:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788390954.637827:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103380480:12345-0@lo:38:llog_process_th.0 Request processed in 60us (428us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788390954.637834:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390954.637868:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788390954.637876:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b2b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788390954.637879:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788390954.637883:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103380480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788390954.638784:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34461:x1875263103380608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788390954.639016:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34461:x1875263103380608:12345-0@lo:502:llog_process_th.0 Request processed in 232us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390954.639024:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788390954.639130:0:34461:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788390954.639146:0:34461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34461:1875263103380608:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788390954.639167:0:34461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788390954.639226:0:34412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788390954.639245:0:34412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390954.639258:0:34412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390954.639268:0:34412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788390954.639310:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788390954.639313:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390954.639314:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390954.639315:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390954.639316:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390954.639317:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390954.639319:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390954.639320:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390954.639322:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390954.639323:0:34412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390954.639336:0:34412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788390954.639338:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390954.639340:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390954.639341:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390954.639342:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390954.639343:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390954.639344:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390954.639350:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390954.639351:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390954.639352:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390954.639353:0:34412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390954.639367:0:34412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788390954.639375:0:34412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390954.639405:0:34412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390954.639431:0:34412:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788390954.639440:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380736 00000100:00100000:2.0:1788390954.639444:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380736 00000100:00100000:2.0:1788390954.639465:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788390954.639484:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34412:x1875263103380736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390954.639509:0:34424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390954.639520:0:34424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788390954.659050:0:34424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390954.659144:0:34424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788390954.659183:0:34446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788390954.659188:0:34446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788390954.659209:0:34446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.659227:0:34446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 12 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.659236:0:34446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.659273:0:34446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 12 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.659287:0:34446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 12 pid: 34425 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390954.659301:0:34446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103380864:0@lo:104: 00000100:00100000:1.0:1788390954.659693:0:34446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390954.659730:0:34446:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390954.659755:0:34413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380864 00000100:00100000:0.0:1788390954.659763:0:34413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380864 00000100:00100000:0.0:1788390954.659845:0:34413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390954.659855:0:34413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103380864:12345-0@lo:104: 00010000:00010000:0.0:1788390954.659868:0:34413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.659929:0:34413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390954.659936:0:34413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103380864:12345-0@lo:104: Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390954.659943:0:34413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788390954.660019:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390954.660024:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.660032:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390954.660036:0:34419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.660045:0:34419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390954.660052:0:34419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390954.660107:0:34446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103380864:0@lo:104: 00010000:00010000:1.0:1788390954.660126:0:34446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390954.660127:0:34419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390954.660193:0:34419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.660201:0:34419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390954.660220:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.660227:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd34f19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f20 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390954.660278:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.660280:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390954.660282:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390954.660298:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390954.660316:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103380992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390954.660462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390954.660558:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103380992 00000100:00100000:2.0:1788390954.660572:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103380992 00010000:00010000:2.0:1788390954.660592:0:34415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 13 pid: 34425 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390954.660648:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390954.660656:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+13:3286:x1875263103380992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390954.660677:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390954.660683:0:34415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 13 pid: 34425 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660693:0:34415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 13 pid: 34425 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660705:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd34f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34f19 expref: 13 pid: 34425 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660733:0:34415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660740:0:34415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390954.660752:0:34415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001565057s 00010000:00010000:2.0:1788390954.660757:0:34415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660763:0:34415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660770:0:34415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660776:0:34415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660782:0:34415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390954.660786:0:34415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660793:0:34415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660810:0:34415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390954.660820:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390954.660863:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:3286:x1875263103380992:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390954.660871:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788390954.660918:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103380992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390954.661002:0:34446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.661011:0:34446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390954.661017:0:34446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390954.664630:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34412:x1875263103380736:12345-0@lo:253:mount.lustre.0 Request processed in 25138us (25215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390954.664650:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390954.664658:0:34412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34412:1875263103380736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390954.664683:0:34412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788390954.664686:0:34412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390954.664688:0:34412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788390954.664689:0:34412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390954.664690:0:34412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390954.664692:0:34412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390954.664693:0:34412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390954.664695:0:34412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788390954.664696:0:34412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788390954.664698:0:34412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390954.664700:0:34412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788390954.664713:0:34412:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390954.668893:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390954.669142:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390954.669322:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390954.669462:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390954.669655:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390954.669762:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390954.670278:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390954.670413:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390954.670583:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390954.670790:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788390954.670953:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788390954.671105:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788390954.686450:0:34412:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 12884902008 00000040:01000000:0.0:1788390954.686868:0:34412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788390954.686929:0:34467:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 12884902008 00000020:00080000:1.0:1788390954.686933:0:34467:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00000040:01000000:1.0:1788390954.687265:0:34468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788390954.687896:0:34468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788390954.691127:0:34412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788390954.691214:0:34412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788390954.691524:0:34412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788390954.691528:0:34412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788390954.691593:0:34412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390954.693023:0:34468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788390954.693091:0:34468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788390954.693096:0:34468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788390954.693757:0:34412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788390954.694325:0:34412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788390954.694347:0:34412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788390954.694686:0:34412:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 3, last_idx 4 00080000:10000000:2.0:1788390954.695742:0:34412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000001:00000004:2.0:1788390954.700660:0:34412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000001:00080000:0.0:1788390954.723321:0:34412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788390954.723351:0:34412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba85818b7988 00100000:10000000:0.0:1788390954.723357:0:34412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788390954.723689:0:34412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788390954.723704:0:34412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788390954.723717:0:34412:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788390954.723736:0:34412:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788390955.469186:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390955.662868:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788390955.662876:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390955.663878:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:0.0:1788390955.663887:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 10000000:01000000:3.0:1788390955.665803:0:34427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390955.665813:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586120800 from 15 10000000:01000000:3.0:1788390955.665820:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390955.665873:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390955.665893:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390955.665906:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390955.665934:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390955.666111:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390955.666163:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390955.666428:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381120 00000100:00100000:0.0:1788390955.666437:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381120 00000100:00100000:0.0:1788390955.666492:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788390955.666504:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34427:x1875263103381120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390955.666535:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390955.666552:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f58 expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390955.666577:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390955.666588:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390955.666598:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:0.0:1788390955.666651:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103381120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390955.666667:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390955.666837:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390955.666853:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390955.666862:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390955.666913:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390955.666949:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390955.666997:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381248 00000100:00100000:0.0:1788390955.667002:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381248 00000100:00100000:3.0:1788390955.667011:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065780 going to sleep for 11 seconds 00000100:00100000:0.0:1788390955.667043:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788390955.667051:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103381248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390955.667073:0:34424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390955.667088:0:34424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390955.667091:0:34424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 15 00000100:00100000:0.0:1788390955.667171:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103381248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390955.667178:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390955.667189:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390955.667229:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390955.667236:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390955.667245:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390956.494133:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390956.685242:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788390956.685251:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390956.685279:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:0.0:1788390956.685284:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000001:02000400:2.0:1788390957.128871:0:34711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788390957.517912:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390958.542798:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788390958.971334:0:34862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb16c9ae0 20000000:00000080:1.0:1788390958.971353:0:34862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d5872ca800 uarg=0000000000000000 20000000:01000000:1.0:1788390958.971386:0:34862:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788390958.971394:0:34862:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788390958.971439:0:34862:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788390958.972205:0:34863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788390958.972364:0:34862:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788390958.978278:0:34862:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788390958.978433:0:34862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390958.978452:0:34862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390958.978460:0:34862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390958.978506:0:34862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390958.978520:0:34862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 11 pid: 34424 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390958.978536:0:34862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:34862:1875263103381376:0@lo:104: 00000100:00100000:1.0:1788390958.978617:0:34862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390958.978678:0:34862:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046240 going to sleep for 11 seconds 00000100:00100000:2.0:1788390958.978690:0:34414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381376 00000100:00100000:2.0:1788390958.978699:0:34414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381376 00000100:00100000:2.0:1788390958.978792:0:34414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390958.978802:0:34414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34862:x1875263103381376:12345-0@lo:104: 00010000:00010000:2.0:1788390958.978815:0:34414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390958.978880:0:34414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788390958.978886:0:34414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34862:x1875263103381376:12345-0@lo:104: Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390958.978892:0:34414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390958.978892:0:34862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:34862:1875263103381376:0@lo:104: 00010000:00010000:3.0:1788390958.978948:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390958.978954:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.978978:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390958.978982:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.978991:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390958.978998:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390958.978998:0:34862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390958.979005:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788390958.979031:0:34418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979037:0:34418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390958.979061:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979068:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34f27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f2e expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390958.979083:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103381504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390958.979089:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390958.979090:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390958.979092:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390958.979110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390958.979414:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381504 00000100:00100000:3.0:1788390958.979420:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381504 00010000:00010000:3.0:1788390958.979438:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 12 pid: 34424 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390958.979458:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390958.979464:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:3288:x1875263103381504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390958.979473:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390958.979477:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 12 pid: 34424 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979487:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 12 pid: 34424 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979499:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0e00/0x9aafc5f04cd34f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34f27 expref: 12 pid: 34424 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979510:0:34417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979517:0:34417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979528:0:34417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979535:0:34417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979542:0:34417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979558:0:34417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979563:0:34417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390958.979567:0:34417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979574:0:34417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979586:0:34417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979596:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390958.979639:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:3288:x1875263103381504:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390958.979646:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390958.979673:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103381504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390958.979870:0:34862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979877:0:34862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390958.979883:0:34862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34f66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390959.565275:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390960.077734:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103381632:0@lo:400:kworker.0 00000100:00100000:3.0:1788390960.077821:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788390960.078114:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390960.078120:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390960.078123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390960.078126:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390960.078134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788390960.078138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788390960.078141:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d682b2b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788390960.078150:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d682b2b800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788390960.078174:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc7c9f80 x1875263103381760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390960.078251:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381632 00000100:00100000:1.0:1788390960.078259:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381632 00000100:00100000:1.0:1788390960.078305:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788390960.078314:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:3289:x1875263103381632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390960.079387:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:3289:x1875263103381632:12345-0@lo:400:kworker.0 Request processed in 1069us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390960.079399:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390960.079671:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103381760:0@lo:38:kworker.0 00000100:00100000:2.0:1788390960.079720:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390960.079822:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381760 00000100:00100000:1.0:1788390960.079828:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381760 00000100:00100000:1.0:1788390960.079861:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788390960.079869:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103381760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788390960.079895:0:34432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 777 last 0 00000020:00000080:1.0:1788390960.079931:0:34432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aafc5f04cd34f6d 00000004:00100000:1.0:1788390960.079946:0:34432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390960.080106:0:34432:0:(import.c:65:import_set_state_nolock()) ffff95d585013000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390960.080157:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103381760:12345-0@lo:38:kworker.0 Request processed in 287us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390960.080164:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788390960.080256:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bc7c9f80 x1875263103381760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788390960.080272:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:2.0:1788390960.080279:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788390960.080284:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788390960.080286:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b2b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788390960.080291:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103381760:0@lo:38:kworker.0 00000100:00100000:3.0:1788390960.082739:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103381632:0@lo:400:kworker.0 10000000:01000000:3.0:1788390960.205072:0:34427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788390960.205081:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586120800 from 10 10000000:01000000:3.0:1788390960.205087:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788390960.205142:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.205155:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.205178:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390960.205204:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390960.205289:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390960.205390:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390960.205928:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103381888 00000100:00100000:2.0:1788390960.205938:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103381888 00000100:00100000:3.0:1788390960.206085:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788390960.206095:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+11:34427:x1875263103381888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390960.206109:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390960.206124:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f74 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.206149:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.206159:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.206199:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788390960.206258:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103381888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390960.206265:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788390960.206293:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103381888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788390960.206310:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390960.206328:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390960.206388:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103382016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390960.206419:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390960.206499:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390960.206737:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382016 00000100:00100000:1.0:1788390960.206742:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382016 00000100:00100000:1.0:1788390960.206778:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788390960.206784:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103382016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390960.207346:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103382016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 560us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390960.207353:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788390960.207516:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103382016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788390960.207672:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103382144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390960.207715:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390960.207800:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1788390960.208162:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382144 00000100:00100000:3.0:1788390960.208169:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382144 00000100:00100000:3.0:1788390960.208242:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788390960.208251:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103382144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390960.208424:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:34427:x1875263103382144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390960.208431:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788390960.208505:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103382144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788390960.211894:0:34941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788390960.212188:0:34427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390960.212207:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390960.212219:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390960.212231:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390960.589833:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390961.613690:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788390961.900910:0:35111:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788390961.900914:0:35111:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788390961.901109:0:35111:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d585015800 00000020:01000004:1.0:1788390961.901124:0:35111:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788390961.901135:0:35111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788390961.901152:0:35111:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d683d4cd28) 00000020:00000080:1.0:1788390961.901167:0:35111:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788390961.915667:0:35111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788390961.916217:0:35111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788390961.917159:0:35111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788390961.917387:0:35111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788390961.917599:0:35111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:1.0:1788390961.919142:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 657: rc = 0 00100000:10000000:1.0:1788390961.919248:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 657: rc = 0 00100000:10000000:1.0:1788390961.919344:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 657: rc = 0 00100000:10000000:1.0:1788390961.919950:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390961.920266:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 571: rc = 0 00100000:10000000:1.0:1788390961.920521:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390961.920889:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 571: rc = 0 00100000:10000000:1.0:1788390961.921239:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788390961.922274:0:35111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 571: rc = 0 00000020:00000080:1.0:1788390961.923196:0:35111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788390961.923205:0:35111:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788390961.923215:0:35111:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd34f89 00000020:01000004:1.0:1788390961.923222:0:35111:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788390961.923237:0:35111:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788390961.923241:0:35111:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788390961.923247:0:35111:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788390961.923252:0:35111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788390961.923265:0:35111:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d683d499b8) 00000020:00000080:1.0:1788390961.923279:0:35111:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788390961.924501:0:35111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390961.924708:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788390961.924715:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788390961.925380:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788390961.925387:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788390961.925849:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788390961.925856:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788390961.928447:0:35111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788390961.928639:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788390961.928646:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788390961.931300:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788390961.931311:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788390961.947780:0:35111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788390961.948041:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788390961.948049:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788390961.950376:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788390961.950388:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788390961.956499:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788390961.956516:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788390961.958212:0:35111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788390961.958388:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788390961.958393:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788390961.959107:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788390961.959115:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788390961.992394:0:35111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788390961.992612:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788390961.992620:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788390961.994097:0:35111:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788390961.994107:0:35111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788390961.994704:0:35111:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788390961.994729:0:35111:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788390961.994735:0:35111:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788390962.003094:0:35111:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788390962.003132:0:35111:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788390962.003136:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788390962.003138:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390962.003139:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390962.003140:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390962.003142:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390962.003143:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390962.003144:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390962.003146:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390962.003147:0:35111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390962.003150:0:35111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788390962.003152:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788390962.003153:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390962.003154:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390962.003155:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390962.003156:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390962.003157:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390962.003158:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390962.003159:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390962.003160:0:35111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788390962.003185:0:35111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788390962.003205:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788390962.003287:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.003390:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.003468:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382272 00000100:00100000:1.0:1788390962.003475:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382272 00000100:00100000:1.0:1788390962.003556:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788390962.003573:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:35111:x1875263103382272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390962.003620:0:34423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788390962.003623:0:34423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788390962.003627:0:34423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788390962.010482:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:35111:x1875263103382272:12345-0@lo:253:mount.lustre.0 Request processed in 6902us (7186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.010497:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788390962.010619:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788390962.010647:0:35111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788390962.010651:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788390962.010653:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788390962.010654:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788390962.010655:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788390962.010656:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788390962.010657:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788390962.010659:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788390962.010661:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788390962.010662:0:35111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788390962.010682:0:35111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d585015800 from lustre-OST0000 10000000:01000000:0.0:1788390962.010705:0:35111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788390962.010708:0:35111:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788390962.010715:0:35111:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d691318000 local copy 00010000:00010000:0.0:1788390962.010725:0:35111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390962.010951:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390962.011011:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.011043:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574180 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.011201:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382400 00000100:00100000:1.0:1788390962.011207:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382400 00000100:00100000:1.0:1788390962.011248:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788390962.011257:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:35111:x1875263103382400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.011421:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:35111:x1875263103382400:12345-0@lo:501:mount.lustre.0 Request processed in 164us (408us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390962.011429:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788390962.011516:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382400:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788390962.011532:0:35111:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788390962.011696:0:35111:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788390962.011703:0:35111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.011712:0:35111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390962.011732:0:35111:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d585015800 10000000:01000000:2.0:1788390962.011737:0:35111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788390962.011741:0:35111:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d691318000 10000000:01000000:2.0:1788390962.011744:0:35111:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788390962.011748:0:35111:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d691318000 from 1 10000000:01000000:2.0:1788390962.011751:0:35111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788390962.011775:0:35111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.011783:0:35111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.011804:0:35111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390962.011818:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390962.011955:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390962.012008:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390962.012065:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382528 00000100:00100000:0.0:1788390962.012069:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382528 00000100:00100000:0.0:1788390962.012143:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788390962.012152:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+12:35111:x1875263103382528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390962.012162:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390962.012174:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd34f9e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34f97 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012195:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd34f9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f97 expref: 13 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012206:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd34f9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f97 expref: 13 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012222:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:0.0:1788390962.012256:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+13:35111:x1875263103382528:12345-0@lo:101:mount.lustre.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.012262:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788390962.012393:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390962.012406:0:35111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.012414:0:35111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390962.012429:0:35111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788390962.012517:0:35111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.012525:0:35111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390962.012532:0:35111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788390962.012535:0:35111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788390962.012540:0:35111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788390962.012542:0:35111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788390962.012556:0:35111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.012564:0:35111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.012577:0:35111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390962.012590:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788390962.012625:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390962.012648:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788390962.012743:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382656 00000100:00100000:0.0:1788390962.012748:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382656 00000100:00100000:0.0:1788390962.012780:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788390962.012788:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+13:35111:x1875263103382656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390962.012796:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390962.012804:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd34fac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34fa5 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012817:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd34fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fa5 expref: 14 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012825:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd34fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fa5 expref: 14 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.012832:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:0.0:1788390962.012870:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103382656:12345-0@lo:101:mount.lustre.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.012876:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788390962.013043:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390962.013054:0:35111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.013062:0:35111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390962.013774:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000040:00080000:2.0:1788390962.014903:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390962.015244:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:2.0:1788390962.015292:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:2.0:1788390962.015329:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:2.0:1788390962.015392:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:2.0:1788390962.015433:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:2.0:1788390962.015470:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:2.0:1788390962.015532:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:2.0:1788390962.015571:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:2.0:1788390962.015618:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 80 off9712 00000040:00080000:2.0:1788390962.015670:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9936 00000040:00080000:2.0:1788390962.015710:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10160 00000040:00080000:2.0:1788390962.015760:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 120 off10280 00000040:00080000:2.0:1788390962.015822:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 224 off10504 00000040:00080000:2.0:1788390962.015906:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 14 00000100:00100000:2.0:1788390962.016017:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390962.016077:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390962.016124:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.016256:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382784 00000100:00100000:1.0:1788390962.016263:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382784 00000100:00100000:1.0:1788390962.016311:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788390962.016322:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103382784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.016662:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103382784:12345-0@lo:501:mount.lustre.0 Request processed in 341us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.016669:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788390962.016809:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390962.016916:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390962.016985:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390962.017002:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6812edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390962.017077:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103382912 00000100:00100000:2.0:1788390962.017082:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103382912 00000100:00100000:2.0:1788390962.017106:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788390962.017113:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103382912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390962.017401:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103382912:12345-0@lo:503:mount.lustre.0 Request processed in 288us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390962.017409:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788390962.017534:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103382912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390962.018238:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390962.018301:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390962.018346:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390962.018381:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6812edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390962.018466:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383040 00000100:00100000:2.0:1788390962.018471:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383040 00000100:00100000:2.0:1788390962.018498:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788390962.018617:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103383040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390962.018802:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103383040:12345-0@lo:502:mount.lustre.0 Request processed in 188us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390962.018809:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788390962.019064:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390962.019267:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788390962.019327:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:3.0:1788390962.019359:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:3.0:1788390962.019406:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:3.0:1788390962.019441:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:3.0:1788390962.019472:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:3.0:1788390962.019589:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:3.0:1788390962.019642:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:3.0:1788390962.019677:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 80 off9712 00000040:00080000:3.0:1788390962.019726:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9936 00000040:00080000:3.0:1788390962.019762:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10160 00000040:00080000:3.0:1788390962.019810:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 120 off10280 00000100:00100000:3.0:1788390962.019907:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390962.019956:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390962.020184:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6812edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.020228:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383168 00000100:00100000:1.0:1788390962.020234:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383168 00000100:00100000:1.0:1788390962.020308:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788390962.020318:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103383168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390962.020491:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103383168:12345-0@lo:502:mount.lustre.0 Request processed in 175us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.020516:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788390962.020591:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390962.020666:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 224 off10504 00000040:00080000:3.0:1788390962.020676:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788390962.021586:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788390962.021594:0:35125:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788390962.021609:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.021612:0:35125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788390962.021618:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788390962.021633:0:35125:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d6bc75cd28) 00000020:00000080:3.0:1788390962.021655:0:35125:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788390962.021661:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788390962.021750:0:35125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d585015800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788390962.021758:0:35125:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788390962.021768:0:35125:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd34fba 00010000:00010000:3.0:1788390962.028138:0:35125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788390962.028644:0:35125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 17179869195 00080000:10000000:3.0:1788390962.031060:0:35125:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:3.0:1788390962.032456:0:35125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788390962.032470:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390962.032476:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032478:0:35125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788390962.032481:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788390962.032484:0:35125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788390962.032486:0:35125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390962.032487:0:35125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788390962.032489:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788390962.032491:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032493:0:35125:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788390962.032495:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390962.032498:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032499:0:35125:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788390962.032574:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788390962.032578:0:35125:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788390962.032582:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390962.032586:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032587:0:35125:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788390962.032590:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788390962.032592:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032594:0:35125:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788390962.032597:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788390962.032665:0:35125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788390962.032668:0:35125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788390962.032670:0:35125:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788390962.032673:0:35125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000020:01000000:1.0:1788390962.034912:0:35111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788390962.034955:0:35111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788390962.034992:0:35111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.035006:0:35111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390962.035014:0:35111:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d585015800 from 1 10000000:01000000:1.0:1788390962.035016:0:35111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390962.035053:0:35111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.035062:0:35111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.035073:0:35111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390962.035096:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390962.035163:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.035202:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390962.038074:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383296 00000100:00100000:2.0:1788390962.038088:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383296 00000100:00100000:2.0:1788390962.038189:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788390962.038201:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:35111:x1875263103383296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390962.038217:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390962.038233:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34fc1 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.038264:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 15 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.038284:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 15 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.038294:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788390962.038373:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383296:12345-0@lo:101:mount.lustre.0 Request processed in 174us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390962.038380:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788390962.038458:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788390962.038477:0:35111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.038486:0:35111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788390962.039076:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:0.0:1788390962.039418:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788390962.039653:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1788390962.039698:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1788390962.039749:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1788390962.039788:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1788390962.039849:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1788390962.039900:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1788390962.039939:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:0.0:1788390962.039997:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:0.0:1788390962.040068:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:0.0:1788390962.040077:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:0.0:1788390962.040153:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390962.040212:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.043351:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.043432:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383424 00000100:00100000:1.0:1788390962.043441:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383424 00000100:00100000:1.0:1788390962.043483:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788390962.043494:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.043908:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383424:12345-0@lo:501:mount.lustre.0 Request processed in 414us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.043923:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788390962.044155:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390962.044204:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383552:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390962.044250:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.044264:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.044316:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383552 00000100:00100000:1.0:1788390962.044320:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383552 00000100:00100000:1.0:1788390962.044341:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390962.044347:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390962.044502:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383552:12345-0@lo:503:mount.lustre.0 Request processed in 153us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.044597:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788390962.045163:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788390962.045228:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390962.045272:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.045294:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.045413:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788390962.045461:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383680 00000100:00100000:1.0:1788390962.045466:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383680 00000100:00100000:1.0:1788390962.045489:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788390962.045496:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390962.045734:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383680:12345-0@lo:502:mount.lustre.0 Request processed in 238us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.045740:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788390962.045956:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390962.046211:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788390962.046261:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788390962.046314:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788390962.046353:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788390962.046391:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788390962.046456:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788390962.046499:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788390962.046646:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:0.0:1788390962.046676:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390962.046718:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390962.046780:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788390962.046867:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383808 00000100:00100000:3.0:1788390962.046873:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383808 00000100:00100000:1.0:1788390962.047057:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788390962.047066:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390962.047243:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383808:12345-0@lo:502:mount.lustre.0 Request processed in 179us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.047251:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788390962.047387:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788390962.047476:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788390962.047487:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788390962.048415:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390962.048425:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048427:0:35129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788390962.048437:0:35129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d585015800 00000020:00000080:0.0:1788390962.048439:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390962.048446:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390962.048449:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048450:0:35129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788390962.048453:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390962.048455:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048457:0:35129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788390962.048460:0:35129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d585015800 00000020:00000080:0.0:1788390962.048462:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390962.048527:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390962.048531:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048532:0:35129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788390962.048537:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788390962.048545:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048546:0:35129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788390962.048552:0:35129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d585015800 00000020:00000080:0.0:1788390962.048554:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788390962.048588:0:35129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788390962.048592:0:35129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788390962.048593:0:35129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788390962.048598:0:35129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:1.0:1788390962.048773:0:35111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788390962.048795:0:35111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390962.048819:0:35111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.048830:0:35111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390962.048887:0:35111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788390962.048890:0:35111:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d585015800 10000000:01000000:1.0:1788390962.048893:0:35111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d585015800 10000000:01000000:1.0:1788390962.048897:0:35111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788390962.048901:0:35111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d585015800 from 1 10000000:01000000:1.0:1788390962.048904:0:35111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788390962.048931:0:35111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.048940:0:35111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.048950:0:35111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390962.048988:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788390962.049030:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.049233:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390962.052047:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103383936 00000100:00100000:2.0:1788390962.052060:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103383936 00000100:00100000:2.0:1788390962.052101:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788390962.052109:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103383936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390962.052123:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390962.052138:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f800/0x9aafc5f04cd34fd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34fcf expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.052162:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f800/0x9aafc5f04cd34fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fcf expref: 16 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.052172:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f800/0x9aafc5f04cd34fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fcf expref: 16 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.052182:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f800, rc 0) 00000100:00100000:2.0:1788390962.052245:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103383936:12345-0@lo:101:mount.lustre.0 Request processed in 137us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390962.052251:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788390962.052356:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103383936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390962.052372:0:35111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.052382:0:35111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788390962.059754:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:1.0:1788390962.060284:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788390962.065796:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1788390962.065901:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:1.0:1788390962.065939:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:1.0:1788390962.066008:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:1.0:1788390962.066049:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:1.0:1788390962.066102:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:1.0:1788390962.066141:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:1.0:1788390962.066177:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:1.0:1788390962.066226:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:1.0:1788390962.066264:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:1.0:1788390962.066300:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:1.0:1788390962.066351:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:1.0:1788390962.066389:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:1.0:1788390962.066441:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:1.0:1788390962.066495:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:1.0:1788390962.066533:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:1.0:1788390962.066569:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:1.0:1788390962.072687:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:1.0:1788390962.072770:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:1.0:1788390962.072796:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:1.0:1788390962.072834:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:1.0:1788390962.072861:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:1.0:1788390962.072886:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:1.0:1788390962.072920:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:1.0:1788390962.072947:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:1.0:1788390962.072989:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:1.0:1788390962.073032:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:1.0:1788390962.073062:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:1.0:1788390962.073090:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:1.0:1788390962.073173:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:1.0:1788390962.073214:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:1.0:1788390962.073267:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:1.0:1788390962.073306:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:1.0:1788390962.073357:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:1.0:1788390962.073407:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:1.0:1788390962.073459:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:1.0:1788390962.073497:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:1.0:1788390962.073550:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:1.0:1788390962.073597:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:1.0:1788390962.073648:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:1.0:1788390962.073751:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:1.0:1788390962.073759:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:1.0:1788390962.073868:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.073942:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.074021:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384064 00000100:00100000:1.0:1788390962.074028:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384064 00000100:00100000:1.0:1788390962.074068:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390962.074076:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.074276:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384064:12345-0@lo:501:mount.lustre.0 Request processed in 200us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.074284:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788390962.074329:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.074351:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390962.074381:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390962.074416:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.074440:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788390962.075032:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384192 00000100:00100000:1.0:1788390962.075038:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384192 00000100:00100000:1.0:1788390962.075068:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788390962.075076:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390962.075223:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384192:12345-0@lo:503:mount.lustre.0 Request processed in 147us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.075238:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788390962.075280:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788390962.077661:0:35111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788390962.077745:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390962.077818:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.078693:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390962.083647:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384320 00000100:00100000:0.0:1788390962.083663:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384320 00000100:00100000:0.0:1788390962.083725:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788390962.083735:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390962.084043:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384320:12345-0@lo:502:mount.lustre.0 Request processed in 308us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.084051:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788390962.084207:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390962.084490:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1788390962.084570:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:1.0:1788390962.084621:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:1.0:1788390962.084671:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:1.0:1788390962.084709:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:1.0:1788390962.084759:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:1.0:1788390962.084794:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:1.0:1788390962.084825:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:1.0:1788390962.084872:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:1.0:1788390962.084910:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:1.0:1788390962.084946:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:1.0:1788390962.085033:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:1.0:1788390962.085072:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:1.0:1788390962.085107:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:1.0:1788390962.085158:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:1.0:1788390962.085196:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:1.0:1788390962.085231:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:1.0:1788390962.085294:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:1.0:1788390962.085332:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:1.0:1788390962.085367:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:1.0:1788390962.085416:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:1.0:1788390962.085461:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:1.0:1788390962.085497:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:1.0:1788390962.085547:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:1.0:1788390962.085584:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:1.0:1788390962.085634:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:1.0:1788390962.085686:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:1.0:1788390962.085721:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:1.0:1788390962.085754:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:1.0:1788390962.085801:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:1.0:1788390962.085838:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:1.0:1788390962.085868:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:1.0:1788390962.085896:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:1.0:1788390962.085982:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:1.0:1788390962.086023:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:1.0:1788390962.086088:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:1.0:1788390962.086129:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:1.0:1788390962.086163:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:1.0:1788390962.086209:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:1.0:1788390962.086244:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:1.0:1788390962.086289:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390962.086362:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.086406:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788390962.086498:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384448 00000100:00100000:0.0:1788390962.086505:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384448 00000100:00100000:0.0:1788390962.086555:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788390962.086564:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390962.086790:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384448:12345-0@lo:502:mount.lustre.0 Request processed in 226us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.086798:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788390962.091729:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788390962.091893:0:35111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:1.0:1788390962.091909:0:35111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788390962.096192:0:35134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788390962.096214:0:35134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d6bc7599b8) 00000020:00000080:3.0:1788390962.096236:0:35134:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788390962.096320:0:35134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d585015800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390962.096324:0:35134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d585015800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788390962.096326:0:35134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d585015800 3 00010000:00080000:3.0:1788390962.096356:0:35134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d5872c1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788390962.099035:0:35134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788390962.099269:0:35134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788390962.099305:0:35134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788390962.099319:0:35134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd34fe4 00000100:00080000:3.0:1788390962.099331:0:35134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788390962.099337:0:35134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d5872c1000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390962.099374:0:35134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68f55e680 x1875263103384576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788390962.099410:0:35134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788390962.099476:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390962.099482:0:32887:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788390962.099484:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788390962.099487:0:32887:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788390962.099544:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103384704:0@lo:400:kworker.0 00000100:00100000:3.0:1788390962.099621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.099665:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384704 00000100:00100000:1.0:1788390962.099673:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384704 00000100:00100000:0.0:1788390962.099716:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103384576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788390962.099722:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390962.099732:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103384704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390962.099757:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.099800:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103384704:12345-0@lo:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.099809:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390962.099812:0:34430:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788390962.099822:0:34430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788390962.099824:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384576 00000100:00100000:1.0:1788390962.099828:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384576 00000100:00100000:1.0:1788390962.099838:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390962.099841:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103384576:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788390962.099858:0:34431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 779 last 0 00010000:00080000:3.0:1788390962.099885:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d6bc7caa00 x1875263103384704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788390962.099899:0:34431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd34feb 00000100:00100000:3.0:1788390962.099900:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103384704:0@lo:400:kworker.0 00000004:00100000:1.0:1788390962.099918:0:34431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788390962.099947:0:34431:0:(import.c:65:import_set_state_nolock()) ffff95d5864bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390962.100021:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103384576:12345-0@lo:38:llog_process_th.0 Request processed in 177us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390962.100026:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788390962.100034:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d68f55e680 x1875263103384576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390962.100058:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788390962.100065:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 5 00000100:00080000:0.0:1788390962.100071:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788390962.100076:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788390962.100078:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5872c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788390962.100084:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103384576:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788390962.100896:0:35134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000020:01000000:1.0:1788390962.100997:0:35111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788390962.101030:0:35111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788390962.101062:0:35111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.101074:0:35111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788390962.101133:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788390962.101141:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390962.101142:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390962.101144:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390962.101145:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390962.101147:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390962.101148:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390962.101150:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390962.101152:0:35111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390962.101155:0:35111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788390962.101158:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788390962.101159:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390962.101348:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390962.101350:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390962.101351:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390962.101352:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390962.101353:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390962.101354:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390962.101355:0:35111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788390962.101373:0:35111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788390962.101387:0:35111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788390962.101440:0:35111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.101478:0:35111:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788390962.101567:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384832 00000100:00100000:2.0:1788390962.101574:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384832 00000100:00100000:2.0:1788390962.101696:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788390962.101709:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35111:x1875263103384832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788390962.101734:0:34425:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788390962.101747:0:34425:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788390962.124908:0:34425:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788390962.124933:0:34425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788390962.125118:0:34446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788390962.125123:0:34446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788390962.125141:0:34446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.125157:0:34446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 16 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.125162:0:34446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.125197:0:34446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 16 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390962.125221:0:34446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 16 pid: 34423 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390962.125232:0:34446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103384960:0@lo:104: 00000100:00100000:1.0:1788390962.125288:0:34446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390962.125321:0:34446:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747000 going to sleep for 11 seconds 00000100:00100000:0.0:1788390962.126192:0:34413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103384960 00000100:00100000:0.0:1788390962.126203:0:34413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103384960 00000100:00100000:0.0:1788390962.126257:0:34413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788390962.126269:0:34413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103384960:12345-0@lo:104: 00010000:00010000:0.0:1788390962.126283:0:34413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390962.126357:0:34413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390962.126363:0:34413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103384960:12345-0@lo:104: Request processed in 98us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.126370:0:34413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788390962.126494:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390962.126502:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390962.126511:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390962.126515:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390962.126534:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390962.126542:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390962.126549:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788390962.126590:0:34418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390962.126597:0:34418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390962.126629:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390962.126636:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1c00/0x9aafc5f04cd34f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f5f expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390962.126656:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390962.126658:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390962.126660:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390962.126669:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390962.126677:0:34446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103384960:0@lo:104: 00000100:00100000:3.0:1788390962.126683:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103385088:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390962.126702:0:34446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390962.126722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390962.126751:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385088 00000100:00100000:2.0:1788390962.126755:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385088 00010000:00010000:2.0:1788390962.126771:0:34415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 17 pid: 34423 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390962.126804:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390962.126810:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:3286:x1875263103385088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390962.126818:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390962.126822:0:34415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 17 pid: 34423 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126829:0:34415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 17 pid: 34423 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126838:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92600/0x9aafc5f04cd34f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34f58 expref: 17 pid: 34423 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126848:0:34415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126863:0:34415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788390962.126872:0:34415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001749762s 00010000:00010000:2.0:1788390962.126875:0:34415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126879:0:34415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126883:0:34415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126887:0:34415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126890:0:34415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390962.126892:0:34415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126897:0:34415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126907:0:34415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.126913:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390962.126943:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3286:x1875263103385088:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390962.126947:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788390962.126996:0:34446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.127002:0:34446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390962.127006:0:34446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62c00/0x9aafc5f04cd34ff2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390962.127018:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103385088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390962.137646:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:35111:x1875263103384832:12345-0@lo:253:mount.lustre.0 Request processed in 35930us (36193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390962.137665:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788390962.137699:0:35111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35111:1875263103384832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788390962.137717:0:35111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788390962.137721:0:35111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788390962.137723:0:35111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788390962.137725:0:35111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788390962.137726:0:35111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788390962.137727:0:35111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788390962.137728:0:35111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788390962.137730:0:35111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788390962.137743:0:35111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788390962.137744:0:35111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788390962.137761:0:35111:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788390962.138192:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390962.138354:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788390962.138475:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390962.138638:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788390962.138787:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788390962.139019:0:35111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788390962.140821:0:35111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:3.0:1788390962.173339:0:35111:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788390962.173350:0:35111:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788390962.173389:0:35111:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788390962.173892:0:35111:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788390962.173912:0:35111:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788390962.173950:0:35111:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788390962.639701:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390963.662751:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788390963.725626:0:34427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788390963.725636:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586120800 from 16 10000000:01000000:3.0:1788390963.725642:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788390963.725689:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390963.725701:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390963.725713:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390963.725738:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103385216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788390963.725802:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390963.725892:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390963.725931:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385216 00000100:00100000:1.0:1788390963.725938:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385216 00000100:00100000:1.0:1788390963.726013:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788390963.726027:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:34427:x1875263103385216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390963.726040:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390963.726060:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd34ff9 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390963.726086:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 16 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390963.726098:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 16 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390963.726106:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390963.726151:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:34427:x1875263103385216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390963.726158:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788390963.726222:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103385216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390963.726246:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390963.726255:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390963.726298:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103385344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788390963.726331:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390963.726361:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b2f07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390963.726369:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385344 00000100:00100000:0.0:1788390963.726374:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385344 00000100:00100000:0.0:1788390963.726412:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788390963.726422:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:34427:x1875263103385344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788390963.726443:0:34425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788390963.726459:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788390963.726463:0:34425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 16 00000100:00100000:0.0:1788390963.726547:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:34427:x1875263103385344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390963.726554:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788390963.726686:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103385344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788390963.726741:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788390963.726754:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390963.726763:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390964.174200:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390954/real 1788390954] req@ffff95d6bc649880 x1875263103378816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390964 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.174224:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d6bc649880 x1875263103378816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390964 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.174231:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390954/real 1788390954] req@ffff95d6bc64a680 x1875263103378688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390964 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.174237:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d6bc64a680 x1875263103378688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788390964 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788390964.174250:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390964.174265:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788390964.174268:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103378816:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788390964.174272:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390964.174275:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788390964.174282:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103378688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788390964.174362:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390964.174365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788390964.174368:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390964.174371:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 771 00000100:00080000:2.0:1788390964.174375:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390964.174412:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6bcb46000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390964.174427:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc649c00 x1875263103385600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788390964.174435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390964.174437:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390964.174438:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390964.174440:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 771 00000100:00080000:2.0:1788390964.174442:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788390964.174444:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390964.174448:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc649f80 x1875263103385728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390964.174487:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788390964.174551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390964.174639:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385984 00000100:00100000:2.0:1788390964.174647:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385984 00000100:00100000:2.0:1788390964.174699:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390964.174708:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103385984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390964.174760:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103385984:12345-0@lo:400:kworker.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390964.174767:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788390964.174793:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390964.174811:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc64a680 x1875263103385984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390964.174819:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103385984:0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.174864:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103385856:0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.174896:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390964.174918:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390964.174921:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103385472:0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.174940:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390964.174994:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385856 00000100:00100000:1.0:1788390964.174998:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385856 00000100:00100000:1.0:1788390964.175019:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390964.175025:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103385856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.175059:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103385856:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390964.175066:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788390964.175084:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385472 00000100:00100000:1.0:1788390964.175087:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385472 00000100:00100000:1.0:1788390964.175104:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390964.175108:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3289:x1875263103385472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.175127:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3289:x1875263103385472:12345-0@lo:400:kworker.0 Request processed in 19us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390964.175130:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788390964.175152:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103385472:0@lo:400:kworker.0 00010000:00080000:1.0:1788390964.175159:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc64aa00 x1875263103385856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.175165:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103385856:0@lo:400:kworker.0 00000100:00100000:1.0:1788390964.175177:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103385600:0@lo:8:kworker.0 00000100:00100000:1.0:1788390964.175199:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390964.175225:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103385728:0@lo:8:kworker.0 00000100:00100000:1.0:1788390964.175237:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390964.175338:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385600 00000100:00100000:0.0:1788390964.175342:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385600 00000100:00100000:0.0:1788390964.175360:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103385728 00000100:00100000:0.0:1788390964.175361:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103385728 00000100:00100000:0.0:1788390964.175370:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390964.175375:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103385600:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788390964.175400:0:35112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:0.0:1788390964.175452:0:35112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd35007 00002000:00100000:0.0:1788390964.175467:0:35112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d6bbf78000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788390964.175472:0:35112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788390964.175474:0:35112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788390964.175798:0:35112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788390964.175817:0:35112:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf7f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390964.175860:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103385600:12345-0@lo:8:kworker.0 Request processed in 484us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390964.175864:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390964.175876:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390964.175878:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103385728:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788390964.175886:0:35112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788390964.176817:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc649c00 x1875263103385600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788390979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.176828:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390964.176835:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:1.0:1788390964.176844:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788390964.176849:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788390964.176851:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb46000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788390964.176863:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788390964.176868:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103385600:0@lo:8:kworker.0 00000004:00080000:2.0:1788390964.177008:0:34453:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x63:0x0] 00000100:00100000:2.0:1788390964.177029:0:34453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34453:1875263103386240:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788390964.177071:0:34453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390964.177090:0:34453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68133a3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788390964.177104:0:34452:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788390964.177466:0:34452:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781284504388ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788390964.177515:0:35114:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788390964.177522:0:35114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788390964.177617:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390964.177630:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103386112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390964.177660:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390964.177704:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386240 00000100:00100000:2.0:1788390964.177710:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386240 00000100:00080000:2.0:1788390964.177748:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390964.177812:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390964.177821:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:34453:x1875263103386240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788390964.180243:0:35313:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788390964.180253:0:35313:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -30 00002000:02000040:2.0:1788390964.180258:0:35313:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:100 to 0x240000400:129) 00000100:00100000:1.0:1788390964.180594:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386112 00000100:00100000:1.0:1788390964.180603:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386112 00000100:00100000:1.0:1788390964.180651:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390964.180663:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103386112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788390964.180703:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788390964.180786:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103386112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390964.180793:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788390964.180848:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bc64a680 x1875263103386112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390964.180871:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103386112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390964.189737:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103385728:12345-0@lo:8:kworker.0 Request processed in 13848us (14490us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390964.189761:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788390964.189824:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390964.189830:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390964.189835:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103385728:0@lo:8:kworker.0 00002000:00010000:3.0:1788390964.200286:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.200297:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200313:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.200318:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.200323:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200337:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200345:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200351:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200368:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390964.200392:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390964.200401:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.200415:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.200421:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.200431:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.200453:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.200459:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cd8844a/0x9aafc5f04cd3500e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.200477:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.200480:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.200482:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.200923:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.200929:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200946:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.200950:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.200954:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200984:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.200993:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201001:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201014:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390964.201023:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390964.201027:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201033:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390964.201037:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201044:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201064:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201071:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d652c3/0x9aafc5f04cd35015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201085:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390964.201087:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390964.201089:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.201451:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.201457:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201465:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.201468:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.201472:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201480:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201487:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201495:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.201527:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390964.201904:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390964.201910:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.201918:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.201922:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.201930:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.201943:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.201950:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3501c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.201986:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.201989:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.201990:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.202207:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.202212:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202220:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.202223:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.202228:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202236:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202243:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202250:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202272:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390964.202546:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390964.202551:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.202569:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.202572:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.202589:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.202602:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.202609:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044d36116/0x9aafc5f04cd35023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.202622:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.202624:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.202625:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.202786:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.202792:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202800:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.202809:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.202815:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202824:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202832:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202839:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.202850:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390964.203182:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390964.203188:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.203196:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.203200:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.203208:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.203225:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.203233:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd3502a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.203245:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.203247:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.203249:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.203313:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.203318:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.203326:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.203329:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.203333:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.203342:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.203350:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.203361:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.203372:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390964.204236:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390964.204244:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390964.204253:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788390964.204254:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.204258:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204259:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204268:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:2.0:1788390964.204268:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204271:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.204275:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204281:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204284:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204288:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a1739e6/0x9aafc5f04cd35031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204292:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204299:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204317:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390964.204320:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788390964.204321:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204327:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.204331:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204338:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204349:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204356:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.204367:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.204369:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.204370:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.204862:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.204868:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204881:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.204884:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.204887:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204897:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204904:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204912:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.204924:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390964.205172:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390964.205178:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.205185:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390964.205196:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.205203:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.205214:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.205220:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3503f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390964.205234:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.205235:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390964.205237:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.205679:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.205794:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.205801:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.205810:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.205813:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.205817:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.205827:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.205846:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.205853:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.205875:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390964.206052:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390964.206058:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.206065:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390964.206070:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.206079:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.206095:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.206103:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c6351b/0x9aafc5f04cd35046 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.206118:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.206120:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.206121:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.206341:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.206347:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206355:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.206358:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.206362:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206370:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206378:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206385:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206410:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788390964.206946:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.206952:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.206983:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.206987:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.206992:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207001:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207009:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207016:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207106:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788390964.207544:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.207550:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207559:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.207568:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.207573:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207591:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207600:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207607:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.207614:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788390964.208309:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.208318:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208328:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.208331:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.208335:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208346:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208355:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208366:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208375:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788390964.208924:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.208931:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208939:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.208943:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.208946:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208956:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208984:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.208991:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209000:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788390964.209421:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.209428:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209444:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.209447:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.209452:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209539:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209549:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209557:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.209566:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788390964.210102:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.210109:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210117:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.210120:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.210124:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210133:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210151:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210158:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210166:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788390964.210627:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.210633:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210641:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.210644:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.210648:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210726:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210734:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210740:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.210758:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788390964.211203:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.211210:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211218:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.211222:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.211226:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211235:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211243:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211250:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211258:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788390964.211776:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.211781:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211801:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.211808:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.211812:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211821:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211828:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211834:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.211840:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788390964.212451:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.212457:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.212539:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.212542:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.212546:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.212556:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.212564:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.212578:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.212597:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1788390964.213037:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788390964.213046:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213055:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213059:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213068:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213092:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213099:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd3504d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213122:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788390964.213125:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213132:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213135:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213142:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390964.213146:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.213151:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213152:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213160:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=781s v=(0 0) 00010000:00010000:1.0:1788390964.213160:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35054 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213163:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.213167:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213172:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788390964.213176:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213176:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213184:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213186:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213189:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213192:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213198:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213200:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:1.0:1788390964.213206:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213213:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd3505b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213226:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788390964.213230:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213235:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aaa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213238:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213245:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213254:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213267:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213279:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788390964.213283:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213290:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213293:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213300:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213310:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213317:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd35069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213328:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788390964.213332:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213338:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aac00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213346:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213354:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213364:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213371:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213382:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788390964.213386:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213392:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213395:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213401:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213409:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213415:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213433:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788390964.213436:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213442:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.213446:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213454:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213464:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213471:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd3507e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.213482:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00010000:3.0:1788390964.213546:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.213552:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213565:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.213568:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.213573:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213591:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213599:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213605:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.213612:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788390964.214001:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.214007:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214015:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.214018:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.214022:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214031:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214050:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214057:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214065:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788390964.214269:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390964.214420:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.214425:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214433:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.214436:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.214440:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214448:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214455:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214461:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.214480:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788390964.214556:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214561:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214590:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214603:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214609:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214624:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788390964.214627:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214633:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214636:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214642:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214651:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214659:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3508c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214684:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788390964.214687:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214693:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214696:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214703:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214711:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214718:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000533ac39/0x9aafc5f04cd35093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214728:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788390964.214732:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214738:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214740:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214759:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214769:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214775:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3509a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214787:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788390964.214790:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214797:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214799:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214807:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214817:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214824:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081467c86/0x9aafc5f04cd350a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214846:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390964.214849:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214855:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214858:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214866:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214876:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214883:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d9827f/0x9aafc5f04cd350a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214893:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390964.214896:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214902:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.214905:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214921:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214931:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214937:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724dbc02/0x9aafc5f04cd350af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.214949:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.214950:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.214952:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.214982:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.215161:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.215167:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215175:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.215178:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.215182:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215190:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215198:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215205:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215222:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788390964.215727:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.215734:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215743:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.215752:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.215756:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215766:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215774:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215781:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.215795:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788390964.216225:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390964.216231:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216240:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.216245:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216253:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216266:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216279:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000602fc208/0x9aafc5f04cd350b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390964.216289:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.216294:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216294:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390964.216298:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216302:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.216305:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390964.216305:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.216308:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216310:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216316:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216320:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216326:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216328:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216333:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb73ae80/0x9aafc5f04cd350bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216341:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216344:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.216346:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.216347:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390964.216367:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390964.216402:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390964.216407:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216419:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390964.216422:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216430:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216441:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216448:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd350c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390964.216461:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.216463:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.216465:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.216470:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788390964.216983:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.216990:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.216999:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.217002:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.217006:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217015:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217104:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217112:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217164:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788390964.217612:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.217618:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217633:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.217635:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.217639:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217649:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217792:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.217800:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217832:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390964.217847:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217855:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390964.217860:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217868:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217884:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217891:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd350cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217907:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390964.217910:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217916:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390964.217919:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217925:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788390964.217947:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788390964.217947:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.217954:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.217955:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.217957:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390964.218026:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390964.218090:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788390964.218095:0:35313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd350d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788390964.218396:0:35313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788390964.218400:0:35313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.218406:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=781s v=(0 0) 00010000:00010000:3.0:1788390964.218409:0:35313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390964.218411:0:35313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.218425:0:35313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.218430:0:35313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.218434:0:35313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390964.218447:0:35313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390964.218475:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390964.218480:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.218549:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390964.218553:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.218563:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.218574:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.218594:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd350d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390964.218608:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.218610:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390964.218612:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788390964.218736:0:35313:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:99 00000100:00100000:3.0:1788390964.218816:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:34453:x1875263103386240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 40992us (41740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390964.218828:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390964.218850:0:34453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34453:1875263103386240:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788390964.218866:0:34453:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x81:0x0] from OST, last_created [0x240000400:0x81:0x0]last_used is [0x240000400:0x63:0x0] 00000100:00100000:2.0:1788390964.218908:0:34453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34453:1875263103386368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788390964.218936:0:34453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390964.218995:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386368 00000100:00100000:0.0:1788390964.219003:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386368 00000100:00100000:2.0:1788390964.219044:0:34453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390964.219186:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788390964.219196:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:34453:x1875263103386368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788390964.219234:0:35114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 130 00000100:00100000:1.0:1788390964.224273:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:34453:x1875263103386368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5069us (5326us total) trans 21474836481 rc 0/0 00000100:00100000:1.0:1788390964.224286:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390964.224377:0:34453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34453:1875263103386368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788390964.224393:0:34453:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x81:0x0]-[0x240000400:0xa1:0x0] 00010000:00010000:1.0:1788390964.687264:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390965.709107:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390965.853771:0:35479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788390966.735741:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788390966.926780:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788390966.926791:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788390966.926905:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:0.0:1788390966.926912:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000001:00080000:0.0:1788390967.313853:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836481 is committed 00000001:00100000:0.0:1788390967.313869:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788390967.757238:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390968.781233:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390969.294257:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390969.294447:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103386496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390969.294525:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390969.294608:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386496 00000100:00100000:2.0:1788390969.294615:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386496 00000100:00100000:2.0:1788390969.294667:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788390969.294677:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103386496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390969.294712:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788390969.294759:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103386496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390969.294765:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788390969.294862:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390969.294891:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:2.0:1788390969.294913:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103386496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788390969.295022:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788390969.295026:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788390969.295030:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390969.295035:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 781 00000100:00080000:3.0:1788390969.295039:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788390969.295044:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390969.295063:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d68f55c700 x1875263103386752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788390969.295114:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103386880:0@lo:400:kworker.0 00000100:00100000:3.0:1788390969.295148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390969.295178:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390969.295184:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103387008:0@lo:400:kworker.0 00000100:00100000:3.0:1788390969.295209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390969.295238:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386880 00000100:00100000:3.0:1788390969.295242:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386880 00000100:00100000:3.0:1788390969.295267:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387008 00000100:00100000:3.0:1788390969.295271:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387008 00000100:00100000:3.0:1788390969.295307:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390969.295315:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103386880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390969.295561:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788390969.295571:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103387008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390969.295612:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103387008:12345-0@lo:400:kworker.0 Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390969.295618:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788390969.295640:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390969.295659:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d68f55e300 x1875263103387008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390969.295670:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103387008:0@lo:400:kworker.0 00000100:00100000:2.0:1788390969.295690:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103386624:0@lo:400:kworker.0 00000100:00100000:2.0:1788390969.295719:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390969.295812:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103386880:12345-0@lo:400:kworker.0 Request processed in 498us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390969.295819:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390969.296063:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103386752:0@lo:8:kworker.0 00000100:00100000:0.0:1788390969.296097:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390969.296134:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386624 00000100:00100000:0.0:1788390969.296138:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386624 00000100:00100000:0.0:1788390969.296169:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390969.296177:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3289:x1875263103386624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390969.296214:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3289:x1875263103386624:12345-0@lo:400:kworker.0 Request processed in 38us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390969.296221:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788390969.296261:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103386752 00000100:00100000:0.0:1788390969.296264:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103386752 00000100:00100000:0.0:1788390969.296298:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390969.296303:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103386752:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788390969.296318:0:35112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788390969.296554:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103386752:12345-0@lo:8:kworker.0 Request processed in 248us (455us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788390969.296561:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788390969.296592:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788390969.296606:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788390969.296609:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103386752:0@lo:8:kworker.0 00000100:00100000:0.0:1788390969.296636:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103386624:0@lo:400:kworker.0 00010000:00080000:2.0:1788390969.297059:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d68f55d880 x1875263103386880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390969.297085:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103386880:0@lo:400:kworker.0 00010000:00010000:0.0:1788390969.806956:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788390970.693887:0:35829:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788390970.693891:0:35829:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788390970.694060:0:35829:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d5872c5000 00000020:01000004:3.0:1788390970.694073:0:35829:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788390970.694082:0:35829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788390970.694093:0:35829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d6bc758000) 00000020:00000080:3.0:1788390970.694103:0:35829:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788390970.705223:0:35829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788390970.705536:0:35829:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788390970.706345:0:35829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788390970.706652:0:35829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788390970.706901:0:35829:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:3.0:1788390970.707324:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:3.0:1788390970.707504:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:3.0:1788390970.707685:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:3.0:1788390970.708372:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788390970.708713:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788390970.708982:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788390970.709242:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788390970.709580:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788390970.709826:0:35829:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1788390970.710605:0:35829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788390970.710618:0:35829:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788390970.710628:0:35829:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd350e7 00000020:01000004:3.0:1788390970.710636:0:35829:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788390970.710657:0:35829:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788390970.710661:0:35829:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788390970.710667:0:35829:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788390970.710689:0:35829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788390970.710693:0:35829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788390970.719376:0:35829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788390970.719415:0:35829:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788390970.719420:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788390970.719422:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.719423:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.719424:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.719426:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.719427:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.719494:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.719497:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.719498:0:35829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390970.719502:0:35829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788390970.719504:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390970.719505:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.719507:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.719508:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.719509:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.719510:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.719511:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.719512:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.719519:0:35829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788390970.719558:0:35829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788390970.719579:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788390970.719647:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.719766:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390970.719814:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387136 00000100:00100000:1.0:1788390970.719822:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387136 00000100:00100000:1.0:1788390970.719924:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788390970.719935:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35829:x1875263103387136:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788390970.719993:0:34423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788390970.719997:0:34423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788390970.720001:0:34423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788390970.726340:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35829:x1875263103387136:12345-0@lo:253:mount.lustre.0 Request processed in 6397us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.726356:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788390970.726511:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390970.726539:0:35829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788390970.726543:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390970.726547:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.726548:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.726550:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.726551:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.726552:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.726554:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.726555:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.726557:0:35829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788390970.726579:0:35829:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d5872c5000 from lustre-OST0001 10000000:01000000:3.0:1788390970.726607:0:35829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788390970.726610:0:35829:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788390970.726619:0:35829:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d691318000 local copy 00010000:00010000:3.0:1788390970.726630:0:35829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390970.726855:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.726891:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.727038:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.727090:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387264 00000100:00100000:0.0:1788390970.727097:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387264 00000100:00100000:0.0:1788390970.727177:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788390970.727187:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35829:x1875263103387264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.727546:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387264:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788390970.727559:0:35829:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788390970.727715:0:35829:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788390970.727723:0:35829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.727739:0:35829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390970.727765:0:35829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d5872c5000 10000000:01000000:3.0:1788390970.727770:0:35829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788390970.727775:0:35829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788390970.727778:0:35829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390970.727782:0:35829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788390970.727785:0:35829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788390970.727807:0:35829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.727814:0:35829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.727823:0:35829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390970.727835:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390970.727864:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.727885:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35829:x1875263103387264:12345-0@lo:501:mount.lustre.0 Request processed in 245us (538us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788390970.727894:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788390970.728021:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.728083:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387392 00000100:00100000:0.0:1788390970.728088:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387392 00000100:00100000:2.0:1788390970.728144:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788390970.728154:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:35829:x1875263103387392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390970.728165:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390970.728179:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1ec00/0x9aafc5f04cd350f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd350ee expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.728208:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1ec00/0x9aafc5f04cd350f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd350ee expref: 17 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.728220:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1ec00/0x9aafc5f04cd350f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd350ee expref: 17 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.728231:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ec00, rc 0) 00000100:00100000:2.0:1788390970.728273:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387392:12345-0@lo:101:mount.lustre.0 Request processed in 121us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390970.728279:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788390970.728334:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390970.728347:0:35829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.728356:0:35829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390970.729146:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000040:00080000:3.0:1788390970.730021:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390970.730255:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:3.0:1788390970.730301:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:3.0:1788390970.730340:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:3.0:1788390970.730409:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:3.0:1788390970.730447:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:3.0:1788390970.730483:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:3.0:1788390970.730548:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:3.0:1788390970.730586:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:3.0:1788390970.730636:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:3.0:1788390970.730692:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:3.0:1788390970.730700:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 11 00000100:00100000:3.0:1788390970.730786:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.730849:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.731199:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390970.731243:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387520 00000100:00100000:1.0:1788390970.731250:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387520 00000100:00100000:1.0:1788390970.731291:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788390970.731302:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788390970.731841:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387520:12345-0@lo:501:mount.lustre.0 Request processed in 538us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.731850:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788390970.731998:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.732037:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390970.732081:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.732094:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788390970.732148:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387648 00000100:00100000:1.0:1788390970.732152:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387648 00000100:00100000:1.0:1788390970.732173:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788390970.732179:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788390970.732613:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387648:12345-0@lo:503:mount.lustre.0 Request processed in 431us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.732620:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788390970.732685:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390970.733137:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390970.733191:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390970.733228:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.733249:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.733303:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387776 00000100:00100000:0.0:1788390970.733308:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387776 00000100:00100000:0.0:1788390970.733342:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788390970.733351:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390970.733670:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387776:12345-0@lo:502:mount.lustre.0 Request processed in 320us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.733677:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788390970.733761:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390970.733955:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:3.0:1788390970.734062:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:3.0:1788390970.734099:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:3.0:1788390970.734146:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:3.0:1788390970.734176:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:3.0:1788390970.734202:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:3.0:1788390970.734263:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:3.0:1788390970.734293:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:3.0:1788390970.734329:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:3.0:1788390970.734357:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390970.734392:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.734546:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788390970.734626:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103387904 00000100:00100000:2.0:1788390970.734631:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103387904 00000100:00100000:1.0:1788390970.734676:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788390970.734689:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390970.734837:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103387904:12345-0@lo:502:mount.lustre.0 Request processed in 148us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.734844:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788390970.734913:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103387904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390970.735003:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:3.0:1788390970.735013:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788390970.735767:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788390970.735775:0:35830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788390970.735781:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.735784:0:35830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788390970.735789:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788390970.735803:0:35830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d68a660000) 00000020:00000080:1.0:1788390970.735824:0:35830:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788390970.735828:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788390970.735881:0:35830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d5872c5000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788390970.735887:0:35830:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788390970.735903:0:35830:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd35103 00010000:00010000:1.0:1788390970.739757:0:35830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788390970.740365:0:35830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 17179869189 00080000:10000000:1.0:1788390970.742420:0:35830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:1.0:1788390970.743869:0:35830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788390970.743881:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.743888:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.743890:0:35830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788390970.743893:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390970.743898:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.743899:0:35830:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788390970.743902:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788390970.743904:0:35830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788390970.743906:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.743908:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.743910:0:35830:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788390970.743912:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390970.743924:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.743926:0:35830:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788390970.743930:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788390970.744572:0:35830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.744578:0:35830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.744580:0:35830:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788390970.744584:0:35830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:0.0:1788390970.749538:0:35829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788390970.749580:0:35829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788390970.750341:0:35829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.750356:0:35829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390970.750375:0:35829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d5872c5000 from 1 10000000:01000000:0.0:1788390970.750377:0:35829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788390970.750414:0:35829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.750422:0:35829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.750502:0:35829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390970.750536:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788390970.750597:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.750638:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390970.751125:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388032 00000100:00100000:3.0:1788390970.751132:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388032 00000100:00100000:3.0:1788390970.751208:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788390970.751218:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:35829:x1875263103388032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390970.751230:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390970.751242:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3510a expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.751265:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 18 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.751274:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 18 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.751294:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd000, rc 0) 00000100:00100000:3.0:1788390970.751339:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388032:12345-0@lo:101:mount.lustre.0 Request processed in 123us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390970.751345:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788390970.751506:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788390970.751529:0:35829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.751539:0:35829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390970.752095:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:2.0:1788390970.752663:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390970.752870:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1788390970.752908:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:2.0:1788390970.752951:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:2.0:1788390970.753066:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:2.0:1788390970.753100:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:2.0:1788390970.753146:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:2.0:1788390970.753181:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:2.0:1788390970.753215:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:2.0:1788390970.753285:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:2.0:1788390970.753292:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:2.0:1788390970.753364:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390970.753422:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.753773:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388160 00000100:00100000:0.0:1788390970.753780:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388160 00000100:00100000:0.0:1788390970.753816:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788390970.753825:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788390970.754048:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388160:12345-0@lo:501:mount.lustre.0 Request processed in 223us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.754056:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788390970.754322:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788390970.754344:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788390970.754376:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788390970.754416:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390970.754555:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.754591:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388288 00000100:00100000:0.0:1788390970.754595:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388288 00000100:00100000:0.0:1788390970.754658:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788390970.754666:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788390970.754886:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388288:12345-0@lo:503:mount.lustre.0 Request processed in 221us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.754902:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788390970.754995:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788390970.755599:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788390970.755679:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390970.755724:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390970.756210:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390970.756268:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388416 00000100:00100000:3.0:1788390970.756275:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388416 00000100:00100000:3.0:1788390970.756307:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788390970.756315:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390970.756646:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388416:12345-0@lo:502:mount.lustre.0 Request processed in 331us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390970.756654:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788390970.756762:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390970.757021:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:2.0:1788390970.757073:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:2.0:1788390970.757125:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:2.0:1788390970.757176:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:2.0:1788390970.757208:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:2.0:1788390970.757252:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:2.0:1788390970.757290:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:2.0:1788390970.757326:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:2.0:1788390970.757358:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788390970.757402:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390970.757424:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.757542:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388544 00000100:00100000:0.0:1788390970.757549:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388544 00000100:00100000:0.0:1788390970.757588:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788390970.757596:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390970.757950:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388544:12345-0@lo:502:mount.lustre.0 Request processed in 354us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.757983:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788390970.758506:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788390970.758636:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:2.0:1788390970.758647:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788390970.759656:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390970.759668:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.759671:0:35834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788390970.759677:0:35834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d5872c5000 00000020:00000080:1.0:1788390970.759680:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390970.759687:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.759689:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.759691:0:35834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788390970.759693:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390970.759696:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.759697:0:35834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788390970.759700:0:35834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d5872c5000 00000020:00000080:1.0:1788390970.759702:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390970.759800:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.759804:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.759805:0:35834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788390970.759808:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788390970.759811:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.759812:0:35834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788390970.759815:0:35834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d5872c5000 00000020:00000080:1.0:1788390970.759817:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788390970.765666:0:35834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788390970.765681:0:35834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788390970.765683:0:35834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788390970.765688:0:35834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:3.0:1788390970.766567:0:35829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788390970.766598:0:35829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788390970.766623:0:35829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.766636:0:35829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390970.766685:0:35829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788390970.766688:0:35829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d5872c5000 10000000:01000000:3.0:1788390970.766692:0:35829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d5872c5000 10000000:01000000:3.0:1788390970.766695:0:35829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788390970.766701:0:35829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d5872c5000 from 1 10000000:01000000:3.0:1788390970.766703:0:35829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788390970.766739:0:35829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.766758:0:35829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.766770:0:35829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390970.766796:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788390970.766862:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.766897:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390970.766985:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388672 00000100:00100000:1.0:1788390970.766993:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388672 00000100:00100000:1.0:1788390970.767048:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788390970.767058:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103388672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788390970.767071:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390970.767084:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd3511f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35118 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390970.767105:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd3511f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35118 expref: 19 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390970.767115:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd3511f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35118 expref: 19 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390970.767124:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62800, rc 0) 00000100:00100000:1.0:1788390970.767162:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0fd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103388672:12345-0@lo:101:mount.lustre.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.767169:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788390970.767277:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788390970.767292:0:35829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.767301:0:35829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390970.768059:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:3.0:1788390970.768368:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788390970.769558:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:3.0:1788390970.769611:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:3.0:1788390970.769646:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:3.0:1788390970.769692:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:3.0:1788390970.769729:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:3.0:1788390970.769778:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:3.0:1788390970.769814:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:3.0:1788390970.769852:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:3.0:1788390970.769902:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:3.0:1788390970.769955:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:3.0:1788390970.770027:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:3.0:1788390970.770076:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:3.0:1788390970.770113:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:3.0:1788390970.770146:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:3.0:1788390970.770195:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:3.0:1788390970.770233:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:3.0:1788390970.770268:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:3.0:1788390970.770331:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:3.0:1788390970.770371:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:3.0:1788390970.770406:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:3.0:1788390970.773718:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:3.0:1788390970.773801:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:3.0:1788390970.773836:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:3.0:1788390970.773885:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:3.0:1788390970.773922:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:3.0:1788390970.774005:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:3.0:1788390970.774055:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:3.0:1788390970.774088:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:3.0:1788390970.774125:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:3.0:1788390970.774173:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:3.0:1788390970.774205:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:3.0:1788390970.774232:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:3.0:1788390970.774265:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:3.0:1788390970.774313:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:3.0:1788390970.774350:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:3.0:1788390970.774399:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:3.0:1788390970.779645:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:3.0:1788390970.779745:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:3.0:1788390970.779817:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:3.0:1788390970.779854:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:3.0:1788390970.779957:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:3.0:1788390970.779982:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:3.0:1788390970.780082:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.780157:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.780210:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388800 00000100:00100000:3.0:1788390970.780217:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388800 00000100:00100000:3.0:1788390970.780266:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788390970.780274:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103388800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.780661:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103388800:12345-0@lo:501:mount.lustre.0 Request processed in 386us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390970.780670:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788390970.780715:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390970.780738:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788390970.780768:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390970.780809:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.780833:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103388928 00000100:00100000:3.0:1788390970.780837:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103388928 00000100:00100000:3.0:1788390970.780862:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390970.780869:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68646ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103388928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788390970.781177:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68646ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103388928:12345-0@lo:503:mount.lustre.0 Request processed in 308us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390970.781184:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788390970.781215:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1788390970.781226:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103388928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788390970.784610:0:35829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788390970.784707:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390970.784791:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.784846:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.785568:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389056 00000100:00100000:0.0:1788390970.785577:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389056 00000100:00100000:0.0:1788390970.785631:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788390970.785641:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103389056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788390970.786005:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103389056:12345-0@lo:502:mount.lustre.0 Request processed in 364us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.786013:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788390970.786135:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390970.786386:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:3.0:1788390970.789714:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:3.0:1788390970.789814:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:3.0:1788390970.789898:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:3.0:1788390970.789942:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:3.0:1788390970.790030:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:3.0:1788390970.790068:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:3.0:1788390970.790103:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:3.0:1788390970.790156:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:3.0:1788390970.790196:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:3.0:1788390970.790236:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:3.0:1788390970.790312:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:3.0:1788390970.790355:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:3.0:1788390970.790406:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:3.0:1788390970.790455:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:3.0:1788390970.790493:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:3.0:1788390970.790543:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:3.0:1788390970.790594:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:3.0:1788390970.790629:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:3.0:1788390970.790658:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:3.0:1788390970.790705:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:3.0:1788390970.790742:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:3.0:1788390970.790777:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:3.0:1788390970.790824:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:3.0:1788390970.790856:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:3.0:1788390970.790887:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:3.0:1788390970.790934:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:3.0:1788390970.791000:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:3.0:1788390970.791036:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:3.0:1788390970.791106:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:3.0:1788390970.791141:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:3.0:1788390970.791190:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:3.0:1788390970.791229:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:3.0:1788390970.791284:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:3.0:1788390970.791317:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:3.0:1788390970.791361:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:3.0:1788390970.791396:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:3.0:1788390970.791432:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:3.0:1788390970.791482:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:3.0:1788390970.791518:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:3.0:1788390970.791583:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788390970.791672:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.791721:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1788390970.794120:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389184 00000100:00100000:1.0:1788390970.794135:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389184 00000100:00100000:1.0:1788390970.794193:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788390970.794204:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103389184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788390970.794492:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103389184:12345-0@lo:502:mount.lustre.0 Request processed in 289us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.794500:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788390970.798873:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788390970.799067:0:35829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:3.0:1788390970.799089:0:35829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788390970.800480:0:35839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788390970.800497:0:35839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d6bc27cd28) 00000020:00000080:0.0:1788390970.800533:0:35839:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788390970.802083:0:35839:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d5872c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390970.802092:0:35839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d5872c5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788390970.802095:0:35839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d5872c5000 3 00010000:00080000:0.0:1788390970.802137:0:35839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6bbf79000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788390970.806292:0:35839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788390970.806503:0:35839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788390970.806555:0:35839:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788390970.806569:0:35839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd3512d 00000100:00080000:0.0:1788390970.806580:0:35839:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788390970.806595:0:35839:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d6bbf79000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390970.806631:0:35839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d691832d80 x1875263103389312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390970.806694:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103389312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788390970.806772:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390970.806863:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389312 00000100:00100000:2.0:1788390970.806872:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389312 00000100:00100000:2.0:1788390970.806911:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390970.806919:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103389312:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788390970.806943:0:34432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 787 last 0 00000100:00080000:0.0:1788390970.807001:0:35839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390970.807047:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788390970.807052:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788390970.807054:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788390970.807059:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:0.0:1788390970.807063:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788390970.807067:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788390970.807083:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d691833800 x1875263103389568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1788390970.807151:0:34432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd35134 00000004:00100000:2.0:1788390970.807168:0:34432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788390970.807200:0:34432:0:(import.c:65:import_set_state_nolock()) ffff95d68f044000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390970.807296:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103389568:0@lo:8:kworker.0 00000100:00100000:1.0:1788390970.807336:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.807452:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103389440:0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.807496:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.807517:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788390970.807536:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103389696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.807561:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.807588:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103389824:0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.807610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.807640:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389568 00000100:00100000:0.0:1788390970.807644:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389568 00000100:00100000:0.0:1788390970.807664:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389440 00000100:00100000:0.0:1788390970.807667:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389440 00000100:00100000:0.0:1788390970.807701:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390970.807711:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103389440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.807757:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103389440:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.807771:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788390970.807788:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390970.807793:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103389568:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788390970.807828:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103389568:12345-0@lo:8:kworker.0 Request processed in 34us (493us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788390970.807834:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390970.807853:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389696 00000100:00100000:0.0:1788390970.807857:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389696 00000100:00100000:0.0:1788390970.807875:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389824 00000100:00100000:0.0:1788390970.807878:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389824 00000100:00100000:0.0:1788390970.807889:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390970.807895:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103389696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.807924:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103389696:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.807930:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390970.807941:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390970.807947:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103389824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.808011:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103389824:12345-0@lo:400:kworker.0 Request processed in 63us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.808018:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788390970.808075:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691832a00 x1875263103389824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390970.808090:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103389824:0@lo:400:kworker.0 00010000:00080000:0.0:1788390970.808120:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691830000 x1875263103389696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788390970.808144:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103389696:0@lo:400:kworker.0 00000100:00100000:0.0:1788390970.808158:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103389440:0@lo:400:kworker.0 00000040:00080000:0.0:1788390970.808543:0:35839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000020:01000000:3.0:1788390970.808607:0:35829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788390970.808643:0:35829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788390970.808669:0:35829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390970.808680:0:35829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788390970.808722:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788390970.808724:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.808725:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.808727:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.808729:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.808730:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.808732:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.808733:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.808735:0:35829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390970.808742:0:35829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788390970.808745:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788390970.808746:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.808747:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.808748:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.808749:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.808750:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.808751:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.808752:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.808753:0:35829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788390970.808770:0:35829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788390970.808784:0:35829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788390970.808934:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103389312:12345-0@lo:38:llog_process_th.0 Request processed in 2013us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390970.808943:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788390970.809010:0:35829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390970.809041:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103389952 00000100:00100000:3.0:1788390970.809046:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103389952 00000100:00100000:3.0:1788390970.809089:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788390970.809097:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:35829:x1875263103389952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788390970.809131:0:34423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788390970.809145:0:34423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788390970.809147:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d691832d80 x1875263103389312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788390980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788390970.809158:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390970.809166:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 5 00000100:00080000:1.0:1788390970.809174:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788390970.809178:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788390970.809182:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf79000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788390970.809188:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103389312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788390970.809213:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788390970.809217:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788390970.809221:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788390970.809224:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103389568:0@lo:8:kworker.0 00000100:00100000:3.0:1788390970.809635:0:35829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788390970.831749:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788390970.873443:0:34423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788390970.873466:0:34423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788390970.873562:0:34446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788390970.873568:0:34446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788390970.873593:0:34446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.873611:0:34446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.873631:0:34446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.873663:0:34446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.873674:0:34446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 19 pid: 34424 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390970.873686:0:34446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103390080:0@lo:104: 00000100:00100000:2.0:1788390970.873737:0:34446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390970.873777:0:34446:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68621d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390970.873787:0:34413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390080 00000100:00100000:0.0:1788390970.873795:0:34413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390080 00000100:00100000:0.0:1788390970.873842:0:34413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390970.873850:0:34413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103390080:12345-0@lo:104: 00010000:00010000:0.0:1788390970.873863:0:34413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.873919:0:34413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390970.873925:0:34413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:34446:x1875263103390080:12345-0@lo:104: Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.873932:0:34413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788390970.873983:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390970.873990:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.873998:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc1d52c20) 00000100:00100000:2.0:1788390970.874002:0:34446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:34446:1875263103390080:0@lo:104: 10000000:00010000:0.0:1788390970.874004:0:34419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390970.874016:0:34446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874025:0:34419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390970.874046:0:34419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390970.874053:0:34419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788390970.874081:0:34419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874088:0:34419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390970.874104:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874112:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0a00/0x9aafc5f04cd34ff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35000 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874129:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390970.874130:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390970.874132:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390970.874141:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103390208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788390970.874166:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390970.874200:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390208 00000100:00100000:0.0:1788390970.874204:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390208 00010000:00010000:0.0:1788390970.874218:0:34415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 20 pid: 34424 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390970.874237:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788390970.874243:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+20:3287:x1875263103390208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390970.874251:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390970.874255:0:34415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 20 pid: 34424 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874270:0:34415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 20 pid: 34424 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874281:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63000/0x9aafc5f04cd35000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34ff9 expref: 20 pid: 34424 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874293:0:34415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874300:0:34415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788390970.874309:0:34415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001749762s 00010000:00010000:0.0:1788390970.874312:0:34415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874320:0:34415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874327:0:34415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874343:0:34415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874349:0:34415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390970.874353:0:34415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874360:0:34415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874377:0:34415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874387:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390970.874414:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3287:x1875263103390208:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390970.874420:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788390970.874443:0:34446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390970.874448:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103390208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390970.874453:0:34446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390970.874461:0:34446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1fe00/0x9aafc5f04cd3513b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 34446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390970.889006:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:35829:x1875263103389952:12345-0@lo:253:mount.lustre.0 Request processed in 79899us (79986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390970.889031:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788390970.889275:0:35829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:35829:1875263103389952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788390970.889329:0:35829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788390970.889332:0:35829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788390970.889334:0:35829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788390970.889336:0:35829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788390970.889337:0:35829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788390970.889395:0:35829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788390970.889398:0:35829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788390970.889399:0:35829:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788390970.889401:0:35829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788390970.889403:0:35829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788390970.889419:0:35829:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788390970.890172:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390970.890580:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390970.890764:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390970.891118:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788390970.891281:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788390970.891690:0:35829:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788390970.892732:0:35829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:3.0:1788390970.923496:0:35829:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788390970.923505:0:35829:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788390970.923566:0:35829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788390970.923653:0:35829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788390970.923719:0:35829:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788390970.923742:0:35829:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788390971.853553:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788390972.750361:0:34427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788390972.750369:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586120800 from 17 10000000:01000000:2.0:1788390972.750376:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788390972.750438:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390972.750450:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390972.750460:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390972.750501:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103390336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390972.750586:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390972.750645:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a7056e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788390972.750854:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390336 00000100:00100000:3.0:1788390972.750862:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390336 00000100:00100000:3.0:1788390972.750908:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788390972.750915:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103390336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390972.750927:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390972.750940:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35142 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390972.750991:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35142 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390972.751001:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35142 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390972.751010:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd800, rc 0) 00000100:00100000:3.0:1788390972.751051:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103390336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390972.751057:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788390972.751167:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103390336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390972.751180:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390972.751188:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390972.751233:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103390464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788390972.751263:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390972.751286:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a7056e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788390972.751324:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390464 00000100:00100000:1.0:1788390972.751328:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390464 00000100:00100000:1.0:1788390972.751351:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788390972.751356:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103390464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788390972.751366:0:34423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788390972.751379:0:34423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788390972.751381:0:34423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 17 00000100:00100000:1.0:1788390972.751463:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103390464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390972.751474:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788390972.751593:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103390464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788390972.751646:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788390972.751653:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390972.751660:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390972.878182:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390973.901044:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390974.414140:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390974.414163:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103390592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390974.414233:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390974.414291:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390592 00000100:00100000:2.0:1788390974.414309:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390592 00000100:00100000:2.0:1788390974.414361:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788390974.414371:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103390592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390974.414406:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788390974.414449:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103390592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390974.414456:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788390974.414477:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390974.414527:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103390592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788390974.925258:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390975.143633:0:36182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788390975.951340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788390975.951347:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788390975.951351:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788390975.951362:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d682b29800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788390975.951383:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc649180 x1875263103390976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788390975.951470:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103391104:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.951550:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390975.951599:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788390975.951605:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103390848:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.951629:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390975.951656:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390975.951706:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103391232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.951731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390975.951749:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788390975.951766:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103390720:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.951796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390975.951819:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103391360:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.951846:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390975.951873:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391104 00000100:00100000:2.0:1788390975.951880:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391104 00000100:00100000:2.0:1788390975.951916:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391232 00000100:00100000:2.0:1788390975.951920:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391232 00000100:00100000:2.0:1788390975.951939:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391360 00000100:00100000:2.0:1788390975.951941:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391360 00000100:00100000:2.0:1788390975.951955:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390975.951988:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103391104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.952034:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103391104:12345-0@lo:400:kworker.0 Request processed in 47us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390975.952041:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788390975.952055:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390975.952061:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103391232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.952088:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103391232:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390975.952095:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788390975.952106:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390975.952113:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103391360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.952137:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103391360:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390975.952143:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788390975.952158:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788390975.952180:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc648e00 x1875263103391104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390975.952200:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103391104:0@lo:400:kworker.0 00010000:00080000:2.0:1788390975.952228:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc64a680 x1875263103391360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390975.952236:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103391360:0@lo:400:kworker.0 00010000:00080000:2.0:1788390975.952244:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc649f80 x1875263103391232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788390991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390975.952251:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103391232:0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.952274:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390720 00000100:00100000:2.0:1788390975.952278:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390720 00000100:00100000:2.0:1788390975.952301:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788390975.952307:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3288:x1875263103390720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390975.952339:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3288:x1875263103390720:12345-0@lo:400:kworker.0 Request processed in 33us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390975.952345:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788390975.952373:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103390720:0@lo:400:kworker.0 00000100:00100000:1.0:1788390975.952542:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103390976:0@lo:8:kworker.0 00000100:00100000:1.0:1788390975.952573:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390975.952744:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390848 00000100:00100000:0.0:1788390975.952750:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390848 00000100:00100000:0.0:1788390975.952782:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103390976 00000100:00100000:0.0:1788390975.952786:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103390976 00000100:00100000:0.0:1788390975.952805:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390975.952811:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103390848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788390975.952852:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103390848:12345-0@lo:400:kworker.0 Request processed in 41us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390975.952857:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390975.952869:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390975.952873:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103390976:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788390975.952905:0:35112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:0.0:1788390975.952932:0:35112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd35150 00002000:00100000:0.0:1788390975.952945:0:35112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d6a186c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788390975.952949:0:35112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788390975.952951:0:35112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788390975.953251:0:35112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788390975.953275:0:35112:0:(import.c:65:import_set_state_nolock()) ffff95d6a1868000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390975.953311:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103390976:12345-0@lo:8:kworker.0 Request processed in 436us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390975.953317:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390975.953360:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103390848:0@lo:400:kworker.0 00010000:00080000:0.0:1788390975.953430:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc649180 x1875263103390976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788391000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788390975.953442:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1788390975.953449:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788390975.953453:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788390975.953455:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788390975.953464:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788390975.953468:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103390976:0@lo:8:kworker.0 00000004:00080000:1.0:1788390975.953634:0:34455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x62:0x0] 00000100:00100000:1.0:1788390975.953652:0:34455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34455:1875263103391616:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788390975.953680:0:34455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390975.953697:0:34455:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79000 going to sleep for 11 seconds 00000004:00080000:1.0:1788390975.953711:0:34454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788390975.954086:0:34454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793061123809ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788390975.954433:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391616 00000100:00100000:1.0:1788390975.954439:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391616 00000100:00100000:1.0:1788390975.954550:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788390975.954561:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:34455:x1875263103391616:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788390975.956560:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103391488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390975.956625:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788390975.956763:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390975.956780:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391488 00000100:00100000:2.0:1788390975.956786:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391488 00000100:00100000:2.0:1788390975.956827:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788390975.956839:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103391488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788390975.956868:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390975.956915:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103391488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390975.956933:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788390975.957000:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d6bc7c9500 x1875263103391488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788390991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788390975.957017:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103391488:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1788390975.963362:0:35112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788390975.963370:0:35112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -31 00002000:02000040:1.0:1788390975.963374:0:35112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) 00002000:00010000:1.0:1788390975.973331:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.973346:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973362:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.973367:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.973372:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973412:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973423:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973431:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973450:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390975.973462:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390975.973467:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973485:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390975.973489:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973499:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973517:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973524:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e2feeab/0x9aafc5f04cd35157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.973549:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.973552:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.973553:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.974037:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.974043:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974051:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.974055:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.974059:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974069:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974077:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974084:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974098:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390975.974106:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390975.974110:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974127:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390975.974131:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974139:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974150:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974156:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000571a9658/0x9aafc5f04cd3515e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974167:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.974169:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.974170:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.974540:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.974547:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974555:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.974558:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.974562:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974571:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974588:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974595:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974608:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390975.974615:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390975.974619:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974625:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390975.974628:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974636:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974645:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974654:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c7d784/0x9aafc5f04cd35165 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.974666:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.974673:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.974675:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.975132:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.975138:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975146:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.975149:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.975154:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975162:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975170:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975177:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975191:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390975.975199:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390975.975203:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975209:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390975.975213:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975232:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975244:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975252:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd3516c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.975266:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.975268:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.975270:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.976162:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.976170:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976179:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.976182:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.976186:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976195:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976201:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976214:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976241:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390975.976453:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.976461:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.976468:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.976481:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.976490:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.976507:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.976515:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.976530:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.976532:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.976534:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.976852:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.976862:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976871:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.976874:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.976878:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976886:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976896:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976903:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.976951:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390975.977315:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.977320:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.977336:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.977339:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.977343:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.977352:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.977361:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.977368:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977691:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390975.977697:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977711:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.977714:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977723:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977736:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977744:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd3517a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977757:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.977761:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977767:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.977770:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977778:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977788:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.977802:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.977804:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.977806:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.977867:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390975.977872:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008230128e/0x9aafc5f04cd35181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390975.978334:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.978340:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.978348:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.978351:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.978356:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.978388:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.978397:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.978405:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.978539:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.978544:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.978552:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.978556:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.978563:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.978574:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.978582:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.978584:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.978586:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.978648:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390975.978653:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecfea741/0x9aafc5f04cd35188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390975.979098:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.979104:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979112:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.979115:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.979119:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979128:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979146:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979153:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.979220:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.979226:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.979234:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.979237:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.979251:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.979263:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.979272:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.979274:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.979275:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.979333:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390975.979339:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086da5b23/0x9aafc5f04cd3518f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788390975.979775:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.979780:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979788:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.979791:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.979795:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979804:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979811:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.979828:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980106:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.980112:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980119:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.980122:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980129:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980140:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980148:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.980149:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.980151:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.980204:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390975.980209:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036e61e71/0x9aafc5f04cd35196 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.980499:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.980757:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.980763:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.980771:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.980774:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.980779:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.980788:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.980796:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.980804:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.980864:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390975.981264:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.981270:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.981278:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.981281:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.981284:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.981293:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.981301:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.981307:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981507:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788390975.981513:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981522:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.981525:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981534:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981549:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981556:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3519d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981572:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.981576:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981582:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.981585:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981594:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981611:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.981619:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.981620:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.981622:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.990683:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788390975.990698:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006857acd6/0x9aafc5f04cd351a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.990729:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.991934:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.991944:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.991993:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.991998:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.992005:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992020:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992028:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992035:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992065:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788390975.992092:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.992099:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992107:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.992111:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992120:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992137:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992144:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb73ae80/0x9aafc5f04cd351ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992157:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.992159:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.992165:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.992565:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.992571:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992580:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.992583:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.992587:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992596:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992613:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992619:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.992640:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788390975.992774:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788390975.992805:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390975.992811:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992819:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390975.992823:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992831:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992842:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992849:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000602fc208/0x9aafc5f04cd351b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390975.992862:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.992863:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390975.992865:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.993081:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.993087:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993095:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.993098:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.993102:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993111:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993119:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993126:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993151:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788390975.993159:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390975.993162:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993169:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788390975.993172:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993179:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993190:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993197:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000724dbc02/0x9aafc5f04cd351b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993209:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.993211:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390975.993212:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.993724:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.993731:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993740:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.993747:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.993751:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993761:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993768:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993776:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.993799:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390975.994064:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390975.994075:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.994082:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390975.994086:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.994094:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.994108:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.994115:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d9827f/0x9aafc5f04cd351c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.994128:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.994130:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.994132:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.994250:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.994256:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994264:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.994267:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.994270:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994279:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994286:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994297:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994319:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390975.994407:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390975.994413:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.994431:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390975.994434:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.994442:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.994455:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.994462:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081467c86/0x9aafc5f04cd351c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.994487:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.994489:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.994491:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.994689:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.994695:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994703:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.994706:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.994710:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994718:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994725:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994732:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.994801:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390975.995004:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390975.995010:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.995018:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390975.995021:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.995038:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.995048:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.995055:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4eb89b/0x9aafc5f04cd351ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.995067:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.995068:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.995070:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.995204:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.995210:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995223:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.995227:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.995231:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995241:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995249:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995257:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995365:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390975.995406:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390975.995410:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.995418:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390975.995421:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.995429:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.995445:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.995453:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000533ac39/0x9aafc5f04cd351d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.995466:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.995468:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.995470:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.995737:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.995743:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995751:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.995755:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.995759:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995768:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995785:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.995791:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.996792:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390975.997262:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.997269:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.997281:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.997284:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.997289:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.997300:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.997308:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.997316:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998496:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788390975.998518:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390975.998533:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390975.998569:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998581:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390975.998586:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998595:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998613:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998630:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fdc2457/0x9aafc5f04cd351dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.998646:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.998649:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390975.998650:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.998986:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.998993:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999001:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.999004:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.999009:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999018:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999026:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999034:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999050:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390975.999397:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.999402:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999410:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.999416:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.999421:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999429:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999436:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999442:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999449:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390975.999638:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390975.999644:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999652:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390975.999656:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999663:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999674:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999681:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b08626/0x9aafc5f04cd351ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999706:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390975.999709:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999716:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390975.999719:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999727:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999737:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999744:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003750344f/0x9aafc5f04cd351f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390975.999756:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.999757:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390975.999759:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390975.999814:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390975.999819:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999827:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390975.999831:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390975.999835:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999844:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999851:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999865:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390975.999884:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788390975.999931:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390975.999936:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.999944:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aac00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390975.999948:0:36261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.999955:0:36261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.999983:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390975.999991:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057124837/0x9aafc5f04cd351f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000008:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000026:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788390976.000029:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000037:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000047:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000055:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036934fe0/0x9aafc5f04cd351e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.000067:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390976.000069:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390976.000070:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390976.000076:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390976.000077:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390976.000079:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.000122:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390976.000289:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.000294:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000303:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.000306:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.000310:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000319:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000327:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000333:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000353:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390976.000387:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390976.000392:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.000399:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.000407:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.000416:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.000426:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.000433:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd351ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.000446:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.000447:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.000449:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390976.000739:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.000745:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000757:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.000760:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.000764:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000772:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000780:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000786:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.000800:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788390976.001188:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.001194:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001201:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.001204:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.001208:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001216:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001233:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001241:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001257:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788390976.001642:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.001648:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001656:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.001659:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.001664:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001673:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001682:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001689:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.001713:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788390976.001829:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788390976.001835:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001843:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aaa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.001847:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001855:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001869:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001880:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001895:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788390976.001899:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001905:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.001907:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001914:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001923:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001929:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008244ceb3/0x9aafc5f04cd3520d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001938:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390976.001941:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001947:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.001955:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001983:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.001994:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002001:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f90bd9/0x9aafc5f04cd35214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002014:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.002015:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.002017:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390976.002093:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.002099:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.002108:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.002111:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.002115:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.002124:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.002131:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.002138:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.002146:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390976.002158:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390976.002177:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390976.002181:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002188:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.002192:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002199:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002210:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002222:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000020d0aa9/0x9aafc5f04cd3521b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.002234:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.002236:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.002238:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390976.003314:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.003323:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003334:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.003342:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.003346:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003356:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003365:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003372:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003390:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390976.003455:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390976.003461:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003468:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.003482:0:34418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003490:0:34418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003502:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003509:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd35222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003521:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.003523:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.003525:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788390976.003798:0:35112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788390976.003804:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003812:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788390976.003815:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788390976.003819:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003828:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003836:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003848:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390976.003868:0:35112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390976.003886:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390976.003891:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003898:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390976.003902:0:34419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003910:0:34419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003921:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003929:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165f498b/0x9aafc5f04cd35229 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.003940:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.003942:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.003944:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390976.004006:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788390976.004055:0:35112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:98 00000100:00100000:1.0:1788390976.004158:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:34455:x1875263103391616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 49595us (50472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390976.004167:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390976.004257:0:34455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34455:1875263103391616:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788390976.004272:0:34455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x62:0x0] 00000100:00100000:0.0:1788390976.004320:0:34455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34455:1875263103391744:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788390976.004359:0:34455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390976.004396:0:34455:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788390976.004402:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391744 00000100:00100000:1.0:1788390976.004409:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391744 00000100:00100000:1.0:1788390976.004456:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390976.004466:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:34455:x1875263103391744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788390976.004511:0:35114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 130 00000100:00100000:1.0:1788390976.008503:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:34455:x1875263103391744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4028us (4133us total) trans 21474836481 rc 0/0 00000100:00100000:1.0:1788390976.008517:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390976.008547:0:34455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:34455:1875263103391744:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788390976.008561:0:34455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x81:0x0]-[0x280000400:0xa1:0x0] 00000040:00080000:2.0:1788390976.142353:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788390976.142369:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390976.142946:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 3 00000040:00080000:2.0:1788390976.142955:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788390976.466208:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390976.467533:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094003840 00000100:00100000:1.0:1788390976.467545:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094003840 00000100:00100000:1.0:1788390976.467598:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788390976.467607:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1875263094003840:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788390976.467636:0:34423:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 58512328-c007-4a40-b0fc-1350e8f2f98e@192.168.202.1@tcp t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:1.0:1788390976.467664:0:34423:0:(genops.c:1385:class_connect()) connect: client 58512328-c007-4a40-b0fc-1350e8f2f98e, cookie 0x9aafc5f04cd35230 00000100:00080000:1.0:1788390976.467802:0:34423:0:(import.c:65:import_set_state_nolock()) ffff95d586b30800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390976.470489:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+5:2355:x1875263094003840:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 2863us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390976.470520:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788390976.477654:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.477999:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094003968 00000100:00100000:0.0:1788390976.478010:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094003968 00000100:00100000:0.0:1788390976.478110:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788390976.478121:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+5:25294:x1875263094003968:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788390976.478138:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390976.478156:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd35237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff6b6 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.478184:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd35237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6b6 expref: 6 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.478195:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd35237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6b6 expref: 6 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.478204:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:0.0:1788390976.478265:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+6:25294:x1875263094003968:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 145us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.478272:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788390976.480233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390976.480305:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004096 00000100:00100000:2.0:1788390976.480329:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004096 00000100:00100000:2.0:1788390976.480384:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788390976.480396:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+6:25294:x1875263094004096:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390976.482874:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+6:25294:x1875263094004096:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 2467us (2636us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788390976.482890:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788390976.484361:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.484548:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004224 00000100:00100000:3.0:1788390976.484559:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004224 00000100:00100000:3.0:1788390976.484636:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1788390976.484644:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+6:25294:x1875263094004224:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390976.484658:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390976.484671:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd3523e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff6bd expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.484705:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd3523e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6bd expref: 7 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.484713:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd3523e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6bd expref: 7 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.484721:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc200, rc 0) 00000100:00100000:3.0:1788390976.484767:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+7:25294:x1875263094004224:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.484778:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788390976.487091:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.487144:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004352 00000100:00100000:3.0:1788390976.487154:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004352 00000100:00100000:3.0:1788390976.487252:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788390976.487262:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6885f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+7:25294:x1875263094004352:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788390976.487564:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6885f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25294:x1875263094004352:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 301us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.487572:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788390976.493164:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.493270:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004480 00000100:00100000:3.0:1788390976.493279:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004480 00000100:00100000:3.0:1788390976.493397:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788390976.493408:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68643f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25294:x1875263094004480:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788390976.493790:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68643f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25294:x1875263094004480:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 383us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.493799:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788390976.499401:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.499643:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004608 00000100:00100000:3.0:1788390976.499666:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004608 00000100:00100000:3.0:1788390976.499724:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788390976.499736:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68643e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25312:x1875263094004608:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390976.500267:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68643e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25312:x1875263094004608:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 532us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.500276:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1788390976.514150:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.520531:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004736 00000100:00100000:3.0:1788390976.520550:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004736 00000100:00100000:3.0:1788390976.520609:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788390976.520617:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68643dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25312:x1875263094004736:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788390976.520892:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68643dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25312:x1875263094004736:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 275us (6753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.520898:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788390976.529430:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.530296:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004864 00000100:00100000:3.0:1788390976.530315:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004864 00000100:00100000:3.0:1788390976.530568:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788390976.530581:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+8:25294:x1875263094004864:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390976.530604:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390976.530624:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd35245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff6e7 expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.530655:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd35245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6e7 expref: 9 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.530664:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd35245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6e7 expref: 9 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.530691:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd400, rc 0) 00000100:00100000:3.0:1788390976.530790:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+9:25294:x1875263094004864:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 211us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.530798:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788390976.533670:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.534078:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094004992 00000100:00100000:0.0:1788390976.534090:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094004992 00000100:00100000:0.0:1788390976.534211:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788390976.534223:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+9:25294:x1875263094004992:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788390976.534257:0:34425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788390976.534288:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788390976.534293:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788390976.534302:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788390976.534305:0:34425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1788390976.537499:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+9:25294:x1875263094004992:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 3263us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.537519:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788390976.541351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.541504:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005120 00000100:00100000:3.0:1788390976.541517:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005120 00000100:00100000:3.0:1788390976.541590:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788390976.541604:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+9:25294:x1875263094005120:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390976.541626:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390976.541649:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff6ee expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.541686:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 10 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.541699:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 10 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390976.541711:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:3.0:1788390976.541786:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25294:x1875263094005120:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 184us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.541794:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:1.0:1788390976.543736:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.545201:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005248 00000100:00100000:0.0:1788390976.545220:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005248 00000100:00100000:0.0:1788390976.545480:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1788390976.545494:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25294:x1875263094005248:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390976.546308:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25294:x1875263094005248:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 814us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.546319:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1788390976.551289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390976.551512:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005376 00000100:00100000:2.0:1788390976.551527:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005376 00000100:00100000:2.0:1788390976.551601:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1788390976.551614:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25294:x1875263094005376:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390976.552070:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25294:x1875263094005376:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 457us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390976.552079:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788390976.555700:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.556275:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005504 00000100:00100000:0.0:1788390976.556290:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005504 00000100:00100000:0.0:1788390976.556698:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788390976.556713:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25317:x1875263094005504:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390976.557128:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25317:x1875263094005504:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 416us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.557137:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1788390976.560485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.560681:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005632 00000100:00100000:0.0:1788390976.560695:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005632 00000100:00100000:0.0:1788390976.560815:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788390976.560828:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25317:x1875263094005632:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390976.561186:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25317:x1875263094005632:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 359us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.561195:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788390976.564603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390976.565010:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005760 00000100:00100000:2.0:1788390976.565024:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005760 00000100:00100000:2.0:1788390976.565082:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390976.565092:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875263094005760:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788390976.565129:0:34432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0b559db7-d4f9-4591-8d87-f7c547dbb07b@192.168.202.1@tcp t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:2.0:1788390976.565190:0:34432:0:(genops.c:1385:class_connect()) connect: client 0b559db7-d4f9-4591-8d87-f7c547dbb07b, cookie 0x9aafc5f04cd35253 00000004:00100000:2.0:1788390976.565229:0:34432:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788390976.565235:0:34432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000100:00080000:3.0:1788390976.621005:0:34432:0:(import.c:65:import_set_state_nolock()) ffff95d5872c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390976.621127:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2355:x1875263094005760:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 56033us (56537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390976.621138:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390976.623890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390976.623998:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.624458:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006016 00000100:00100000:0.0:1788390976.624480:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006016 00000100:00100000:0.0:1788390976.624548:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094005888 00000100:00100000:0.0:1788390976.624552:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094005888 00000100:00100000:0.0:1788390976.624575:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390976.624586:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:25294:x1875263094006016:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390976.624625:0:34431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788390976.624699:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:25294:x1875263094006016:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 115us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.624706:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390976.624722:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390976.624727:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:0:x1875263094005888:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390976.624736:0:34431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788390976.624752:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:0:x1875263094005888:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 25us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.624757:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00080000:1.0:1788390976.624859:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390976.626156:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.626206:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006144 00000100:00100000:0.0:1788390976.626214:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006144 00000100:00100000:0.0:1788390976.626255:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390976.626263:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25294:x1875263094006144:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788390976.626417:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25294:x1875263094006144:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.626424:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390976.629435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390976.629553:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390976.629747:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006272 00000100:00100000:2.0:1788390976.629756:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006272 00000100:00100000:2.0:1788390976.629890:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006400 00000100:00100000:2.0:1788390976.629893:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006400 00000100:00100000:1.0:1788390976.631167:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390976.631177:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263094006272:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788390976.631212:0:35113:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0b559db7-d4f9-4591-8d87-f7c547dbb07b@192.168.202.1@tcp t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:1.0:1788390976.631259:0:35113:0:(genops.c:1385:class_connect()) connect: client 0b559db7-d4f9-4591-8d87-f7c547dbb07b, cookie 0x9aafc5f04cd3525a 00002000:00100000:1.0:1788390976.631272:0:35113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b559db7-d4f9-4591-8d87-f7c547dbb07b/ffff95d586b31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390976.631309:0:35113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390976.631676:0:35113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788390976.631709:0:35113:0:(import.c:65:import_set_state_nolock()) ffff95d586b37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390976.631779:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2355:x1875263094006272:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 601us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390976.631787:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390976.631810:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788390976.631816:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263094006400:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788390976.632389:0:35113:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0b559db7-d4f9-4591-8d87-f7c547dbb07b@192.168.202.1@tcp t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:1.0:1788390976.632413:0:35113:0:(genops.c:1385:class_connect()) connect: client 0b559db7-d4f9-4591-8d87-f7c547dbb07b, cookie 0x9aafc5f04cd35261 00002000:00100000:1.0:1788390976.632421:0:35113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b559db7-d4f9-4591-8d87-f7c547dbb07b/ffff95d586b32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788390976.632428:0:35113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788390976.632569:0:35113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788390976.632588:0:35113:0:(import.c:65:import_set_state_nolock()) ffff95d586b33800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788390976.632619:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2355:x1875263094006400:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 801us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390976.632627:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390976.633035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390976.633077:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006528 00000100:00100000:3.0:1788390976.633084:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006528 00000100:00100000:3.0:1788390976.633122:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390976.633131:0:34434:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788390976.633132:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25294:x1875263094006528:12345-192.168.202.1@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788390976.633141:0:34434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:2.0:1788390976.633749:0:34433:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 555us 00000004:00200000:2.0:1788390976.647509:0:34433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788390976.647937:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25294:x1875263094006528:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 14515us (14612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390976.648019:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390976.827016:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390976.827084:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006656 00000100:00100000:0.0:1788390976.827095:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006656 00000100:00100000:0.0:1788390976.827165:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390976.827191:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25338:x1875263094006656:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1788390976.827214:0:34432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390976.827284:0:34432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd35268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff718 expref: -99 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827350:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827364:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827379:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390976.827417:0:34432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788390976.827421:0:34432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788390976.827457:0:34432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827496:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd35268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff718 expref: 8 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827513:0:34432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff718 expref: 7 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390976.827521:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:0.0:1788390976.827524:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788390976.827527:0:34432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:0.0:1788390976.827587:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:25338:x1875263094006656:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 399us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390976.827604:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:0.0:1788390976.973926:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788390977.516622:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00010000:00010000:0.0:1788390977.997201:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390978.463477:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.463574:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006784 00000100:00100000:2.0:1788390978.463585:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006784 00000100:00100000:2.0:1788390978.463697:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390978.463707:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:25390:x1875263094006784:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:2.0:1788390978.463740:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788390978.463809:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:25390:x1875263094006784:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.463813:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00080000:1.0:1788390978.464092:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788390978.465443:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.465507:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094006912 00000100:00100000:2.0:1788390978.465513:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094006912 00000100:00080000:1.0:1788390978.465561:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788390978.465725:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788390978.465735:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25390:x1875263094006912:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:2.0:1788390978.465767:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788390978.465825:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25390:x1875263094006912:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 91us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.465833:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390978.594388:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.594446:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007040 00000100:00100000:2.0:1788390978.594468:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007040 00000100:00100000:2.0:1788390978.594518:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1788390978.594529:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+10:25421:x1875263094007040:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788390978.594548:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390978.594582:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1fc00/0x9aafc5f04cd35276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff71f expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390978.594627:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1fc00/0x9aafc5f04cd35276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff71f expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390978.594641:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1fc00/0x9aafc5f04cd35276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff71f expref: 11 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390978.594662:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788390978.594777:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007040:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 248us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.594784:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:1.0:1788390978.597492:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.602108:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007168 00000100:00100000:3.0:1788390978.602134:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007168 00000100:00100000:3.0:1788390978.602245:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788390978.602259:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007168:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788390978.605949:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007168:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 3680us (8466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.605997:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788390978.608693:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.608785:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007296 00000100:00100000:2.0:1788390978.608799:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007296 00000100:00100000:2.0:1788390978.608864:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788390978.608875:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007296:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788390978.609220:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007296:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 346us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.609226:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788390978.617559:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.617679:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007424 00000100:00100000:2.0:1788390978.617697:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007424 00000100:00100000:2.0:1788390978.617786:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788390978.617797:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25429:x1875263094007424:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390978.618424:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25429:x1875263094007424:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 628us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.618431:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:1.0:1788390978.630607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.630955:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007552 00000100:00100000:0.0:1788390978.631000:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007552 00000100:00100000:0.0:1788390978.631120:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788390978.631131:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25429:x1875263094007552:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390978.631469:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25429:x1875263094007552:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 339us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.631483:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788390978.637274:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.637927:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007680 00000100:00100000:3.0:1788390978.637943:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007680 00000100:00100000:3.0:1788390978.638074:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788390978.638083:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25421:x1875263094007680:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390978.638102:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390978.638122:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd3527d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff749 expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.638154:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd3527d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff749 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.638163:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd3527d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff749 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.638171:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:3.0:1788390978.638238:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25421:x1875263094007680:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 154us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.638269:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788390978.642095:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.642330:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007808 00000100:00100000:0.0:1788390978.642345:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007808 00000100:00100000:0.0:1788390978.642517:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788390978.642531:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25421:x1875263094007808:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788390978.642567:0:34425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788390978.642599:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788390978.642604:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788390978.642607:0:34425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788390978.642609:0:34425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1788390978.644260:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25421:x1875263094007808:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1721us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.644272:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:1.0:1788390978.647188:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.647488:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094007936 00000100:00100000:3.0:1788390978.647500:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094007936 00000100:00100000:3.0:1788390978.647620:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788390978.647633:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25421:x1875263094007936:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788390978.647656:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390978.647677:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff750 expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.647711:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 13 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.647724:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 13 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.647734:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:3.0:1788390978.647802:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25421:x1875263094007936:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 172us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.647808:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788390978.656205:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.656406:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008064 00000100:00100000:0.0:1788390978.656418:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008064 00000100:00100000:0.0:1788390978.656571:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788390978.656585:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25421:x1875263094008064:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788390978.657049:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25421:x1875263094008064:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 466us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.657070:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788390978.660664:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.660746:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008192 00000100:00100000:3.0:1788390978.660760:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008192 00000100:00100000:3.0:1788390978.660864:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788390978.660874:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25421:x1875263094008192:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788390978.661214:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25421:x1875263094008192:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 341us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.661223:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1788390978.664738:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.665045:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008320 00000100:00100000:0.0:1788390978.665065:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008320 00000100:00100000:0.0:1788390978.665169:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788390978.665181:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25433:x1875263094008320:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788390978.665589:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25433:x1875263094008320:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 405us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.665598:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:1.0:1788390978.672647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.672942:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008448 00000100:00100000:3.0:1788390978.672955:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008448 00000100:00100000:2.0:1788390978.673198:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1788390978.673212:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25433:x1875263094008448:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788390978.673575:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25433:x1875263094008448:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 365us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.673584:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1788390978.680950:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390978.681042:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390978.681066:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390978.681115:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.681306:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009088 00000100:00100000:0.0:1788390978.681318:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009088 00000100:00100000:0.0:1788390978.681391:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009216 00000100:00100000:0.0:1788390978.681394:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009216 00000100:00100000:3.0:1788390978.681409:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008576 00000100:00100000:3.0:1788390978.681414:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008576 00000100:00100000:0.0:1788390978.681423:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390978.681436:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008960 00000100:00100000:0.0:1788390978.681436:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2358:x1875263094009088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390978.681438:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008960 00000100:00100000:3.0:1788390978.681488:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390978.681496:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2358:x1875263094008960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390978.681540:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2358:x1875263094008960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.681540:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2358:x1875263094009088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 106us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.681547:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390978.681548:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390978.681566:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788390978.681566:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390978.681570:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263094008576:12345-192.168.202.1@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788390978.681571:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2358:x1875263094009216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390978.681593:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2358:x1875263094009216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00010000:00080000:3.0:1788390978.681596:0:34430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f8191374-9b73-41ea-ad83-0407a9b7bf5d@192.168.202.1@tcp t0 exp 0000000000000000 cur 795 last 0 00000100:00100000:0.0:1788390978.681619:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000020:00000080:3.0:1788390978.681644:0:34430:0:(genops.c:1385:class_connect()) connect: client f8191374-9b73-41ea-ad83-0407a9b7bf5d, cookie 0x9aafc5f04cd3528b 00000004:00100000:3.0:1788390978.681683:0:34430:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788390978.681810:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390978.681829:0:34430:0:(import.c:65:import_set_state_nolock()) ffff95d69052c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788390978.684654:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2355:x1875263094008576:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 3062us (3698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.684673:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390978.687899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390978.687998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.688107:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008704 00000100:00100000:0.0:1788390978.688119:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008704 00000100:00100000:0.0:1788390978.688209:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094008832 00000100:00100000:0.0:1788390978.688213:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094008832 00000100:00100000:0.0:1788390978.688247:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390978.688259:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+7:0:x1875263094008704:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390978.688324:0:34432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788390978.688412:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+7:0:x1875263094008704:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 154us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.688420:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390978.688442:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390978.688459:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094008832:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788390978.688472:0:34432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788390978.688495:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094008832:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.688502:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00080000:1.0:1788390978.688841:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390978.693100:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.693257:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009344 00000100:00100000:0.0:1788390978.693270:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009344 00000100:00100000:0.0:1788390978.693418:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390978.693431:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094009344:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788390978.693580:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094009344:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 151us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390978.693588:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390978.697228:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.697328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390978.697374:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390978.697950:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009472 00000100:00100000:2.0:1788390978.697986:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009472 00000100:00100000:2.0:1788390978.698044:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009600 00000100:00100000:2.0:1788390978.698047:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009600 00000100:00100000:2.0:1788390978.698073:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788390978.698084:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875263094009472:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788390978.698129:0:35113:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f8191374-9b73-41ea-ad83-0407a9b7bf5d@192.168.202.1@tcp t0 exp 0000000000000000 cur 795 last 0 00000020:00000080:2.0:1788390978.698182:0:35113:0:(genops.c:1385:class_connect()) connect: client f8191374-9b73-41ea-ad83-0407a9b7bf5d, cookie 0x9aafc5f04cd35292 00002000:00100000:2.0:1788390978.698201:0:35113:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f8191374-9b73-41ea-ad83-0407a9b7bf5d/ffff95d68f043800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788390978.698215:0:35113:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788390978.698526:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788390978.698533:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263094009600:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788390978.698552:0:35112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f8191374-9b73-41ea-ad83-0407a9b7bf5d@192.168.202.1@tcp t0 exp 0000000000000000 cur 795 last 0 00000020:00000080:3.0:1788390978.698579:0:35112:0:(genops.c:1385:class_connect()) connect: client f8191374-9b73-41ea-ad83-0407a9b7bf5d, cookie 0x9aafc5f04cd35299 00002000:00100000:3.0:1788390978.698584:0:35112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f8191374-9b73-41ea-ad83-0407a9b7bf5d/ffff95d690529000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788390978.698591:0:35112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788390978.698685:0:35112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788390978.698795:0:35112:0:(import.c:65:import_set_state_nolock()) ffff95d68a71b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788390978.698909:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2355:x1875263094009600:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 373us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.698917:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00002000:00080000:2.0:1788390978.699385:0:35113:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788390978.699409:0:35113:0:(import.c:65:import_set_state_nolock()) ffff95d68f040800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788390978.699445:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2355:x1875263094009472:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 1362us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390978.699464:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390978.700232:0:34434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009728 00000100:00100000:1.0:1788390978.700247:0:34434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009728 00000100:00100000:1.0:1788390978.700488:0:34434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390978.700500:0:34434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094009728:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788390978.700598:0:34434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788390978.700675:0:34434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25421:x1875263094009728:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 178us (3462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390978.700682:0:34434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788390978.789283:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390978.789360:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009856 00000100:00100000:3.0:1788390978.789375:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009856 00000100:00100000:3.0:1788390978.789467:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390978.789480:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:25455:x1875263094009856:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:3.0:1788390978.789509:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390978.789538:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd352a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff77a expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.789632:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.789649:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.789666:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390978.790883:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390978.790891:0:35136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390978.790957:0:35136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.791004:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd352a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 8 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.791023:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 7 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390978.791040:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390978.791042:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390978.791046:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:3.0:1788390978.791219:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8191374-9b73-41ea-ad83-0407a9b7bf5d+7:25455:x1875263094009856:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 1740us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390978.791228:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:0.0:1788390979.021428:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390979.534994:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390979.535022:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103391872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788390979.535105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390979.535189:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103391872 00000100:00100000:0.0:1788390979.535199:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103391872 00000100:00100000:0.0:1788390979.535272:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390979.535281:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103391872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390979.535308:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390979.535360:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103391872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390979.535368:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788390979.535421:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103391872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788390979.535531:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390980.046722:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390980.697206:0:36387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788390981.069159:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788390981.069184:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103392128:0@lo:400:kworker.0 00000100:00100000:2.0:1788390981.069226:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103392256:0@lo:400:kworker.0 00000100:00100000:0.0:1788390981.069256:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390981.069281:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390981.069310:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103392000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390981.069311:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103392768:0@lo:400:kworker.0 00000100:00100000:2.0:1788390981.069344:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390981.069363:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390981.069369:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103392384:0@lo:400:kworker.0 00000100:00100000:2.0:1788390981.069389:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390981.069421:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392768 00000100:00100000:2.0:1788390981.069437:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392768 00000100:00100000:2.0:1788390981.069495:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390981.069506:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103392768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390981.069541:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788390981.069577:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390981.069578:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103392768:12345-0@lo:400:kworker.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390981.069591:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788390981.069612:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392512 00000100:00100000:1.0:1788390981.069615:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788390981.069616:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392512 00000100:00100000:1.0:1788390981.069625:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103392640:0@lo:400:kworker.0 00000100:00100000:2.0:1788390981.069639:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390981.069647:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103392512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390981.069658:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390981.069697:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392128 00000100:00100000:1.0:1788390981.069702:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392128 00000100:00100000:1.0:1788390981.069739:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788390981.069749:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103392128:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788390981.069751:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390981.069777:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392256 00000100:00100000:3.0:1788390981.069782:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392256 00000100:00100000:1.0:1788390981.069786:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103392128:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390981.069794:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788390981.069821:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392384 00000100:00100000:3.0:1788390981.069826:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392384 00000100:00100000:1.0:1788390981.069851:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392640 00000100:00100000:1.0:1788390981.069856:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392640 00000100:00100000:3.0:1788390981.069859:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390981.069870:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103392256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390981.069898:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390981.069907:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103392640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390981.069914:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103392256:12345-0@lo:400:kworker.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390981.069922:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788390981.069939:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788390981.069946:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103392384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390981.069993:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103392384:12345-0@lo:400:kworker.0 Request processed in 48us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390981.070000:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390981.070157:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390981.070206:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103392128:0@lo:400:kworker.0 00000100:00100000:0.0:1788390981.070242:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103392000 00000100:00100000:0.0:1788390981.070246:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103392000 00000100:00100000:0.0:1788390981.070275:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390981.070283:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103392000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788390981.070308:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788390981.070515:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390981.070520:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788390981.070522:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390981.070553:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103392384:0@lo:400:kworker.0 00000100:00100000:3.0:1788390981.070577:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103392256:0@lo:400:kworker.0 00000100:00100000:3.0:1788390981.070594:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103392768:0@lo:400:kworker.0 00000100:00100000:0.0:1788390981.070830:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103392000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 546us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390981.070837:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788390981.070888:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103392000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390981.073118:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103392640:12345-0@lo:400:kworker.0 Request processed in 3207us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390981.073132:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788390981.073189:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103392640:0@lo:400:kworker.0 00000100:00100000:2.0:1788390981.073348:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103392512:12345-0@lo:400:kworker.0 Request processed in 3700us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390981.073357:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788390981.073437:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103392512:0@lo:400:kworker.0 00000001:00100000:2.0:1788390981.107280:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788390981.107305:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000001:00080000:2.0:1788390981.107315:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836481 is committed 00000001:00100000:2.0:1788390981.107417:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000001:00100000:1.0:1788390981.613649:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000001:00100000:1.0:1788390981.613663:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00010000:00010000:0.0:1788390982.093376:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788390982.642346:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000020:00000080:0.0:1788390982.740218:0:36536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6416a270 20000000:00000080:0.0:1788390982.740232:0:36536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d585d4cc00 uarg=0000000000000000 20000000:01000000:0.0:1788390982.740260:0:36536:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390982.740264:0:36536:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788390982.740267:0:36536:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788390982.741152:0:36537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788390982.741226:0:36536:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788390982.741238:0:36536:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788390982.741260:0:36536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741289:0:36536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 18 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741295:0:36536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741299:0:36536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 18 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741305:0:36536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741309:0:36536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741313:0:36536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741349:0:36536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741363:0:36536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 12 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390982.741384:0:36536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103392896:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390982.741505:0:36536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741514:0:36536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390982.741523:0:36536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393024:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390982.741553:0:36536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 18 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741562:0:36536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 18 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390982.741569:0:36536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393152:0@lo:104: 00000100:00100000:3.0:1788390982.741598:0:36536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788390982.741625:0:36536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390982.741632:0:36536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.741632:0:34414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393152 00000100:00100000:0.0:1788390982.741639:0:34414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393152 00000100:00100000:3.0:1788390982.741641:0:36536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393280:0@lo:104: 00000100:00100000:3.0:1788390982.741660:0:36536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390982.741676:0:34414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393280 00010000:00010000:3.0:1788390982.741680:0:36536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 18 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.741680:0:34414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393280 00010000:00010000:3.0:1788390982.741688:0:36536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 18 pid: 34424 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.741698:0:34414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390982.741708:0:34414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+4:36536:x1875263103393152:12345-0@lo:104: 00010000:00010000:0.0:1788390982.741721:0:34414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.741770:0:34414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390982.741777:0:34414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+4:36536:x1875263103393152:12345-0@lo:104: Request processed in 71us (177us total) trans 0 rc 0/0 00010000:00010000:1.0:1788390982.741788:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788390982.741792:0:34414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788390982.741795:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741802:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc1d52c20) 00000100:00100000:0.0:1788390982.741808:0:34414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 10000000:00010000:1.0:1788390982.741811:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.741814:0:34414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:36536:x1875263103393280:12345-0@lo:104: 00010000:00010000:1.0:1788390982.741821:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.741822:0:34414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390982.741829:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390982.741835:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390982.741865:0:34418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741871:0:34418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390982.741883:0:34414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788390982.741889:0:34414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:36536:x1875263103393280:12345-0@lo:104: Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390982.741894:0:34414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788390982.741898:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741904:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92e00/0x9aafc5f04cd3510a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35111 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741916:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788390982.741920:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741925:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788390982.741928:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.741933:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788390982.741949:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390982.741954:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788390982.742006:0:34418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742012:0:34418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788390982.742032:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742039:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63800/0x9aafc5f04cd34fc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34fc8 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742047:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390982.742049:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788390982.742051:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390982.742069:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103393536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390982.742101:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390982.742107:0:36536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393408:0@lo:104: 00000100:00100000:1.0:1788390982.742142:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788390982.742149:0:36536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390982.742153:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103393664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390982.742172:0:36536:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788390982.742183:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390982.742196:0:36536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393152:0@lo:104: 00000100:00100000:3.0:1788390982.742211:0:36536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393280:0@lo:104: 00000100:00100000:1.0:1788390982.742231:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393536 00000100:00100000:1.0:1788390982.742236:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393536 00010000:00010000:1.0:1788390982.742258:0:34415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 19 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.742261:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393664 00000100:00100000:0.0:1788390982.742264:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393664 00010000:00010000:0.0:1788390982.742276:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 20 pid: 34425 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.742290:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788390982.742296:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+20:3287:x1875263103393536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390982.742305:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788390982.742310:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 20 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.742320:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 20 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742327:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390982.742333:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd000/0x9aafc5f04cd35111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd3510a expref: 20 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.742347:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390982.742390:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3287:x1875263103393536:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390982.742456:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103393536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390982.742575:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390982.742579:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788390982.742582:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103393664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390982.742595:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390982.742600:0:34415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742608:0:34415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742618:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd34fc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34fc1 expref: 18 pid: 34425 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742627:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390982.742659:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:3289:x1875263103393664:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390982.742665:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788390982.742678:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103393664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390982.742692:0:34413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788390982.742701:0:34413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393408 00000100:00100000:1.0:1788390982.742704:0:34413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393408 00000100:00100000:1.0:1788390982.742733:0:34413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788390982.742739:0:34413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:36536:x1875263103393408:12345-0@lo:104: 00010000:00010000:1.0:1788390982.742748:0:34413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390982.742796:0:34413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788390982.742802:0:34413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+3:36536:x1875263103393408:12345-0@lo:104: Request processed in 64us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390982.742803:0:36536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393408:0@lo:104: 00000100:00100000:1.0:1788390982.742814:0:34413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788390982.742846:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390982.742851:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742857:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390982.742859:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742864:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390982.742868:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390982.742871:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788390982.742890:0:36261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742894:0:36261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788390982.742921:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788390982.742935:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742942:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0800/0x9aafc5f04cd34f74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd34f7b expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.742958:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390982.742978:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390982.742980:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390982.743023:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103393792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390982.743048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390982.743128:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103393792 00000100:00100000:2.0:1788390982.743136:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103393792 00010000:00010000:2.0:1788390982.743148:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 17 pid: 34424 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390982.743167:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788390982.743172:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:3288:x1875263103393792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390982.743177:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390982.743180:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 17 pid: 34424 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.743186:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 17 pid: 34424 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.743193:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd34f7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd34f74 expref: 17 pid: 34424 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.743200:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390982.743222:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3288:x1875263103393792:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390982.743228:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788390982.743385:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103393792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390982.743627:0:36536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103392896:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390982.743633:0:36536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36536:1875263103393024:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390982.743651:0:36536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.744190:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390982.744223:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094009984 00000100:00100000:1.0:1788390982.744228:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094009984 00010000:00010000:1.0:1788390982.744245:0:34416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 13 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390982.744252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390982.744285:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010112 00000100:00100000:2.0:1788390982.744290:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010112 00010000:00010000:2.0:1788390982.744308:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 14 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390982.744324:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788390982.744332:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+14:2356:x1875263094009984:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390982.744340:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390982.744344:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 14 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744360:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 14 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744372:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35284 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff750 expref: 14 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744382:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390982.744431:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2356:x1875263094009984:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390982.744439:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788390982.744455:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788390982.744461:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:2356:x1875263094010112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390982.744467:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390982.744471:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744479:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744488:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd3524c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6ee expref: 12 pid: 34423 timeout: 899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744495:0:34417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744500:0:34417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744516:0:34417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744520:0:34417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744524:0:34417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744528:0:34417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744531:0:34417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdca00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788390982.744534:0:34417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744538:0:34417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744554:0:34417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390982.744560:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390982.744581:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+11:2356:x1875263094010112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 121us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390982.744585:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:0.0:1788390982.744665:0:36536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.744672:0:36536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390982.744676:0:36536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd352ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.121360:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390983.521700:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.521809:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010240 00000100:00100000:3.0:1788390983.521818:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010240 00000100:00100000:3.0:1788390983.521928:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788390983.521937:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:25909:x1875263094010240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390983.521955:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390983.521993:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd352b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff781 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522056:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522078:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522087:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522097:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522102:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522106:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522456:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522462:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522466:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390983.522484:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788390983.522487:0:35136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390983.522513:0:35136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522520:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522531:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522591:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522598:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.522602:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522609:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522620:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390983.522623:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.522627:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522632:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd352bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522644:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522650:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522655:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522660:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.522669:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522675:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522682:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d686a70f00) 00010000:00010000:3.0:1788390983.522684:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.522688:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522693:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd352c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522724:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd352b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff781 expref: 8 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522734:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff781 expref: 7 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.522739:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788390983.522741:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788390983.522742:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc000, rc 0) 00000100:00100000:3.0:1788390983.522823:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:25909:x1875263094010240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 888us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390983.522828:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:1.0:1788390983.523569:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390983.530127:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.530236:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010496 00000100:00100000:2.0:1788390983.530245:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010496 00000100:00100000:2.0:1788390983.530654:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788390983.530665:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:25909:x1875263094010496:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390983.530698:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.530729:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd352d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff788 expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530796:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530806:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530815:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530824:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530828:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.530832:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531243:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd352e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531250:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd352e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531254:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd352e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.531483:0:34430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788390983.531691:0:34430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531699:0:34430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531704:0:34430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531710:0:34430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.531714:0:34430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531721:0:34430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531733:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788390983.531737:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.531741:0:34430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531747:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd352d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531760:0:34430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531766:0:34430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531772:0:34430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531788:0:34430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.531791:0:34430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531797:0:34430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531805:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d68641e300) 00010000:00010000:2.0:1788390983.531807:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.531810:0:34430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.531816:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd352df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.533521:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd352d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff788 expref: 10 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.533544:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd352e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff788 expref: 9 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.533552:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390983.533555:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.533558:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788390983.533621:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25909:x1875263094010496:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2957us (3499us total) trans 21474836481 rc 0/0 00000100:00100000:2.0:1788390983.533629:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390983.535527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.535802:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010624 00000100:00100000:2.0:1788390983.535820:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010624 00000100:00100000:2.0:1788390983.535867:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788390983.535877:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25909:x1875263094010624:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788390983.535991:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25909:x1875263094010624:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 115us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.535998:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788390983.588291:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390983.588363:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010752 00000100:00100000:1.0:1788390983.588371:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010752 00000100:00100000:1.0:1788390983.588431:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788390983.588442:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25918:x1875263094010752:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390983.588464:0:34432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390983.588486:0:34432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd352f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff78f expref: -99 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588550:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588565:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588578:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588592:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588599:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588606:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588799:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588812:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588818:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588824:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390983.588828:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588834:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588845:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390983.588847:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.588851:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588856:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd352fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588867:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588873:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588878:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588882:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390983.588889:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588894:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588901:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788390983.588903:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.588905:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588911:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd35302 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588943:0:34432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd352f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff78f expref: 10 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.588953:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390983.588955:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.589021:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd352f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff78f expref: 10 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.589032:0:34432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63000, rc 0) 00000100:00100000:1.0:1788390983.589148:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25918:x1875263094010752:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 707us (866us total) trans 0 rc 301/301 00000100:00100000:1.0:1788390983.589156:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788390983.593454:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.593623:0:34439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094010880 00000100:00100000:2.0:1788390983.593632:0:34439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094010880 00000100:00100000:2.0:1788390983.593731:0:34439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788390983.593742:0:34439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25918:x1875263094010880:12345-192.168.202.1@tcp:700:lfs.0 00000100:00100000:2.0:1788390983.593830:0:34439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25918:x1875263094010880:12345-192.168.202.1@tcp:700:lfs.0 Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.593838:0:34439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390983.596089:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.596239:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011136 00000100:00100000:3.0:1788390983.596249:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011136 00000100:00100000:3.0:1788390983.596307:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788390983.596317:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25918:x1875263094011136:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:3.0:1788390983.596383:0:35136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390983.596426:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3526f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff718 expref: 9 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.596445:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390983.596449:0:35136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390983.596645:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.596660:0:35136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 5 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.596669:0:35136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.596702:0:35136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 5 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.596715:0:35136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 5 pid: 35136 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390983.596729:0:35136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:35136:1875263103393920:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390983.596824:0:35136:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390983.599447:0:35136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:35136:1875263103393920:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788390983.599578:0:35136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390983.599805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390983.599898:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011264 00000100:00100000:1.0:1788390983.599910:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011264 00000100:00080000:3.0:1788390983.599957:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788390983.599978:0:34416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 6 pid: 35136 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390983.600098:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788390983.600109:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2357:x1875263094011264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390983.600124:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390983.600131:0:34416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 6 pid: 35136 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600143:0:34416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 6 pid: 35136 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600165:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd352a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff77a expref: 6 pid: 35136 timeout: 900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600176:0:34416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:1.0:1788390983.600180:0:34416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600186:0:34416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600191:0:34416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.600231:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390983.600235:0:35136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.600241:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390983.600321:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2357:x1875263094011264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390983.600329:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00010000:00010000:3.0:1788390983.600402:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.600424:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.600432:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390983.603143:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788390983.603155:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603162:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603167:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603170:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.603174:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603179:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603191:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23d00) 00010000:00010000:3.0:1788390983.603197:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.603201:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.603205:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35309 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788390983.603222:0:35136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2d7f468 reply state 00000000d1c840e2 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390983.603231:0:35136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390983.603520:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+10:25918:x1875263094011136:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 7200us (7436us total) trans 21474836482 rc 0/0 00000100:00100000:3.0:1788390983.603529:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:1.0:1788390983.604755:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604777:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604782:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604785:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390983.604788:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604792:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604801:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff95d686a70f00) 00010000:00010000:1.0:1788390983.604803:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.604806:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.604810:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35310 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390983.610257:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.610462:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011392 00000100:00100000:2.0:1788390983.610473:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011392 00000100:00100000:2.0:1788390983.610570:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390983.610582:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:25919:x1875263094011392:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788390983.610604:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.610629:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff796 expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610692:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610707:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610719:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.610767:0:34430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390983.610771:0:34430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390983.610808:0:34430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610832:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff796 expref: 11 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610851:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff796 expref: 10 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.610859:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390983.610862:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390983.610866:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788390983.610929:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+10:25919:x1875263094011392:12345-192.168.202.1@tcp:101:rm.0 Request processed in 349us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.610936:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390983.614934:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.615059:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011520 00000100:00100000:2.0:1788390983.615070:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011520 00000100:00100000:2.0:1788390983.615133:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390983.615144:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+10:25919:x1875263094011520:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788390983.615162:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.615182:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff79d expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615243:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615275:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615286:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615302:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615309:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615316:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615413:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615420:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615426:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.615452:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390983.615455:0:34431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390983.615471:0:34431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615481:0:34431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615497:0:34431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615502:0:34431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615508:0:34431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.615512:0:34431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615519:0:34431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615530:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390983.615533:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.615537:0:34431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615544:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3532c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615557:0:34431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615563:0:34431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615569:0:34431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615574:0:34431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.615582:0:34431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615588:0:34431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615596:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff95d68641e600) 00010000:00010000:2.0:1788390983.615599:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.615601:0:34431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615606:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615636:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff79d expref: 12 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615648:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff79d expref: 11 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.615655:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390983.615658:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390983.615660:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f400, rc 0) 00000100:00100000:2.0:1788390983.615759:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25919:x1875263094011520:12345-192.168.202.1@tcp:101:rm.0 Request processed in 616us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.615766:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390983.622422:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390983.622651:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011648 00000100:00100000:1.0:1788390983.622662:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011648 00000100:00100000:1.0:1788390983.622727:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390983.622738:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25919:x1875263094011648:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1788390983.622760:0:34432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390983.622781:0:34432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd35341 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7a4 expref: -99 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622881:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622896:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622907:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622921:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622928:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.622935:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623027:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623035:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623042:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623047:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390983.623052:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623070:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623083:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390983.623087:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.623092:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623098:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35348 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623110:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623115:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623121:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623126:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390983.623129:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623135:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623143:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788390983.623146:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.623148:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623164:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd3534f lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623199:0:34432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd35341 lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7a4 expref: 12 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623210:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390983.623212:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390983.623216:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd35341 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7a4 expref: 12 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.623226:0:34432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788390983.623280:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25919:x1875263094011648:12345-192.168.202.1@tcp:101:rm.0 Request processed in 544us (876us total) trans 0 rc 301/301 00000100:00100000:1.0:1788390983.623288:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390983.627114:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.627394:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011776 00000100:00100000:3.0:1788390983.627412:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011776 00000100:00100000:3.0:1788390983.627475:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390983.627486:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25919:x1875263094011776:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788390983.627507:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390983.627527:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35356 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7ab expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627603:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627619:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627630:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627671:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627679:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627687:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627742:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627749:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627755:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627761:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.627766:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627774:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627785:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390983.627789:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.627794:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627799:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc800/0x9aafc5f04cd3535d lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627819:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627826:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627831:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627856:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.627859:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627865:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627872:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff95d686a70000) 00010000:00010000:3.0:1788390983.627874:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.627877:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627908:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35364 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627941:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35356 lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ab expref: 12 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.627951:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390983.627953:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390983.628111:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd35356 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ab expref: 12 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.628122:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdde00, rc 0) 00000100:00100000:3.0:1788390983.628226:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25919:x1875263094011776:12345-192.168.202.1@tcp:101:rm.0 Request processed in 741us (1120us total) trans 0 rc 301/301 00000100:00100000:3.0:1788390983.628233:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788390983.666878:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390983.667029:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094011904 00000100:00100000:1.0:1788390983.667043:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094011904 00000100:00100000:1.0:1788390983.667191:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788390983.667207:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25925:x1875263094011904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390983.667241:0:34432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390983.667276:0:34432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3536b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7b2 expref: -99 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667364:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667381:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667430:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390983.667474:0:34432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390983.667477:0:34432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390983.667524:0:34432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667554:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3536b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7b2 expref: 13 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667574:0:34432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7b2 expref: 12 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390983.667583:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390983.667586:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390983.667590:0:34432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62a00, rc 0) 00000100:00100000:1.0:1788390983.667657:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+12:25925:x1875263094011904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 455us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390983.667664:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788390983.669827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.669906:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094012160 00000100:00100000:2.0:1788390983.669919:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094012160 00000100:00100000:2.0:1788390983.670066:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788390983.670075:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+12:25925:x1875263094012160:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390983.670113:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.670139:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7b9 expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.670245:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788390983.670389:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35379 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7b9 expref: 14 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.670420:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390983.670424:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390983.670430:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7b9 expref: 14 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.670445:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788390983.670495:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25925:x1875263094012160:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 422us (680us total) trans 21474836483 rc 301/301 00000100:00100000:2.0:1788390983.670501:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788390983.673487:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.673570:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094012416 00000100:00100000:2.0:1788390983.673584:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094012416 00000100:00100000:2.0:1788390983.673663:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788390983.673676:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25925:x1875263094012416:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1788390983.673777:0:34430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390983.673813:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35372 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7b2 expref: 13 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.673838:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390983.673844:0:34430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390983.673895:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.673912:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.673924:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390983.674242:0:34430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e22a8817 reply state 0000000018f42922 transno 21474836484 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390983.674254:0:34430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788390983.674264:0:34430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788390983.674372:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25925:x1875263094012416:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 695us (893us total) trans 21474836484 rc 0/0 00000100:00100000:2.0:1788390983.674380:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788390983.676073:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.676422:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094012672 00000100:00100000:2.0:1788390983.676434:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094012672 00000100:00100000:2.0:1788390983.676501:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788390983.676515:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25925:x1875263094012672:12345-192.168.202.1@tcp:35:lfs.0 00010000:00010000:3.0:1788390983.676971:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.676985:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.676992:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.676998:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390983.677004:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.677011:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.677031:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390983.677034:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788390983.677040:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.677046:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd35387 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390983.677216:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25925:x1875263094012672:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 702us (1155us total) trans 21474836485 rc 0/0 00000100:00100000:2.0:1788390983.677225:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390983.679599:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.679724:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094012928 00000100:00100000:3.0:1788390983.679743:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094012928 00000100:00100000:3.0:1788390983.679816:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788390983.679827:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25925:x1875263094012928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390983.679856:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390983.679880:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3538e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7c0 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.680037:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35395 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.680054:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35395 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.680068:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35395 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390983.680081:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788390983.680231:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3538e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c0 expref: 17 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.680252:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35395 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c0 expref: 16 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.680261:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390983.680264:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788390983.680268:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:3.0:1788390983.680692:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:25925:x1875263094012928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 864us (1104us total) trans 21474836486 rc 0/0 00000100:00100000:3.0:1788390983.680701:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788390983.683639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.683793:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013056 00000100:00100000:2.0:1788390983.683808:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013056 00000100:00100000:2.0:1788390983.683939:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788390983.683951:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:25925:x1875263094013056:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788390983.684015:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.684055:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd353a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7c7 expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684141:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684157:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684170:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.684214:0:34430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788390983.684218:0:34430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390983.684239:0:34430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684278:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd353a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c7 expref: 18 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684298:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c7 expref: 17 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.684314:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390983.684317:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390983.684321:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e600, rc 0) 00000100:00100000:2.0:1788390983.684379:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:25925:x1875263094013056:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 432us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.684386:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788390983.687185:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.687270:0:36301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013184 00000100:00100000:3.0:1788390983.687283:0:36301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013184 00000100:00100000:3.0:1788390983.687351:0:36301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390983.687362:0:36301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:25925:x1875263094013184:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:3.0:1788390983.691794:0:36301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:25925:x1875263094013184:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 4416us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390983.691811:0:36301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788390983.799418:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390983.799844:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390983.799884:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390983.799927:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390983.799992:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390983.800028:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013440 00000100:00100000:0.0:1788390983.800039:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013440 00000100:00100000:0.0:1788390983.800123:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013568 00000100:00100000:0.0:1788390983.800127:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013568 00000100:00100000:0.0:1788390983.800143:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013696 00000100:00100000:0.0:1788390983.800146:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013696 00000100:00100000:0.0:1788390983.800157:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013824 00000100:00100000:0.0:1788390983.800160:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013824 00000100:00100000:0.0:1788390983.800187:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390983.800199:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2359:x1875263094013440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390983.800294:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2359:x1875263094013440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390983.800302:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390983.800321:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390983.800327:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2358:x1875263094013568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390983.800352:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2358:x1875263094013568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390983.800359:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390983.800380:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390983.800387:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2359:x1875263094013696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390983.800531:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788390983.800542:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2358:x1875263094013824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390983.800646:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2358:x1875263094013824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 105us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390983.800653:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:3.0:1788390983.800701:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788390983.800706:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788390983.800768:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094013312 00000100:00100000:2.0:1788390983.800781:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094013312 00000100:00100000:2.0:1788390983.800816:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788390983.800824:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:2358:x1875263094013312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390983.800854:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+11:2358:x1875263094013312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390983.800860:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1788390983.801899:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2359:x1875263094013696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1505us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390983.801909:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390983.979851:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390983.979957:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014080 00000100:00100000:2.0:1788390983.979991:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014080 00000100:00100000:2.0:1788390983.980091:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788390983.980104:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:25941:x1875263094014080:12345-192.168.202.1@tcp:101:multiop.0 00010000:00010000:2.0:1788390983.980131:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390983.980134:0:34431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788390983.980171:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd353aa lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c7 expref: 17 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980195:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390983.980200:0:34431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788390983.980216:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd353b1 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7ce expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980376:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980393:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980416:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980456:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980464:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.980472:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981337:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd353c6 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981349:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd353c6 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981357:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd353c6 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390983.981369:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788390983.981411:0:34431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981419:0:34431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981427:0:34431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981437:0:34431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.981442:0:34431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981461:0:34431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981471:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390983.981474:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.981478:0:34431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981484:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd353b8 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788390983.981495:0:34431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a4c2de4 reply state 00000000a40a6691 transno 21474836487 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390983.981504:0:34431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788390983.981535:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd353b1 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ce expref: 19 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981548:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd353c6 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ce expref: 18 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.981555:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788390983.981557:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788390983.981560:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e400, rc 0) 00000100:00100000:2.0:1788390983.981652:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:25941:x1875263094014080:12345-192.168.202.1@tcp:101:multiop.0 Request processed in 1549us (1816us total) trans 21474836487 rc 0/0 00000100:00100000:2.0:1788390983.981661:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00010000:00010000:2.0:1788390983.985642:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985683:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985690:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985695:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390983.985698:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985704:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985720:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff95d68641e600) 00010000:00010000:2.0:1788390983.985723:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390983.985727:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390983.985731:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd353bf lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390983.989070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390983.991332:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014208 00000100:00100000:3.0:1788390983.991500:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014208 00000100:00100000:3.0:1788390983.991631:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788390983.991645:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+11:25308:x1875263094014208:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390983.991677:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390983.991703:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd353d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7d5 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.991738:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd353d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7d5 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.991750:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd353d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7d5 expref: 12 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390983.991783:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdde00, rc 0) 00000100:00100000:3.0:1788390983.991868:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014208:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 226us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390983.991886:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1788390983.997639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390983.997763:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014336 00000100:00100000:1.0:1788390983.997774:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014336 00000100:00100000:1.0:1788390983.997835:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788390983.997843:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014336:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390983.998215:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014336:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 371us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390983.998222:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788390983.999856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390984.000004:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014464 00000100:00100000:3.0:1788390984.000017:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014464 00000100:00100000:3.0:1788390984.000268:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788390984.000279:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014464:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390984.000545:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014464:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 265us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.000554:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788390984.002803:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390984.003007:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014592 00000100:00100000:2.0:1788390984.003020:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014592 00000100:00100000:2.0:1788390984.003203:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1788390984.003214:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+12:25308:x1875263094014592:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390984.003233:0:34423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390984.003255:0:34423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd353db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7dc expref: -99 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.003319:0:34423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd353db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7dc expref: 13 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.003330:0:34423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd353db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7dc expref: 13 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.003339:0:34423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788390984.003412:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25308:x1875263094014592:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 187us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.003420:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1788390984.006320:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390984.006491:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014720 00000100:00100000:3.0:1788390984.006505:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014720 00000100:00100000:3.0:1788390984.006572:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:3.0:1788390984.006585:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25308:x1875263094014720:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390984.007020:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25308:x1875263094014720:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 436us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.007030:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:0.0:1788390984.009316:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390984.009434:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094014848 00000100:00100000:2.0:1788390984.009450:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094014848 00000100:00100000:2.0:1788390984.009539:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788390984.009552:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25308:x1875263094014848:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390984.009880:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:25308:x1875263094014848:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 330us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.009890:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00010000:00010000:2.0:1788390984.141204:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788390984.205117:0:34427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390984.205128:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d5872c5000 from 10 10000000:01000000:1.0:1788390984.205135:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390984.205205:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.205219:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.205232:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390984.205266:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.205359:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.205477:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390984.206208:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394048 00000100:00100000:3.0:1788390984.206221:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394048 00000100:00100000:3.0:1788390984.206294:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788390984.206306:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:34427:x1875263103394048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390984.206322:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390984.206340:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd353e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd353e2 expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.206392:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd353e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd353e2 expref: 17 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.206413:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd353e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd353e2 expref: 17 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.206424:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc800, rc 0) 00000100:00100000:3.0:1788390984.206495:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.206501:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788390984.206618:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390984.206662:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.206674:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390984.206758:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.206791:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.206829:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390984.207273:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394176 00000100:00100000:2.0:1788390984.207280:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394176 00000100:00100000:2.0:1788390984.207318:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788390984.207325:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390984.207637:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.207645:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788390984.207751:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.207796:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.207841:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.207882:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390984.207945:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394304 00000100:00100000:3.0:1788390984.207950:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394304 00000100:00100000:3.0:1788390984.208023:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788390984.208032:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788390984.208327:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.208335:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788390984.208433:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788390984.210596:0:36549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788390984.210830:0:34427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788390984.210878:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788390984.210892:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.210907:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788390984.210921:0:34427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788390984.210925:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d585015800 from 10 10000000:01000000:1.0:1788390984.210928:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788390984.211083:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.211092:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.211105:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390984.211148:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.211236:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.211347:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:2.0:1788390984.212526:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394432 00000100:00100000:2.0:1788390984.212538:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394432 00000100:00100000:2.0:1788390984.212615:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788390984.212626:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:34427:x1875263103394432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788390984.212643:0:34425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390984.212661:0:34425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd353f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd353f0 expref: -99 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.212692:0:34425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd353f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd353f0 expref: 18 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.212703:0:34425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd353f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd353f0 expref: 18 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.212713:0:34425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788390984.212786:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.212794:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788390984.213036:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390984.213074:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.213109:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390984.213183:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.213219:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.213257:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:3.0:1788390984.213306:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394560 00000100:00100000:3.0:1788390984.213311:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394560 00000100:00100000:3.0:1788390984.213345:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788390984.213353:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788390984.213682:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.213690:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788390984.213760:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.213809:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.213853:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.213877:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:0.0:1788390984.214079:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394688 00000100:00100000:0.0:1788390984.214084:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394688 00000100:00100000:0.0:1788390984.214123:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788390984.214131:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788390984.214336:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390984.214343:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788390984.215452:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788390984.216708:0:36550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788390984.216953:0:34427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788390984.217216:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390984.217232:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.217247:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390984.217259:0:34427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788390984.217262:0:34427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586120800 from 10 10000000:01000000:2.0:1788390984.217266:0:34427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788390984.217319:0:34427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.217339:0:34427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.217351:0:34427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390984.217380:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788390984.217472:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390984.217555:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264540 going to sleep for 11 seconds 00000100:00100000:3.0:1788390984.217610:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394816 00000100:00100000:3.0:1788390984.217628:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394816 00000100:00100000:3.0:1788390984.217730:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788390984.217741:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:34427:x1875263103394816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788390984.217756:0:34424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390984.217772:0:34424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd35405 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd353fe expref: -99 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.217800:0:34424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd35405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd353fe expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.217811:0:34424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd35405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd353fe expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390984.217820:0:34424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:3.0:1788390984.217876:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103394816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390984.217883:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788390984.217983:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788390984.218001:0:34427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390984.218011:0:34427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390984.218066:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.218096:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.218224:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6922286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390984.218332:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103394944 00000100:00100000:2.0:1788390984.218336:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103394944 00000100:00100000:2.0:1788390984.218361:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788390984.218368:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103394944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788390984.218682:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103394944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.218690:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788390984.218762:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103394944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.218826:0:34427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103395072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788390984.218868:0:34427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390984.218891:0:34427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6922286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390984.218937:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395072 00000100:00100000:2.0:1788390984.218941:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395072 00000100:00100000:2.0:1788390984.218990:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788390984.218997:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103395072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788390984.219256:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:34427:x1875263103395072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390984.219263:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788390984.219341:0:34427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:34427:1875263103395072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788390984.220712:0:36551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788390984.220928:0:34427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788390984.220952:0:34427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788390984.221265:0:34427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390984.221293:0:34427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390984.333548:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788390984.333559:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390984.333619:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 3 00000040:00080000:2.0:1788390984.333629:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:1.0:1788390984.653300:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390984.653440:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390984.653499:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395200 00000100:00100000:0.0:1788390984.653520:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395200 00000100:00080000:3.0:1788390984.653558:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390984.653598:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788390984.653608:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103395200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390984.653650:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390984.653713:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103395200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390984.653722:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788390984.653761:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788390985.165153:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390986.189218:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788390986.189590:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103395456:0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.189691:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390986.189783:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390986.189800:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103395584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.189851:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390986.189888:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395584 00000100:00100000:3.0:1788390986.189895:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395584 00000100:00100000:3.0:1788390986.189983:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788390986.189994:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103395584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.190065:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103395584:12345-0@lo:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.190088:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788390986.190115:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390986.190156:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103395584:0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.190219:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395456 00000100:00100000:3.0:1788390986.190222:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395456 00000100:00100000:3.0:1788390986.190249:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788390986.190256:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3288:x1875263103395456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.190292:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3288:x1875263103395456:12345-0@lo:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.190298:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788390986.190330:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103395456:0@lo:400:kworker.0 00000100:00100000:1.0:1788390986.191550:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395712:0@lo:400:kworker.0 00000100:00100000:1.0:1788390986.191613:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390986.191655:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390986.191690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390986.191699:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395712 00000100:00100000:0.0:1788390986.191730:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395712 00000100:00100000:1.0:1788390986.191761:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395328 00000100:00100000:1.0:1788390986.191769:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395328 00000100:00100000:0.0:1788390986.191811:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788390986.191825:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103395712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390986.191834:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788390986.191921:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103395712:12345-0@lo:400:kworker.0 Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390986.191931:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390986.192707:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103395328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390986.192757:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:0.0:1788390986.192787:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395712:0@lo:400:kworker.0 00002000:00000024:1.0:1788390986.192924:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788390986.193061:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103395328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788390986.193128:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788390986.193185:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103395328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 488us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390986.193194:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788390986.195562:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390986.195593:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788390986.195617:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103395840:0@lo:400:kworker.0 00000100:00100000:2.0:1788390986.195625:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788390986.195639:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103395968:0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.195729:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788390986.195740:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103396096:0@lo:400:kworker.0 00000100:00100000:0.0:1788390986.195840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390986.195883:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390986.195897:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395840 00000100:00100000:1.0:1788390986.195907:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395840 00000100:00100000:1.0:1788390986.195996:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103396096 00000100:00100000:1.0:1788390986.195999:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103396096 00000100:00100000:3.0:1788390986.196020:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788390986.196035:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103395840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390986.196056:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788390986.196065:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390986.196112:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103395840:12345-0@lo:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00080000:0.0:1788390986.196120:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390986.196123:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103396096:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.196130:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788390986.196164:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103395840:0@lo:400:kworker.0 00000100:00100000:2.0:1788390986.196175:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390986.196193:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103396096:0@lo:400:kworker.0 00000100:00100000:2.0:1788390986.196213:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103395968 00000100:00100000:2.0:1788390986.196218:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103395968 00000100:00080000:0.0:1788390986.196246:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390986.197450:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788390986.199539:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788390986.199569:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103395968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390986.199702:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103395968:12345-0@lo:400:kworker.0 Request processed in 150us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390986.199712:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788390986.199754:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103395968:0@lo:400:kworker.0 00000040:00080000:2.0:1788390986.382003:0:34463:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788390986.382020:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390986.383243:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 1 00000040:00080000:2.0:1788390986.383474:0:34463:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390986.383524:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 1 00000001:00080000:1.0:1788390986.735199:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836487 is committed 00000100:00100000:0.0:1788390986.854474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390986.854553:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094015104 00000100:00100000:3.0:1788390986.854566:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094015104 00000100:00100000:3.0:1788390986.854687:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788390986.854699:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+11:25968:x1875263094015104:12345-192.168.202.1@tcp:101:lfs.0 00000100:00080000:0.0:1788390986.854724:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788390986.854736:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390986.854778:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3540c lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7e3 expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.854922:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35413 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.854941:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35413 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.854955:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35413 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390986.855011:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390986.855495:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3540c lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7e3 expref: 14 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.855513:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35413 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7e3 expref: 13 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.855521:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390986.855523:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390986.855526:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:3.0:1788390986.855602:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25968:x1875263094015104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 905us (1144us total) trans 21474836488 rc 0/0 00000100:00100000:3.0:1788390986.855609:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788390986.857650:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390986.858011:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094015232 00000100:00100000:3.0:1788390986.858035:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094015232 00000100:00100000:3.0:1788390986.858092:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788390986.858100:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25968:x1875263094015232:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390986.858411:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858427:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858438:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858467:0:34430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858475:0:34430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858482:0:34430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858489:0:34430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390986.858494:0:34430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858502:0:34430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858515:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390986.858519:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390986.858524:0:34430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.858541:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35421 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390986.858672:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25968:x1875263094015232:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 570us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.858681:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788390986.865226:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390986.865444:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094015488 00000100:00100000:2.0:1788390986.865458:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094015488 00000100:00100000:2.0:1788390986.865534:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788390986.865547:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c18ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:25968:x1875263094015488:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788390986.866081:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c18ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25968:x1875263094015488:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 533us (879us total) trans 21474836489 rc 0/0 00000100:00100000:2.0:1788390986.866090:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1788390986.921166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390986.921308:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094015744 00000100:00100000:1.0:1788390986.921322:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094015744 00000100:00100000:1.0:1788390986.921416:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1788390986.921431:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:25978:x1875263094015744:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1788390986.921516:0:34432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390986.921556:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35413 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7e3 expref: 14 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390986.921588:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788390986.921594:0:34432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390986.921939:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390986.921956:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390986.922043:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788390986.922116:0:34432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836490 00000004:00010000:1.0:1788390986.922154:0:34432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000772e0bcf reply state 0000000079fa67aa transno 21474836491 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390986.922188:0:34432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390986.922361:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:25978:x1875263094015744:12345-192.168.202.1@tcp:36:bash.0 Request processed in 934us (1209us total) trans 21474836491 rc 0/0 00000100:00100000:1.0:1788390986.922370:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000020:00080000:1.0:1788390986.922385:0:34432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788390986.924864:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.924885:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.924999:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.925096:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390986.925103:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.925112:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.925134:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:0.0:1788390986.925138:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390986.925143:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390986.925150:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62200/0x9aafc5f04cd35428 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390986.925558:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390986.925631:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094015872 00000100:00100000:2.0:1788390986.925648:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094015872 00000100:00100000:2.0:1788390986.925722:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788390986.925735:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+15:25978:x1875263094015872:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788390986.925767:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390986.925787:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3542f lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7ea expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.925908:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.925924:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.925935:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390986.925994:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788390986.926000:0:35136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390986.926039:0:35136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.926069:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3542f lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ea expref: 17 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.926086:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ea expref: 16 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390986.926103:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788390986.926106:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390986.926110:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877aba00, rc 0) 00000100:00100000:2.0:1788390986.926202:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:25978:x1875263094015872:12345-192.168.202.1@tcp:101:bash.0 Request processed in 468us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390986.926210:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788390986.957778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390986.960653:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094016000 00000100:00100000:3.0:1788390986.960672:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094016000 00000100:00100000:3.0:1788390986.960789:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788390986.960800:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:25981:x1875263094016000:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390986.960823:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390986.960847:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3543d lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7f1 expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.960943:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.960957:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.960980:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.960995:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961000:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961013:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961414:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961423:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961430:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390986.961474:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788390986.961480:0:34431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788390986.961503:0:34431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961513:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961520:0:34431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961524:0:34431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961530:0:34431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961534:0:34431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390986.961538:0:34431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961549:0:34431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961560:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390986.961562:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390986.961565:0:34431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961569:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35444 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961580:0:34431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961583:0:34431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961587:0:34431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961590:0:34431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390986.961592:0:34431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961595:0:34431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961598:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff95d686a70a00) 00010000:00010000:3.0:1788390986.961600:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788390986.961601:0:34431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961611:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd3544b lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961640:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3543d lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f1 expref: 18 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961649:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f1 expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.961655:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390986.961656:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390986.961658:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:3.0:1788390986.961887:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:25981:x1875263094016000:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1087us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.961896:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788390986.963625:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390986.963688:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094016128 00000100:00100000:3.0:1788390986.963701:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094016128 00000100:00100000:3.0:1788390986.963828:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788390986.963840:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:2359:x1875263094016128:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390986.963858:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390986.963884:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd35452 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f1 expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390986.963905:0:34415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390986.963910:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390986.963981:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:2359:x1875263094016128:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 125us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390986.964004:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390987.143168:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.143396:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094016384 00000100:00100000:2.0:1788390987.143409:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094016384 00000100:00100000:2.0:1788390987.143529:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788390987.143542:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+16:26011:x1875263094016384:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788390987.143571:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390987.143598:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35459 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7f8 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.143783:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa400/0x9aafc5f04cd35460 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.143800:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa400/0x9aafc5f04cd35460 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.143813:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa400/0x9aafc5f04cd35460 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390987.143828:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788390987.144073:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35459 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f8 expref: 19 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.144121:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa400/0x9aafc5f04cd35460 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f8 expref: 18 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.144131:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788390987.144135:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390987.144139:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877aa400, rc 0) 00000100:00100000:2.0:1788390987.144220:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26011:x1875263094016384:12345-192.168.202.1@tcp:101:cat.0 Request processed in 680us (1065us total) trans 21474836492 rc 0/0 00000100:00100000:2.0:1788390987.144228:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788390987.151566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.151612:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.151699:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094016512 00000100:00100000:3.0:1788390987.151700:0:36301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094016768 00000100:00100000:1.0:1788390987.151714:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094016512 00000100:00100000:3.0:1788390987.151715:0:36301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094016768 00000100:00100000:1.0:1788390987.151786:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788390987.151791:0:36301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390987.151799:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:2358:x1875263094016512:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788390987.151805:0:36301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26011:x1875263094016768:12345-192.168.202.1@tcp:35:cat.0 00010000:00010000:1.0:1788390987.151822:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.151854:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa400/0x9aafc5f04cd35460 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7f8 expref: 19 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.151878:0:34416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788390987.151882:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390987.151944:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:2358:x1875263094016512:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.151950:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788390987.152235:0:36301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26011:x1875263094016768:12345-192.168.202.1@tcp:35:cat.0 Request processed in 435us (620us total) trans 21474836493 rc 0/0 00000100:00100000:3.0:1788390987.152243:0:36301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788390987.184782:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.184850:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017024 00000100:00100000:3.0:1788390987.184864:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017024 00000100:00100000:3.0:1788390987.184947:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788390987.184992:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26014:x1875263094017024:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390987.185135:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390987.185161:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3546e lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff7ff expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.185272:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35475 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.185287:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35475 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.185297:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35475 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788390987.185308:0:34431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788390987.185472:0:34431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3546e lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ff expref: 21 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.185509:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35475 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ff expref: 20 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.185516:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390987.185518:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788390987.185521:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:3.0:1788390987.185582:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26014:x1875263094017024:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 626us (818us total) trans 21474836494 rc 0/0 00000100:00100000:3.0:1788390987.185587:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788390987.188431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.188541:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017152 00000100:00100000:3.0:1788390987.188552:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017152 00000100:00100000:3.0:1788390987.188607:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788390987.188618:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26014:x1875263094017152:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1788390987.188702:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188718:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188729:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188759:0:34430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188767:0:34430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188793:0:34430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188798:0:34430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390987.188802:0:34430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188808:0:34430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188818:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390987.188821:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788390987.188824:0:34430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.188828:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35483 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390987.188927:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26014:x1875263094017152:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 312us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390987.188932:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00010000:00010000:2.0:1788390987.213195:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390987.253555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.253691:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017280 00000100:00100000:1.0:1788390987.253704:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017280 00000100:00100000:1.0:1788390987.253782:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788390987.253805:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26024:x1875263094017280:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788390987.253834:0:34432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390987.253861:0:34432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3548a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff806 expref: -99 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.253997:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.254016:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.254030:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390987.254075:0:34432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390987.254079:0:34432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390987.254102:0:34432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.254133:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd3548a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff806 expref: 22 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.254155:0:34432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff806 expref: 21 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.254165:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390987.254168:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390987.254172:0:34432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f62a00, rc 0) 00000100:00100000:1.0:1788390987.254287:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26024:x1875263094017280:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 485us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.254294:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788390987.257772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.257882:0:34434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017664 00000100:00100000:1.0:1788390987.257894:0:34434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017664 00000100:00100000:1.0:1788390987.258000:0:34434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390987.258074:0:34434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26024:x1875263094017664:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788390987.258718:0:34434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26024:x1875263094017664:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 646us (960us total) trans 21474836495 rc 0/0 00000100:00100000:1.0:1788390987.258728:0:34434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788390987.261261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.261355:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017792 00000100:00100000:3.0:1788390987.261366:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017792 00000100:00100000:3.0:1788390987.261452:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788390987.261474:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26024:x1875263094017792:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788390987.261492:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788390987.261525:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35475 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ff expref: 22 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.261576:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aba00/0x9aafc5f04cd35436 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ea expref: 21 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.261591:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd353c6 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7ce expref: 20 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.261609:0:34415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788390987.261622:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390987.261686:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26024:x1875263094017792:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390987.261694:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788390987.263188:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.263392:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094017920 00000100:00100000:2.0:1788390987.263403:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094017920 00000100:00100000:2.0:1788390987.263498:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788390987.263509:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26024:x1875263094017920:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:2.0:1788390987.263639:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.263659:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.263672:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788390987.264651:0:35136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788390987.264733:0:35136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 64 off8512 00000040:00080000:2.0:1788390987.264815:0:35136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 136 off8328 00000100:00100000:2.0:1788390987.264928:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26024:x1875263094017920:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1419us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390987.264944:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788390987.266696:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.266778:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018048 00000100:00100000:3.0:1788390987.266799:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018048 00000100:00100000:3.0:1788390987.266915:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788390987.266927:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26024:x1875263094018048:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788390987.266954:0:34431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390987.267034:0:34431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff80d expref: -99 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267105:0:34431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 2/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267116:0:34431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 4/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 20 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267140:0:34431:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267169:0:34431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 20 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267186:0:34431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:3.0:1788390987.267190:0:34431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390987.267195:0:34431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 20 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.267204:0:34431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:3.0:1788390987.267279:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26024:x1875263094018048:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 354us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390987.267287:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000040:00080000:2.0:1788390987.405310:0:34463:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788390987.405324:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390987.405381:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:2.0:1788390987.405390:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1788390987.405580:0:34463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:34463:1875263103396224:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390987.405719:0:34463:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390987.410135:0:34463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:34463:1875263103396224:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788390987.410596:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.410716:0:34441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018176 00000100:00100000:1.0:1788390987.410726:0:34441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018176 00000100:00100000:1.0:1788390987.410803:0:34441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390987.410816:0:34441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094018176:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788390987.410921:0:34441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094018176:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.410929:0:34441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788390987.414040:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.414451:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018304 00000100:00100000:3.0:1788390987.414465:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018304 00000100:00100000:3.0:1788390987.414546:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788390987.414559:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26025:x1875263094018304:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390987.414601:0:34430:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390987.414727:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26025:x1875263094018304:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 170us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390987.414735:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788390987.416797:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.417025:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018432 00000100:00100000:1.0:1788390987.417037:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018432 00000100:00100000:1.0:1788390987.417106:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788390987.417120:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26025:x1875263094018432:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788390987.417215:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417236:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417250:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417267:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417297:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417304:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417332:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417341:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417348:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788390987.417412:0:34432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788390987.417418:0:34432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390987.417437:0:34432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417450:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417458:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417466:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417472:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390987.417477:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417493:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417510:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e900) 00010000:00010000:1.0:1788390987.417513:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390987.417519:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417526:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63a00/0x9aafc5f04cd354a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417545:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417551:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417558:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417564:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390987.417567:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417573:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417581:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x29bef300 (ffff95d6a0d59c00) 00010000:00010000:1.0:1788390987.417584:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390987.417587:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417603:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417620:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417626:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417632:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417637:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390987.417640:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417646:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417654:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:1.0:1788390987.417656:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390987.417659:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.417664:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354b4 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.417743:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26025:x1875263094018432:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 625us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.417752:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788390987.419087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.419197:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018688 00000100:00100000:2.0:1788390987.419207:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018688 00000100:00100000:2.0:1788390987.419269:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1788390987.419280:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26025:x1875263094018688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390987.419301:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390987.419323:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa600/0x9aafc5f04cd354bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff814 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419452:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419468:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419485:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390987.419499:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788390987.419635:0:35136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419655:0:35136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419663:0:35136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419669:0:35136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390987.419674:0:35136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419682:0:35136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419695:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:2.0:1788390987.419698:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390987.419703:0:35136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419709:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354c2 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419756:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa600/0x9aafc5f04cd354bb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff814 expref: 22 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419768:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390987.419770:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788390987.419774:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa600/0x9aafc5f04cd354bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff814 expref: 22 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.419784:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877aa600, rc 0) 00000100:00100000:2.0:1788390987.419862:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094018688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 583us (782us total) trans 21474836496 rc 301/301 00000100:00100000:2.0:1788390987.419870:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788390987.422991:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.423382:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094018816 00000100:00100000:3.0:1788390987.423397:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094018816 00000100:00100000:3.0:1788390987.423485:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1788390987.423499:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094018816:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788390987.423570:0:34431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788390987.423726:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094018816:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 228us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390987.423737:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788390987.426269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.426337:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019072 00000100:00100000:3.0:1788390987.426350:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019072 00000100:00100000:3.0:1788390987.426442:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788390987.426456:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094019072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390987.426483:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390987.426486:0:34430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788390987.426526:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62a00/0x9aafc5f04cd35491 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff806 expref: 21 pid: 34432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.426546:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788390987.426552:0:34430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788390987.426569:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd354d0 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff81b expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788390987.428677:0:34430:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x64:0x0], count =30 00000004:00080000:3.0:1788390987.428691:0:34430:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x64:0x0]+30 in llog 00000004:00080000:3.0:1788390987.428751:0:34430:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x82:0x0], index 0: 0 00010000:00010000:3.0:1788390987.429627:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd354d7 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.429646:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd354d7 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.429657:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd354d7 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.429742:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd354d0 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff81b expref: 23 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.429764:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd354d7 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff81b expref: 22 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.429774:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d686a70a00) 00010000:00010000:3.0:1788390987.429777:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788390987.429781:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:3.0:1788390987.430039:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26025:x1875263094019072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3583us (3778us total) trans 21474836497 rc 0/0 00000100:00100000:3.0:1788390987.430050:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788390987.434480:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.434554:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019328 00000100:00100000:1.0:1788390987.434566:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019328 00000100:00100000:1.0:1788390987.434716:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1788390987.434731:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26025:x1875263094019328:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390987.434815:0:34432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.434848:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd354d7 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff81b expref: 22 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.434871:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d686a70a00) 00010000:00010000:1.0:1788390987.434883:0:34432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390987.434917:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.434933:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.434944:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435590:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435618:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435632:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435879:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435900:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435906:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435911:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390987.435916:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435923:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435935:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788390987.435938:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390987.435943:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.435948:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63200/0x9aafc5f04cd354e5 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436001:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436008:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436014:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436019:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788390987.436029:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436036:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436045:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x54151cf5 (ffff95d6a0d59c00) 00010000:00010000:1.0:1788390987.436047:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788390987.436050:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.436055:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63000/0x9aafc5f04cd354ec lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x54151cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.436175:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094019328:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1443us (1701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788390987.436184:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788390987.438182:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.438358:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019456 00000100:00100000:2.0:1788390987.438381:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019456 00000100:00100000:2.0:1788390987.439767:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:2.0:1788390987.439784:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+21:26025:x1875263094019456:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390987.439804:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390987.439824:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa600/0x9aafc5f04cd354f3 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff822 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.439859:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.439872:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.439883:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.440009:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aa600/0x9aafc5f04cd354f3 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 23 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.440026:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 22 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.440034:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390987.440037:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788390987.440047:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877ab600, rc 0) 00000100:00100000:2.0:1788390987.440110:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26025:x1875263094019456:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 331us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390987.440117:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788390987.444141:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.444233:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019712 00000100:00100000:3.0:1788390987.444244:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019712 00000100:00100000:3.0:1788390987.444408:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1788390987.444419:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26025:x1875263094019712:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788390987.444502:0:34431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.444517:0:34431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.444530:0:34431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788390987.444950:0:34431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 88 off8344 00000004:00080000:3.0:1788390987.444991:0:34431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804552029940ns, next at 805551996614ns, rc = 0 00000004:00010000:3.0:1788390987.445084:0:34431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000066c88e1 reply state 000000007650e84e transno 21474836498 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390987.445092:0:34431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788390987.445231:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:26025:x1875263094019712:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 813us (1098us total) trans 21474836498 rc 0/0 00000100:00100000:3.0:1788390987.445240:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788390987.447257:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.447388:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019840 00000100:00100000:3.0:1788390987.447398:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019840 00000100:00100000:3.0:1788390987.447455:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788390987.447464:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:26025:x1875263094019840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390987.447486:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390987.447505:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff829 expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.447569:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 25 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.447584:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 25 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.447604:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788390987.447607:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390987.447612:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00010000:00010000:2.0:1788390987.448055:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448066:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448073:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448079:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788390987.448084:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448091:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448103:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390987.448106:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788390987.448109:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.448115:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd35501 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.448430:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:26025:x1875263094019840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 963us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.448439:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1788390987.449951:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.450062:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094019968 00000100:00100000:3.0:1788390987.450071:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094019968 00000100:00100000:3.0:1788390987.450185:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788390987.450196:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2357:x1875263094019968:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788390987.450591:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2357:x1875263094019968:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 395us (644us total) trans 21474836482 rc 0/0 00000100:00100000:3.0:1788390987.450599:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:0.0:1788390987.451396:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390987.455163:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.455407:0:36301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094020224 00000100:00100000:2.0:1788390987.455417:0:36301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094020224 00000100:00100000:2.0:1788390987.455524:0:36301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788390987.455534:0:36301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:26025:x1875263094020224:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788390987.455810:0:36301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+25:26025:x1875263094020224:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 277us (658us total) trans 21474836499 rc 0/0 00000100:00100000:2.0:1788390987.455819:0:36301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390987.457577:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.458135:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094020480 00000100:00100000:3.0:1788390987.458146:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094020480 00000100:00100000:0.0:1788390987.458381:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390987.458393:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+25:26025:x1875263094020480:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788390987.458547:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+25:26025:x1875263094020480:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 149us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.458555:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788390987.467065:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.467196:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094020608 00000100:00100000:2.0:1788390987.467207:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094020608 00000100:00100000:2.0:1788390987.467270:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1788390987.467280:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+25:26025:x1875263094020608:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788390987.467301:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788390987.467322:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab200/0x9aafc5f04cd3550f lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff830 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467403:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467418:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467430:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788390987.467466:0:35136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788390987.467483:0:35136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467511:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab200/0x9aafc5f04cd3550f lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff830 expref: 27 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467530:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff830 expref: 26 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.467559:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788390987.467562:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788390987.467566:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877aae00, rc 0) 00000100:00100000:2.0:1788390987.467690:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+26:26025:x1875263094020608:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 411us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390987.467698:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1788390987.471755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.475391:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094020736 00000100:00100000:0.0:1788390987.475407:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094020736 00000100:00100000:0.0:1788390987.475522:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788390987.475533:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2356:x1875263094020736:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390987.475559:0:35114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390987.475579:0:35114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff837 expref: -99 pid: 35114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788390987.475625:0:35114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98ae4b, blocks: 0x1 00010000:00010000:0.0:1788390987.475646:0:35114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=804s v=(0 0) 00010000:00010000:0.0:1788390987.475651:0:35114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390987.475660:0:35114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 7 pid: 35114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.475679:0:35114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 7 pid: 35114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.475691:0:35114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:0.0:1788390987.475764:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2356:x1875263094020736:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 233us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.475771:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788390987.480259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.480392:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094020992 00000100:00100000:0.0:1788390987.480410:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094020992 00000100:00100000:0.0:1788390987.480541:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1788390987.480552:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+26:26025:x1875263094020992:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788390987.481000:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+26:26025:x1875263094020992:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 450us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.481006:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788390987.489355:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390987.490674:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021120 00000100:00100000:3.0:1788390987.490686:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021120 00000100:00100000:3.0:1788390987.490778:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788390987.490788:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:26025:x1875263094021120:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788390987.490805:0:35112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788390987.490822:0:35112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff83e expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.490858:0:35112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 8 pid: 35114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.490867:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390987.490872:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788390987.490878:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 8 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.490907:0:35112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 8 pid: 35114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.490920:0:35112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 8 pid: 35114 timeout: 904 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390987.490946:0:35112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35112:1875263103396352:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788390987.491035:0:35112:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68133a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788390987.494507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.494685:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021248 00000100:00100000:2.0:1788390987.494694:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021248 00010000:00010000:2.0:1788390987.494732:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 9 pid: 35114 timeout: 904 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390987.494766:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788390987.494775:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc723050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:2356:x1875263094021248:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390987.494789:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390987.494808:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 9 pid: 35114 timeout: 904 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.494822:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 9 pid: 35114 timeout: 904 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.494853:0:34417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390987.494857:0:34417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788390987.494865:0:34417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 9 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.494893:0:34417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 9 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.494927:0:34417:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 9 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390987.494939:0:34417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:34417:1875263103396480:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788390987.495033:0:34417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a643c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788390987.495517:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002650bcbf/0x9aafc5f04cd3551d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff837 expref: 9 pid: 35114 timeout: 904 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.495533:0:35112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35112:1875263103396352:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390987.495568:0:35112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 8 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.495578:0:35112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:0.0:1788390987.495617:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+8:26025:x1875263094021120:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 4830us (6270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.495624:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788390987.497469:0:34417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:34417:1875263103396480:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390987.497492:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788390987.497532:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc723050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2356:x1875263094021248:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2756us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.497552:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788390987.500623:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.500913:0:35118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021376 00000100:00100000:1.0:1788390987.500927:0:35118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021376 00002000:00100000:1.0:1788390987.501167:0:35118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff95d68f55f800 x1875263094021376/t0(0) o4->0b559db7-d4f9-4591-8d87-f7c547dbb07b@192.168.202.1@tcp:603/0 lens 504/0 e 0 to 0 dl 1788390998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788390987.501183:0:35118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55f800 with x1875263094021376 ext(0->13) 00002000:00010000:1.0:1788390987.501192:0:35118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55f800 00000100:00100000:1.0:1788390987.501949:0:35118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788390987.501985:0:35118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2356:x1875263094021376:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788390987.502691:0:35118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:2356:x1875263094021376:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 730us (2075us total) trans 21474836483 rc 0/0 00000100:00100000:1.0:1788390987.502700:0:35118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:1.0:1788390987.502709:0:35118:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff95d68f55f800 x1875263094021376/t21474836483(0) o4->0b559db7-d4f9-4591-8d87-f7c547dbb07b@192.168.202.1@tcp:603/0 lens 504/448 e 0 to 0 dl 1788390998 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788390987.502718:0:35118:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55f800 with x1875263094021376 ext(0->13) 00002000:00010000:1.0:1788390987.502723:0:35118:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55f800 00000100:00100000:1.0:1788390987.507043:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.512070:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021504 00000100:00100000:2.0:1788390987.512085:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021504 00000100:00100000:2.0:1788390987.512201:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788390987.512213:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+26:26025:x1875263094021504:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788390987.547917:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836495 is committed 00000001:00080000:3.0:1788390987.547942:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836499 is committed 00000004:00080000:3.0:1788390987.547957:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788390987.548016:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26025:x1875263094021504:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 35797us (40972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.548029:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788390987.548203:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103396608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788390987.548255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390987.548714:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103396608 00000100:00100000:0.0:1788390987.548721:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103396608 00000100:00100000:0.0:1788390987.548767:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788390987.548777:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103396608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788390987.548979:0:35313:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 0 -> 14 00002000:00010000:0.0:1788390987.548983:0:35313:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1788390987 00002000:00010000:0.0:1788390987.548986:0:35313:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788390987.548988:0:35313:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1788390987 -> 1788390987 00002000:00010000:0.0:1788390987.548990:0:35313:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788390987.549062:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103396608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (805us total) trans 21474836484 rc 0/0 00000100:00100000:1.0:1788390987.549069:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788390987.549146:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d687861500/2, rc 0, transno 21474836484 00000100:00100000:2.0:1788390987.549152:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103396608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788390987.550849:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.550992:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021632 00000100:00100000:1.0:1788390987.551001:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021632 00000100:00100000:1.0:1788390987.551125:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788390987.551136:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+9:2357:x1875263094021632:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788390987.588999:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836484 is committed 00000001:00080000:3.0:1788390987.589024:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836483 is committed 00000100:00100000:1.0:1788390987.589349:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2357:x1875263094021632:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 38206us (38499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.589363:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788390987.593092:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.594661:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094021888 00000100:00100000:1.0:1788390987.594676:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094021888 00000100:00100000:1.0:1788390987.594756:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788390987.594769:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:26025:x1875263094021888:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788390987.594865:0:34432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.594899:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aae00/0x9aafc5f04cd35516 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff830 expref: 14 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.594926:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390987.594931:0:34432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788390987.595006:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.595020:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.595029:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788390987.595253:0:34432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023128daf reply state 000000002083c10c transno 21474836500 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.595264:0:34432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788390987.595423:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+15:26025:x1875263094021888:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 655us (2345us total) trans 21474836500 rc 0/0 00000100:00100000:1.0:1788390987.595431:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788390987.599176:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.599243:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022016 00000100:00100000:1.0:1788390987.599257:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022016 00010000:00010000:0.0:1788390987.599271:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599283:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599309:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599313:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390987.599317:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599322:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599340:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390987.599343:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788390987.599348:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:0.0:1788390987.599349:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.599358:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd3552b lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.599362:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2356:x1875263094022016:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788390987.599722:0:35114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 14 -> 14 00002000:00010000:1.0:1788390987.599726:0:35114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1788390987 -> 1788390987 00002000:00010000:1.0:1788390987.599729:0:35114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 1788390984 00002000:00010000:1.0:1788390987.599739:0:35114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1788390987 -> 1788390987 00002000:00010000:1.0:1788390987.599741:0:35114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788390987.599819:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2356:x1875263094022016:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 460us (658us total) trans 21474836485 rc 0/0 00000100:00100000:1.0:1788390987.599829:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390987.607192:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.607290:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022272 00000100:00100000:0.0:1788390987.607307:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022272 00000100:00100000:0.0:1788390987.607400:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1788390987.607414:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:26025:x1875263094022272:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788390987.607513:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.607534:0:34430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 14 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.607544:0:34430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 4/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.607609:0:34430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 14 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.607642:0:34430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 14 pid: 35136 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.607661:0:34430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:34430:1875263103396736:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390987.607784:0:34430:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390987.611643:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.611732:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022400 00000100:00100000:1.0:1788390987.611743:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022400 00010000:00010000:1.0:1788390987.611788:0:34416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 5/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 15 pid: 35136 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.611836:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788390987.611847:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+15:2357:x1875263094022400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390987.611866:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.611873:0:34416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 5/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 15 pid: 35136 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.611886:0:34416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 15 pid: 35136 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.611911:0:34416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390987.611916:0:34416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.611925:0:34416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.611930:0:34416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.612026:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390987.612087:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+15:2357:x1875263094022400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 241us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.612094:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00010000:00010000:0.0:1788390987.612442:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877ab600/0x9aafc5f04cd354fa lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff822 expref: 14 pid: 35136 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.612463:0:34430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:34430:1875263103396736:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390987.612490:0:34430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612501:0:34430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612507:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612549:0:34430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612558:0:34430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612564:0:34430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612576:0:34430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390987.612580:0:34430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612585:0:34430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612595:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:0.0:1788390987.612598:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788390987.612602:0:34430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.612609:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd35532 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.612710:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:26025:x1875263094022272:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 5300us (5535us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788390987.612718:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788390987.619541:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.619708:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022528 00000100:00100000:0.0:1788390987.619723:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022528 00000100:00100000:0.0:1788390987.619804:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390987.619816:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+7:2357:x1875263094022528:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788390987.619880:0:35112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.619906:0:35112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 7 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.619941:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788390987.619946:0:35112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788390987.619951:0:35112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.620021:0:35112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 7 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.620039:0:35112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 7 pid: 35112 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.620058:0:35112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35112:1875263103396864:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788390987.620173:0:35112:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788390987.625210:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.625437:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022656 00000100:00100000:1.0:1788390987.625451:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022656 00010000:00010000:1.0:1788390987.625508:0:34417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 8 pid: 35112 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.625557:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390987.625566:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+8:2356:x1875263094022656:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390987.625583:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.625611:0:34417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 8 pid: 35112 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.625628:0:34417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 8 pid: 35112 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.625659:0:34417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390987.625665:0:34417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788390987.625672:0:34417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.625683:0:34417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.625736:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390987.625809:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+8:2356:x1875263094022656:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 243us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.625818:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:0.0:1788390987.626052:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd35524 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff83e expref: 7 pid: 35112 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.626072:0:35112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35112:1875263103396864:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788390987.626098:0:35112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626111:0:35112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626117:0:35112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626156:0:35112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626165:0:35112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626173:0:35112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626181:0:35112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390987.626186:0:35112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626195:0:35112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626210:0:35112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.626217:0:35112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c493e1/0x9aafc5f04cd35539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.626274:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2357:x1875263094022528:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 6460us (6750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.626291:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788390987.630541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.630787:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094022912 00000100:00100000:1.0:1788390987.630800:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094022912 00000100:00100000:1.0:1788390987.630874:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788390987.630884:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:26025:x1875263094022912:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788390987.631012:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631033:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631048:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631308:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631317:0:34432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 14 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631324:0:34432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 4/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631376:0:34432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 14 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.631405:0:34432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 14 pid: 34430 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.631423:0:34432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:34432:1875263103396992:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788390987.631523:0:34432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788390987.639053:0:34432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:34432:1875263103396992:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788390987.639096:0:34432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788390987.640692:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.640860:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094023040 00000100:00100000:1.0:1788390987.640874:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094023040 00010000:00010000:1.0:1788390987.640928:0:34416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 15 pid: 34430 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.641476:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390987.641491:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+15:2356:x1875263094023040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390987.641510:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390987.641519:0:34416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 15 pid: 34430 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641534:0:34416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 15 pid: 34430 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641694:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc600/0x9aafc5f04cd35508 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff829 expref: 15 pid: 34430 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641794:0:34416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:1.0:1788390987.641801:0:34416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641812:0:34416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641821:0:34416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 4/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390987.641867:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788390987.642039:0:34432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390987.642040:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+14:2356:x1875263094023040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 550us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.642057:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:0.0:1788390987.642057:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788390987.642282:0:34432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836501 00000001:00080000:0.0:1788390987.642458:0:34432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836502 00000001:00080000:0.0:1788390987.642510:0:34432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836503 00000100:00100000:0.0:1788390987.642614:0:34432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:34432:1875263103397120:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788390987.642825:0:34432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390987.642885:0:34432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788390987.642912:0:34435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103397120 00000100:00100000:1.0:1788390987.642922:0:34435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103397120 00000100:00100000:1.0:1788390987.643010:0:34435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788390987.643020:0:34435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:34432:x1875263103397120:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788390987.643144:0:34435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:34432:x1875263103397120:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.643151:0:34435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788390987.643931:0:34432:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836484 gen 2 00000004:00080000:2.0:1788390987.643941:0:34432:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d687861500, transno 21474836484 00000100:00100000:2.0:1788390987.644006:0:34432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:34432:1875263103397120:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788390987.651087:0:34432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836504 00000100:00100000:3.0:1788390987.651251:0:34432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:34432:1875263103397248:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788390987.651355:0:34432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390987.651408:0:34432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a64900 going to sleep for 11 seconds 00000100:00100000:0.0:1788390987.651702:0:34436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103397248 00000100:00100000:0.0:1788390987.651722:0:34436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103397248 00000100:00100000:0.0:1788390987.651857:0:34436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788390987.651879:0:34436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:34432:x1875263103397248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788390987.652263:0:34436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:34432:x1875263103397248:12345-0@lo:1000:mdt00_002.0 Request processed in 387us (908us total) trans 21474836486 rc 0/0 00000100:00100000:0.0:1788390987.652272:0:34436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788390987.652408:0:34432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:34432:1875263103397248:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788390987.652471:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652485:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652496:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652503:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390987.652509:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652540:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652568:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788390987.652572:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390987.652579:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652586:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd35547 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652644:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652651:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652657:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652662:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788390987.652665:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652672:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652679:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:3.0:1788390987.652682:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788390987.652691:0:34432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652715:0:34432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652725:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390987.652795:0:34432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 17 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390987.652810:0:34432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:34432:1875263103397376:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788390987.652908:0:34432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6868b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788390987.659139:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.659208:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094023168 00000100:00100000:0.0:1788390987.659234:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094023168 00000100:00100000:0.0:1788390987.659349:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390987.659359:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26024:x1875263094023168:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:0.0:1788390987.659541:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+18:26024:x1875263094023168:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 183us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390987.659550:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390987.662648:0:34432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:34432:1875263103397376:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788390987.662682:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662694:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aac00/0x9aafc5f04cd35498 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662732:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662746:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662757:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662767:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662772:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662778:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662783:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390987.662787:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662793:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662815:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:0.0:1788390987.662831:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788390987.662835:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662841:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3554e lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662853:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662858:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662864:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662869:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390987.662872:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662877:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662885:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:0.0:1788390987.662887:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390987.662889:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.662895:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f62000/0x9aafc5f04cd35540 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390987.663381:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:26025:x1875263094022912:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 32487us (32844us total) trans 21474836505 rc 0/0 00000100:00100000:0.0:1788390987.663401:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000020:00080000:0.0:1788390987.663408:0:34432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788390987.663735:0:34463:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788390987.663739:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788390987.663755:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:1.0:1788390987.663760:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1788390987.667683:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390987.667785:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094023424 00000100:00100000:1.0:1788390987.667795:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094023424 00000100:00100000:1.0:1788390987.667867:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788390987.667890:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:26024:x1875263094023424:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:1.0:1788390987.668323:0:35136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].2, 136 off8464 00000100:00100000:1.0:1788390987.668426:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:26024:x1875263094023424:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 538us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390987.668444:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788390987.677686:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390987.677836:0:36301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094023680 00000100:00100000:2.0:1788390987.677846:0:36301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094023680 00000100:00100000:2.0:1788390987.677907:0:36301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788390987.677917:0:36301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+17:26025:x1875263094023680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788390987.678808:0:36301:0:(mdd_object.c:4014:mdd_close()) Object [0x200002341:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788390987.678919:0:36301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836506 00010000:00010000:2.0:1788390987.678991:0:36301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679008:0:36301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679021:0:36301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679030:0:36301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679037:0:36301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679044:0:36301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390987.679072:0:36301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390987.679097:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390987.679104:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.679110:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aaa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788390987.679114:0:36261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.679119:0:36261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.679129:0:36261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:0.0:1788390987.679132:0:36261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788390987.679135:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 1/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.679139:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d5877aaa00/0x9aafc5f04cd35555 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 36301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390987.679154:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390987.679155:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390987.679156:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390987.679256:0:36301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:26025:x1875263094023680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1337us (1576us total) trans 21474836507 rc 0/0 00000100:00100000:2.0:1788390987.679266:0:36301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000020:00080000:2.0:1788390987.679512:0:36301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788390987.765427:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390987.765547:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094023936 00000100:00100000:0.0:1788390987.765557:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094023936 00000100:00100000:0.0:1788390987.765612:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788390987.765620:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+19:25941:x1875263094023936:12345-192.168.202.1@tcp:35:multiop.0 00000100:00100000:0.0:1788390987.768257:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:25941:x1875263094023936:12345-192.168.202.1@tcp:35:multiop.0 Request processed in 2625us (2827us total) trans 21474836508 rc 0/0 00000100:00100000:0.0:1788390987.768286:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00010000:00010000:0.0:1788390988.240892:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788390988.687666:0:34463:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788390988.687679:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788390988.687747:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:2.0:1788390988.687756:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1788390988.687917:0:34463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:34463:1875263103397504:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788390988.688067:0:34463:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:3.0:1788390988.690122:0:34463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:34463:1875263103397504:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788390988.691375:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390988.691731:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094024064 00000100:00100000:0.0:1788390988.691743:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094024064 00000100:00080000:3.0:1788390988.691799:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390988.692141:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1788390988.692155:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26175:x1875263094024064:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788390988.692204:0:34431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788390988.692335:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26175:x1875263094024064:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 182us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390988.692343:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788390988.695172:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390988.696662:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094024320 00000100:00100000:0.0:1788390988.696682:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094024320 00000100:00100000:0.0:1788390988.696762:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1788390988.696774:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+20:26175:x1875263094024320:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788390988.696801:0:35136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788390988.696828:0:35136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3555c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff845 expref: -99 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.696992:0:35136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd35563 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.697009:0:35136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd35563 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.697023:0:35136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd35563 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788390988.697037:0:35136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 14 00010000:00010000:0.0:1788390988.697225:0:35136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3555c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff845 expref: 23 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.697244:0:35136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd35563 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff845 expref: 22 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.697254:0:35136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:0.0:1788390988.697257:0:35136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788390988.697261:0:35136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92e00, rc 0) 00000100:00100000:0.0:1788390988.697345:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26175:x1875263094024320:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 572us (2187us total) trans 21474836509 rc 0/0 00000100:00100000:0.0:1788390988.697353:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788390988.711000:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390988.711059:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094024576 00000100:00100000:0.0:1788390988.711074:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094024576 00000100:00100000:0.0:1788390988.711163:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1788390988.711178:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+22:26175:x1875263094024576:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788390988.711479:0:34432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.711502:0:34432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.711516:0:34432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.711774:0:34432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.711781:0:34432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.712806:0:34432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.712814:0:34432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788390988.712820:0:34432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.712829:0:34432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.712850:0:34432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:0.0:1788390988.712853:0:34432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788390988.712858:0:34432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390988.712864:0:34432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd35571 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788390988.713601:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+23:26175:x1875263094024576:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 2418us (2639us total) trans 21474836510 rc 0/0 00000100:00100000:0.0:1788390988.713616:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000040:00080000:3.0:1788390988.716476:0:34463:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788390988.716490:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390988.716531:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:3.0:1788390988.716540:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1788390988.718790:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390988.718893:0:36301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094024832 00000100:00100000:0.0:1788390988.718904:0:36301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094024832 00000100:00100000:0.0:1788390988.718982:0:36301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788390988.718992:0:36301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+23:26175:x1875263094024832:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390988.719247:0:36301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:26175:x1875263094024832:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 256us (469us total) trans 21474836511 rc 0/0 00000100:00100000:0.0:1788390988.719255:0:36301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788390988.918886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390988.919015:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025088 00000100:00100000:1.0:1788390988.919030:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025088 00000100:00100000:2.0:1788390988.919061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390988.919108:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788390988.919121:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2356:x1875263094025088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788390988.919535:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+6:2356:x1875263094025088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 415us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390988.919545:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390988.919691:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094024960 00000100:00100000:0.0:1788390988.919697:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094024960 00000100:00100000:0.0:1788390988.919741:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788390988.919750:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2357:x1875263094024960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390988.919803:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2357:x1875263094024960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390988.919811:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788390988.922116:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390988.922154:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390988.922177:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390988.922197:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390988.922252:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025600 00000100:00100000:0.0:1788390988.922275:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025600 00000100:00100000:3.0:1788390988.922345:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025216 00000100:00100000:3.0:1788390988.922349:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025216 00000100:00100000:0.0:1788390988.922352:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025472 00000100:00100000:0.0:1788390988.922369:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025472 00000100:00100000:3.0:1788390988.922402:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1788390988.922408:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390988.922414:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094025600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788390988.922414:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390988.922466:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788390988.922470:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025344 00000100:00100000:2.0:1788390988.922476:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390988.922478:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025344 00000100:00100000:0.0:1788390988.922482:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2357:x1875263094025216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390988.922494:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2357:x1875263094025472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390988.922532:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094025600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390988.922539:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2357:x1875263094025472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390988.922540:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2357:x1875263094025216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390988.922544:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390988.922549:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788390988.922556:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788390988.922566:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094025344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788390988.922581:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390988.922623:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094025344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390988.922631:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788390988.922637:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:0.0:1788390989.261109:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390989.773177:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103397632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788390989.773255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390989.773378:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103397632 00000100:00100000:2.0:1788390989.773388:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103397632 00000100:00100000:2.0:1788390989.773472:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788390989.773484:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103397632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788390989.773518:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788390989.773569:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103397632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390989.773576:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390989.773623:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103397632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788390989.773790:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788390990.289296:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390990.653745:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390990.653907:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025728 00000100:00100000:3.0:1788390990.653924:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025728 00000100:00100000:3.0:1788390990.654095:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788390990.654109:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:25909:x1875263094025728:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788390990.654268:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:25909:x1875263094025728:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 162us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390990.654275:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00080000:0.0:1788390990.654398:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390990.656042:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390990.656079:0:34433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094025984 00000100:00100000:0.0:1788390990.656090:0:34433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094025984 00000100:00100000:0.0:1788390990.656158:0:34433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788390990.656169:0:34433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+24:25909:x1875263094025984:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788390990.656484:0:34433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b559db7-d4f9-4591-8d87-f7c547dbb07b+25:25909:x1875263094025984:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 316us (450us total) trans 21474836512 rc 0/0 00000100:00100000:0.0:1788390990.656493:0:34433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788390990.804569:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390990.804749:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026112 00000100:00100000:1.0:1788390990.804764:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026112 00000100:00100000:1.0:1788390990.804879:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788390990.804893:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:26480:x1875263094026112:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1788390990.804944:0:34430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788390990.804997:0:34430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd35578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff84c expref: -99 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805097:0:34430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805115:0:34430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805129:0:34430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788390990.805142:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788390990.805175:0:34430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788390990.805179:0:34430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788390990.805227:0:34430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805256:0:34430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63800/0x9aafc5f04cd35578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff84c expref: 7 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805289:0:34430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff84c expref: 6 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390990.805300:0:34430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788390990.805303:0:34430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788390990.805307:0:34430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63600, rc 0) 00000100:00100000:1.0:1788390990.805398:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:26480:x1875263094026112:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 509us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390990.805405:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788390991.309299:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788390991.309321:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103398144:0@lo:400:kworker.0 00000100:00100000:2.0:1788390991.309499:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103397888:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.310558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390991.310623:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.310655:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390991.310684:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103398016:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.310708:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390991.310727:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103398528:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.310746:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390991.310774:0:35116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103397760 00000100:00100000:3.0:1788390991.310781:0:35116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103397760 00000100:00100000:1.0:1788390991.310928:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398272 00000100:00100000:1.0:1788390991.310933:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398272 00000100:00100000:1.0:1788390991.310995:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398528 00000100:00100000:1.0:1788390991.310998:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398528 00000100:00100000:3.0:1788390991.311024:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398016 00000100:00100000:3.0:1788390991.311030:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398016 00000100:00100000:1.0:1788390991.311037:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390991.311050:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103398272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.311070:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390991.311110:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103398272:12345-0@lo:400:kworker.0 Request processed in 63us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390991.311118:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788390991.311160:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788390991.311166:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103398528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390991.311201:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103398528:12345-0@lo:400:kworker.0 Request processed in 34us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390991.311208:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788390991.311240:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788390991.311244:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390991.311317:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103398016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.311422:0:35116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788390991.311431:0:35116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103397760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390991.311459:0:35116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788390991.311530:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788390991.311540:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390991.311600:0:35116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103397760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390991.311610:0:35116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390991.311619:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398144 00000100:00100000:1.0:1788390991.311627:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398144 00000100:00100000:3.0:1788390991.311664:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103398528:0@lo:400:kworker.0 00000100:00100000:1.0:1788390991.311680:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788390991.311693:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103398144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.311746:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103398016:12345-0@lo:400:kworker.0 Request processed in 669us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390991.311754:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788390991.311763:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103398144:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390991.311773:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788390991.311892:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103398016:0@lo:400:kworker.0 00000100:00100000:1.0:1788390991.312298:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103398144:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.312309:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788390991.312352:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788390991.312983:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390991.313143:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103397888 00000100:00100000:0.0:1788390991.313154:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103397888 00000100:00100000:0.0:1788390991.313205:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788390991.313217:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103397888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390991.313472:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103398400:0@lo:400:kworker.0 00000100:00100000:2.0:1788390991.313522:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390991.313692:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390991.313792:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103397888:12345-0@lo:400:kworker.0 Request processed in 577us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390991.313801:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788390991.313886:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103397888:0@lo:400:kworker.0 00000100:00100000:1.0:1788390991.313953:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398400 00000100:00100000:1.0:1788390991.314120:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398400 00000100:00100000:1.0:1788390991.314224:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788390991.314381:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103398400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788390991.314599:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103398400:12345-0@lo:400:kworker.0 Request processed in 220us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390991.314608:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788390991.314658:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788390991.314705:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103398400:0@lo:400:kworker.0 00010000:00010000:0.0:1788390992.336119:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788390992.437253:0:36737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2b: Test multi remote open when creating ========================================================== 19:16:31 (1788390991) 00000001:00080000:3.0:1788390992.890211:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836486 is committed 00000001:00080000:3.0:1788390992.890234:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836485 is committed 00000001:00080000:1.0:1788390992.892506:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836512 is committed 00000020:00080000:1.0:1788390992.892832:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a70569c0 refcount 2 committed 0 result 0 batchid 17179869275 00000020:00080000:1.0:1788390992.892841:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68133a3c0 00000020:00080000:1.0:1788390992.892845:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5880ba000 00000020:00080000:2.0:1788390992.892887:0:34467:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17179869275 committed batchid 12884902008 00000020:00080000:2.0:1788390992.893459:0:34467:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00000001:02000400:3.0:1788390993.198617:0:36788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_2b Need 2 or more clients, have 1 00010000:00010000:0.0:1788390993.357434:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788390993.985879:0:36836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 19:16:33 (1788390993) 00000100:00100000:3.0:1788390994.042265:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390994.042348:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390994.042370:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026368 00000100:00100000:3.0:1788390994.042386:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390994.042387:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026368 00000100:00100000:3.0:1788390994.042428:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390994.042455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390994.042480:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026624 00000100:00100000:2.0:1788390994.042486:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026624 00000100:00100000:0.0:1788390994.042496:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390994.042513:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+12:2356:x1875263094026368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390994.042536:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390994.042538:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026880 00000100:00100000:2.0:1788390994.042543:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026880 00000100:00100000:3.0:1788390994.042578:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390994.042578:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026496 00000100:00100000:2.0:1788390994.042583:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026496 00000100:00100000:2.0:1788390994.042607:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027008 00000100:00100000:2.0:1788390994.042611:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027008 00000100:00100000:3.0:1788390994.042626:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788390994.042627:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+12:2356:x1875263094026368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 118us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390994.042642:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2356:x1875263094026624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788390994.042648:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788390994.042651:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788390994.042663:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094026880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390994.042676:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026752 00000100:00100000:3.0:1788390994.042682:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2356:x1875263094026624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390994.042682:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026752 00000100:00100000:3.0:1788390994.042692:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788390994.042711:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094026880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390994.042717:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788390994.042725:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788390994.042730:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2356:x1875263094026496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788390994.042732:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788390994.042748:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788390994.042755:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2356:x1875263094026752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390994.042765:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2356:x1875263094026496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390994.042765:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094027008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788390994.042777:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788390994.042797:0:34425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094026240 00000100:00100000:3.0:1788390994.042800:0:34425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094026240 00000100:00100000:0.0:1788390994.042804:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2356:x1875263094026752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390994.042812:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2356:x1875263094027008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390994.042826:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788390994.042830:0:34425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788390994.042832:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788390994.042841:0:34425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2356:x1875263094026240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788390994.042856:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788390994.042863:0:34425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2356:x1875263094026240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00080000:2.0:1788390994.042863:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788390994.042868:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788390994.042872:0:34425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00010000:00010000:2.0:1788390994.381718:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390994.893222:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103398656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788390994.893569:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788390994.894392:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398656 00000100:00100000:0.0:1788390994.894404:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398656 00000100:00100000:0.0:1788390994.894476:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788390994.894486:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103398656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788390994.894530:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788390994.894591:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103398656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390994.894598:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788390994.894619:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788390994.894653:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 2 00000004:00080000:0.0:1788390994.894660:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836486 committed transno 21474836486 00000100:00100000:0.0:1788390994.894690:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103398656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788390995.405226:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390995.657247:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390995.657343:0:34434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027264 00000100:00100000:1.0:1788390995.657354:0:34434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027264 00000100:00100000:1.0:1788390995.657426:0:34434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788390995.657441:0:34434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+12:26993:x1875263094027264:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:1.0:1788390995.659554:0:34434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:26993:x1875263094027264:12345-192.168.202.1@tcp:35:umount.0 Request processed in 2111us (2310us total) trans 21474836513 rc 0/0 00000100:00100000:1.0:1788390995.659567:0:34434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788390995.661382:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390995.661524:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027392 00000100:00100000:3.0:1788390995.661532:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027392 00000100:00100000:3.0:1788390995.661588:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390995.661598:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2359:x1875263094027392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788390995.661613:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788390995.661631:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd3523e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6bd expref: 13 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390995.661661:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788390995.661704:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58512328-c007-4a40-b0fc-1350e8f2f98e+12:2359:x1875263094027392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390995.661712:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788390995.663379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390995.663411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390995.663439:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027520 00000100:00100000:1.0:1788390995.663447:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027520 00000100:00100000:0.0:1788390995.663479:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027648 00000100:00100000:0.0:1788390995.663485:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027648 00000100:00100000:3.0:1788390995.663491:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390995.663521:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027776 00000100:00100000:3.0:1788390995.663526:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027776 00000100:00100000:1.0:1788390995.663561:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788390995.663566:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788390995.663574:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+13:2356:x1875263094027520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788390995.663579:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2355:x1875263094027776:12345-192.168.202.1@tcp:9:umount.0 00010000:00010000:1.0:1788390995.663588:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390995.663606:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd35245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6e7 expref: 13 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788390995.663608:0:35113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35261 00000100:00080000:3.0:1788390995.663625:0:35113:0:(import.c:65:import_set_state_nolock()) ffff95d586b33800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788390995.663651:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1788390995.663671:0:35113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00010000:00010000:0.0:1788390995.663673:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390995.663705:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+12:2356:x1875263094027520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390995.663714:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788390995.663732:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788390995.663739:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+11:2358:x1875263094027648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390995.663757:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390995.663767:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f200/0x9aafc5f04cd353db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7dc expref: 11 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390995.663778:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390995.663803:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+10:2358:x1875263094027648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 65us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390995.663810:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788390995.664129:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+2:2355:x1875263094027776:12345-192.168.202.1@tcp:9:umount.0 Request processed in 554us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390995.664136:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788390995.666188:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788390995.666331:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094027904 00000100:00100000:2.0:1788390995.666341:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094027904 00000100:00100000:2.0:1788390995.666396:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788390995.666407:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+5:2355:x1875263094027904:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:2.0:1788390995.666436:0:35313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3525a 00000100:00080000:2.0:1788390995.666457:0:35313:0:(import.c:65:import_set_state_nolock()) ffff95d586b37000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390995.666499:0:35313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00010000:00010000:0.0:1788390995.666509:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390995.666790:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b559db7-d4f9-4591-8d87-f7c547dbb07b+2:2355:x1875263094027904:12345-192.168.202.1@tcp:9:umount.0 Request processed in 384us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390995.666810:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788390995.676230:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390995.676546:0:34431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094028672 00000100:00100000:0.0:1788390995.676555:0:34431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094028672 00000100:00100000:0.0:1788390995.676616:0:34431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1788390995.676626:0:34431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+13:2355:x1875263094028672:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1788390995.676666:0:34431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35253 00000020:00010000:0.0:1788390995.676680:0:34431:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d68f044800: total 0 00000100:00080000:0.0:1788390995.676683:0:34431:0:(import.c:65:import_set_state_nolock()) ffff95d5872c1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788390995.676708:0:34431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836513 00000020:00010000:2.0:1788390995.676731:0:34419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d68f044800: total 0 00010000:00010000:2.0:1788390995.676791:0:34419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d68f044800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788390995.676826:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:2.0:1788390995.676830:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788390995.676838:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd35563 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff845 expref: 12 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.676858:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390995.676860:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390995.676864:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3531e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff796 expref: 11 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.676878:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788390995.676880:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390995.676884:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd352ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff781 expref: 10 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.676901:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390995.676904:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788390995.676908:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35395 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7c0 expref: 9 pid: 35136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.676919:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff95d68641e000) 00010000:00010000:2.0:1788390995.676921:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788390995.676924:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd3549f lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff80d expref: 8 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.676951:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788390995.676954:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788390995.676996:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3533a lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff79d expref: 7 pid: 34431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.677015:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788390995.677018:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788390995.677022:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd352e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff788 expref: 6 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390995.677033:0:34419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d68f044800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788390995.677055:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390995.677056:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390995.677058:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390995.678256:0:34431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b559db7-d4f9-4591-8d87-f7c547dbb07b+4:2355:x1875263094028672:12345-192.168.202.1@tcp:39:umount.0 Request processed in 1624us (2027us total) trans 21474836514 rc 0/0 00000100:00100000:0.0:1788390995.678268:0:34431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1788390996.182649:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390996.182763:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390996.182984:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094028928 00000100:00100000:1.0:1788390996.182996:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094028928 00000100:00100000:2.0:1788390996.183216:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094028800 00000100:00100000:2.0:1788390996.183221:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094028800 00000100:00100000:1.0:1788390996.183228:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390996.183240:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc720050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58512328-c007-4a40-b0fc-1350e8f2f98e+11:2358:x1875263094028928:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390996.183258:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390996.183276:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd3527d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff749 expref: 11 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390996.183301:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390996.183358:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc720050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58512328-c007-4a40-b0fc-1350e8f2f98e+10:2358:x1875263094028928:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 121us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390996.183380:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788390996.183431:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788390996.183438:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58512328-c007-4a40-b0fc-1350e8f2f98e+9:2358:x1875263094028800:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788390996.183446:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390996.183457:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1fc00/0x9aafc5f04cd35276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff71f expref: 9 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390996.183468:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390996.183498:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58512328-c007-4a40-b0fc-1350e8f2f98e+8:2358:x1875263094028800:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 60us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390996.183504:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788390996.189261:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390996.189323:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390996.189476:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029184 00000100:00100000:1.0:1788390996.189487:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029184 00000100:00100000:1.0:1788390996.189553:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788390996.189564:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2355:x1875263094029184:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1788390996.189604:0:35114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35299 00000100:00080000:1.0:1788390996.189615:0:35114:0:(import.c:65:import_set_state_nolock()) ffff95d68a71b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390996.189650:0:35114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:1.0:1788390996.189852:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+2:2355:x1875263094029184:12345-192.168.202.1@tcp:9:umount.0 Request processed in 289us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390996.189860:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:0.0:1788390996.190048:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788390996.190060:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390996.190305:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029056 00000100:00100000:2.0:1788390996.190310:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029056 00000100:00100000:2.0:1788390996.190362:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788390996.190372:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+8:2359:x1875263094029056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788390996.190382:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390996.190402:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdde00/0x9aafc5f04cd353d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff7d5 expref: 8 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390996.190417:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390996.190454:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58512328-c007-4a40-b0fc-1350e8f2f98e+7:2359:x1875263094029056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 84us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390996.190477:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788390996.192678:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788390996.192751:0:35112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029312 00000100:00100000:3.0:1788390996.192760:0:35112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029312 00000100:00100000:3.0:1788390996.193006:0:35112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1788390996.193017:0:35112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2355:x1875263094029312:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:3.0:1788390996.193054:0:35112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35292 00000100:00080000:3.0:1788390996.193065:0:35112:0:(import.c:65:import_set_state_nolock()) ffff95d68f040800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788390996.193099:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788390996.193159:0:35112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00100000:3.0:1788390996.193375:0:35112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8191374-9b73-41ea-ad83-0407a9b7bf5d+2:2355:x1875263094029312:12345-192.168.202.1@tcp:9:umount.0 Request processed in 359us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.193396:0:35112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00010000:00010000:2.0:1788390996.195425:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788390996.200758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788390996.200901:0:34432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029568 00000100:00100000:1.0:1788390996.200912:0:34432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029568 00000100:00080000:0.0:1788390996.201066:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788390996.201187:0:34432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1788390996.201208:0:34432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+6:2355:x1875263094029568:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:1.0:1788390996.201266:0:34432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3528b 00000020:00010000:1.0:1788390996.201275:0:34432:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d69052b000: total 0 00000100:00080000:1.0:1788390996.201279:0:34432:0:(import.c:65:import_set_state_nolock()) ffff95d69052c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788390996.201317:0:34432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836514 00000100:00100000:1.0:1788390996.201534:0:34432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8191374-9b73-41ea-ad83-0407a9b7bf5d+5:2355:x1875263094029568:12345-192.168.202.1@tcp:39:umount.0 Request processed in 327us (829us total) trans 21474836515 rc 0/0 00000100:00100000:1.0:1788390996.201542:0:34432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00010000:2.0:1788390996.201594:0:34419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d69052b000: total 0 00010000:00010000:2.0:1788390996.201639:0:34419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d69052b000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788390996.201683:0:34419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788390996.201686:0:34419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788390996.201694:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a0f63600/0x9aafc5f04cd3557f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff84c expref: 4 pid: 34430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390996.201734:0:34419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d69052b000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788390996.201744:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390996.201746:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390996.201748:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390996.211130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788390996.211226:0:34424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029824 00000100:00100000:0.0:1788390996.211236:0:34424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029824 00000100:00100000:0.0:1788390996.211311:0:34424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1788390996.211322:0:34424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+7:2355:x1875263094029824:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:0.0:1788390996.211366:0:34424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35230 00000020:00010000:0.0:1788390996.211373:0:34424:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d586b35800: total 0 00000100:00080000:0.0:1788390996.211377:0:34424:0:(import.c:65:import_set_state_nolock()) ffff95d586b30800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788390996.211512:0:34424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58512328-c007-4a40-b0fc-1350e8f2f98e+3:2355:x1875263094029824:12345-192.168.202.1@tcp:251:umount.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788390996.211521:0:34424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000020:00010000:2.0:1788390996.211832:0:36261:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d586b35800: total 0 00010000:00010000:2.0:1788390996.211836:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390996.211867:0:36261:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d586b35800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788390996.211890:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93a00/0x9aafc5f04cd35237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff6b6 expref: 2 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390996.211900:0:36261:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d586b35800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788390996.211904:0:36261:0:(genops.c:885:class_export_put()) final put ffff95d586b35800/58512328-c007-4a40-b0fc-1350e8f2f98e 00010000:00010000:2.0:1788390996.211915:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390996.211917:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390996.211918:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788390996.211941:0:32887:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586b35800/58512328-c007-4a40-b0fc-1350e8f2f98e for MGS 00000020:00000080:0.0:1788390996.212013:0:32887:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d586b30800 for MGS 00010000:00010000:2.0:1788390996.429604:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390996.430887:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103398784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788390996.430890:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103398912:0@lo:400:kworker.0 00000100:00100000:2.0:1788390996.431119:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103399040:0@lo:400:kworker.0 00000100:00100000:1.0:1788390996.431221:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390996.431298:0:34423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398912 00000100:00100000:1.0:1788390996.431309:0:34423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398912 00000100:00100000:3.0:1788390996.431328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390996.431386:0:34423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788390996.431400:0:34423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d686512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103398912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.431406:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103399296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.431445:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390996.431472:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788390996.431478:0:34423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d686512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103398912:12345-0@lo:400:kworker.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.431479:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103399424:0@lo:400:kworker.0 00000100:00100000:1.0:1788390996.431493:0:34423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788390996.431514:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390996.431553:0:35117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103398784 00000100:00100000:3.0:1788390996.431558:0:35117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103398784 00000100:00100000:1.0:1788390996.431583:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103398912:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.431616:0:35117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390996.431627:0:35117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103398784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788390996.431675:0:35117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788390996.431720:0:35117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103398784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.431726:0:35117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390996.431751:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399296 00000100:00100000:3.0:1788390996.431755:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399296 00000100:00100000:3.0:1788390996.431786:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399424 00000100:00100000:3.0:1788390996.431790:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399424 00000100:00100000:3.0:1788390996.431817:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390996.431825:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103399296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.431862:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103399296:12345-0@lo:400:kworker.0 Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.431869:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390996.431883:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390996.431900:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103399424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.431937:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103399424:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.431944:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788390996.431992:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788390996.431998:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788390996.432057:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103399424:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.432073:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103399296:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.432093:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103398784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788390996.432129:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103399168:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.432179:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390996.432223:0:35114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399168 00000100:00100000:3.0:1788390996.432227:0:35114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399168 00000100:00100000:3.0:1788390996.432261:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390996.432270:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103399168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.432325:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103399168:12345-0@lo:400:kworker.0 Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390996.432333:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788390996.432368:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103399168:0@lo:400:kworker.0 00000100:00100000:2.0:1788390996.432850:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390996.432889:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103399552:0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.432896:0:35313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399040 00000100:00100000:3.0:1788390996.432902:0:35313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399040 00000100:00100000:2.0:1788390996.432938:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390996.432949:0:35313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788390996.432982:0:35313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fe95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103399040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788390996.432999:0:35136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399552 00000100:00100000:2.0:1788390996.433004:0:35136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399552 00000100:00100000:3.0:1788390996.433036:0:35313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fe95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103399040:12345-0@lo:400:kworker.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390996.433046:0:35136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390996.433057:0:35136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103399552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788390996.433060:0:35313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788390996.433104:0:35136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103399552:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390996.433113:0:35136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390996.433156:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103399040:0@lo:400:kworker.0 00000100:00100000:2.0:1788390996.433169:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103399552:0@lo:400:kworker.0 00000100:00080000:2.0:1788390996.433195:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788390996.433199:0:34426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788390996.446135:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000020:00000080:0.0:1788390996.446149:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d690529000/f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000001:00100000:0.0:1788390996.446175:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000020:00000080:2.0:1788390996.446199:0:32887:0:(genops.c:844:class_export_destroy()) destroying export ffff95d690529000/f8191374-9b73-41ea-ad83-0407a9b7bf5d for lustre-OST0001 00000020:00000080:0.0:1788390996.446201:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d586b32800/0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000020:00000080:2.0:1788390996.446265:0:32887:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586b32800/0b559db7-d4f9-4591-8d87-f7c547dbb07b for lustre-OST0001 00000020:00000080:2.0:1788390996.446307:0:32887:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68a71b000 for lustre-OST0001 00000020:00000080:2.0:1788390996.446313:0:32887:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d586b33800 for lustre-OST0001 00000040:00080000:3.0:1788390996.943756:0:34463:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788390996.943769:0:34463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788390996.943812:0:34463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:3.0:1788390996.943820:0:34463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000020:01000004:2.0:1788390997.358987:0:37033:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788390997.375261:0:37033:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788390997.375349:0:37033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.375371:0:37033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.375379:0:37033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.375386:0:37033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.375429:0:37033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788390997.375437:0:37033:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788390997.375467:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788390997.375473:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788390997.375480:0:37033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788390997.375514:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d682b2b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788390997.375596:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788390997.375606:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.375615:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788390997.375619:0:34419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.375628:0:34419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788390997.375637:0:34419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788390997.375643:0:34419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788390997.375646:0:34419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788390997.375649:0:34419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788390997.375682:0:34419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.375690:0:34419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788390997.375719:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.375727:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd34f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34f3c expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.375741:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390997.375744:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788390997.375746:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390997.375758:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103399808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390997.375824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390997.375841:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103399680:0@lo:39:umount.0 00000100:00100000:1.0:1788390997.375917:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788390997.375991:0:34430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399680 00000100:00100000:3.0:1788390997.376000:0:34430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399680 00000100:00100000:3.0:1788390997.376052:0:34430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788390997.376058:0:34415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399808 00000100:00100000:3.0:1788390997.376063:0:34430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103399680:12345-0@lo:39:umount.0 00000100:00100000:2.0:1788390997.376069:0:34415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399808 00000020:00000080:3.0:1788390997.376092:0:34430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34f6d 00000100:00080000:3.0:1788390997.376100:0:34430:0:(import.c:65:import_set_state_nolock()) ffff95d585013000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788390997.376130:0:34415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788390997.376144:0:34415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3287:x1875263103399808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390997.376181:0:34430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1875263103399680:12345-0@lo:39:umount.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788390997.376187:0:34430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:00000080:3.0:1788390997.376195:0:34430:0:(genops.c:885:class_export_put()) final put ffff95d686d5c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788390997.376308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d686d5c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788390997.376322:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390997.376378:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d585013000 for lustre-MDT0000 00000100:00080000:1.0:1788390997.376442:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b2b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788390997.376463:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103399680:0@lo:39:umount.0 00010000:00010000:2.0:1788390997.376512:0:34415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390997.376532:0:34415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd34f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34f35 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.376553:0:34415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390997.376604:0:34415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:3287:x1875263103399808:12345-0@lo:103:ldlm_bl.0 Request processed in 464us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390997.376612:0:34415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788390997.376664:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390997.376667:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788390997.376672:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788390997.378414:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3287:1875263103399808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788390997.379397:0:37033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379418:0:37033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379425:0:37033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379432:0:37033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379459:0:37033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788390997.379466:0:37033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379474:0:37033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379480:0:37033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379485:0:37033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379503:0:37033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788390997.379528:0:37033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379534:0:37033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379541:0:37033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379547:0:37033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379568:0:37033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788390997.379574:0:37033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379580:0:37033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379586:0:37033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379592:0:37033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390997.379600:0:37033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788390997.379604:0:37033:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788390997.379622:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788390997.379634:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.379647:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390997.379651:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788390997.379653:0:37033:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788390997.379660:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788390997.379666:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390997.379674:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:3.0:1788390997.379683:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390997.379698:0:37033:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d68f042000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1788390997.379699:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390997.379726:0:37033:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d5864b8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1788390997.379730:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390997.379738:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788390997.379742:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1788390997.379745:0:37033:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d69052b000 f8191374-9b73-41ea-ad83-0407a9b7bf5d 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390997.379753:0:37033:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d68f044800 0b559db7-d4f9-4591-8d87-f7c547dbb07b 192.168.202.1@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 21474836512 stale:0 00000020:00080000:0.0:1788390997.379761:0:37033:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff95d69131b370) has exports, disconnecting them 00000020:00080000:0.0:1788390997.379768:0:37033:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d68f042000), last request at 1788390996 00000020:00000080:0.0:1788390997.379777:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35134 00010000:00010000:3.0:1788390997.379793:0:36261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.379801:0:36261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788390997.379804:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d68f044000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788390997.379841:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.379850:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92000/0x9aafc5f04cd34e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34ea2 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.379873:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788390997.379889:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390997.379891:0:37033:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d68f042000): rc 0 00000020:00000080:0.0:1788390997.379898:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68f042000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788390997.379910:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390997.379914:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788390997.379921:0:37033:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d5864b8800), last request at 1788390996 00010000:00010000:3.0:1788390997.379924:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788390997.379928:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34feb 00000100:00080000:0.0:1788390997.379939:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d5864bd800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788390997.379948:0:37033:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d5864b8800): rc 0 00000020:00000080:0.0:1788390997.379950:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d5864b8800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788390997.379988:0:37033:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba85815ffae0 10000000:00010000:3.0:1788390997.380042:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390997.380048:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390997.380050:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788390997.380052:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1788390997.380058:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390997.380065:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 3 00010000:00010000:3.0:1788390997.380071:0:36261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788390997.380081:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1788390997.380091:0:36261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390997.380102:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380108:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1fe00/0x9aafc5f04cd35142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35149 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380123:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788390997.380127:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380133:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390997.380136:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380143:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390997.380149:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788390997.380164:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788390997.380166:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788390997.380168:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788390997.380184:0:36261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380189:0:36261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390997.380208:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380214:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f000/0x9aafc5f04cd353fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35405 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380226:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788390997.380230:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390997.380234:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390997.380236:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788390997.380242:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380249:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788390997.380255:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390997.380262:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103400064:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788390997.380263:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788390997.380273:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788390997.380276:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788390997.380317:0:36261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380324:0:36261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788390997.380331:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788390997.380338:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93c00/0x9aafc5f04cd34e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34e94 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390997.380388:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390997.380446:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788390997.380454:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103399936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390997.380477:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390997.380517:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400064 00000100:00100000:1.0:1788390997.380525:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400064 00000100:00100000:1.0:1788390997.380580:0:34416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103399936 00000100:00100000:1.0:1788390997.380584:0:34416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103399936 00000100:00100000:1.0:1788390997.380601:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390997.380612:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+19:3289:x1875263103400064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390997.380628:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390997.380649:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35142 expref: 19 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390997.380669:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390997.380709:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+18:3289:x1875263103400064:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390997.380717:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788390997.380735:0:34416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390997.380742:0:34416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:3289:x1875263103399936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788390997.380750:0:34416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788390997.380760:0:34416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1a00/0x9aafc5f04cd34ea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34e9b expref: 17 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788390997.380769:0:34416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788390997.380790:0:34416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3289:x1875263103399936:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788390997.380796:0:34416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788390997.380846:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103399936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390997.380855:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3289:1875263103400064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788390997.381176:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390997.381183:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788390997.381186:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390997.381214:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f042000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1788390997.381245:0:37033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:2.0:1788390997.381276:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788390997.381298:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb46000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788390997.381304:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103400192:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788390997.381317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5864b8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788390997.381318:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390997.381323:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 3 00000100:00100000:2.0:1788390997.381344:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788390997.381346:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788390997.381376:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788390997.381382:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103400320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788390997.381407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788390997.381423:0:37033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788390997.381438:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1788390997.381462:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f044000 for lustre-MDT0000 00000020:00000080:3.0:1788390997.381479:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5864bd800 for lustre-MDT0000 00000100:00100000:2.0:1788390997.381492:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400192 00000100:00100000:2.0:1788390997.381499:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400192 00000020:00080000:0.0:1788390997.381499:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d69131b370) has no exports 00000100:00100000:2.0:1788390997.381536:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400320 00000100:00100000:2.0:1788390997.381540:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400320 00000100:00100000:2.0:1788390997.381557:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390997.381564:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+17:3286:x1875263103400192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390997.381571:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390997.381582:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd35405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd353fe expref: 17 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390997.381594:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390997.381631:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+16:3286:x1875263103400192:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390997.381637:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788390997.381662:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788390997.381669:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc720c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+15:3286:x1875263103400320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390997.381678:0:34417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788390997.381688:0:34417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1ee00/0x9aafc5f04cd34e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34e8d expref: 15 pid: 34423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788390997.381697:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103400192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788390997.381704:0:34417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788390997.381746:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc720c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c069eaf9-b959-44c7-ac7c-ecadb48df3a5+14:3286:x1875263103400320:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390997.381753:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788390997.381758:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3286:1875263103400320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788390997.381817:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103400448:0@lo:9:umount.0 00000100:00100000:1.0:1788390997.381853:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788390997.381879:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103400576:0@lo:9:umount.0 00000100:00100000:1.0:1788390997.381900:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788390997.381998:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400448 00000100:00100000:2.0:1788390997.382003:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400448 00000100:00100000:2.0:1788390997.382049:0:35113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400576 00000100:00100000:2.0:1788390997.382053:0:35113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400576 00000100:00100000:3.0:1788390997.382061:0:35114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788390997.382179:0:35114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103400448:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788390997.382210:0:35114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35007 00000100:00080000:3.0:1788390997.382220:0:35114:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf7f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788390997.382261:0:35114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00010000:00010000:1.0:1788390997.382320:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788390997.382568:0:35114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103400448:12345-0@lo:9:umount.0 Request processed in 494us (713us total) trans 0 rc 0/0 00000100:00080000:1.0:1788390997.382603:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb46000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788390997.382625:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788390997.382627:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390997.382632:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103400448:0@lo:9:umount.0 00000100:00100000:3.0:1788390997.385236:0:35114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788390997.386770:0:35113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788390997.386806:0:35113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103400576:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788390997.386858:0:35113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35150 00000100:00080000:2.0:1788390997.386893:0:35113:0:(import.c:65:import_set_state_nolock()) ffff95d6a1868000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788390997.386984:0:35113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00010000:00010000:1.0:1788390997.387326:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788390997.387625:0:35113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103400576:12345-0@lo:9:umount.0 Request processed in 839us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788390997.387635:0:35113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788390997.387666:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682b29800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788390997.387686:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788390997.387689:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788390997.387693:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103400576:0@lo:9:umount.0 00010000:00010000:2.0:1788390997.453303:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788390998.006007:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000020:00000080:1.0:1788390998.006021:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d586b31800/0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000001:00100000:1.0:1788390998.006056:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788390998.006060:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6bbf78000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788390998.006075:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000020:00000080:1.0:1788390998.006080:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d68f043800/f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000020:00000080:3.0:1788390998.006082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586b31800/0b559db7-d4f9-4591-8d87-f7c547dbb07b for lustre-OST0000 00000020:00000080:3.0:1788390998.006172:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbf78000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788390998.006203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f043800/f8191374-9b73-41ea-ad83-0407a9b7bf5d for lustre-OST0000 00000020:00000080:3.0:1788390998.006266:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d586b37000 for lustre-OST0000 00000020:00000080:3.0:1788390998.006284:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbf7f800 for lustre-OST0000 00000020:00000080:3.0:1788390998.006289:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f040800 for lustre-OST0000 00000001:00100000:3.0:1788390998.013544:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000001:00080000:3.0:1788390998.013571:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836514 is committed 00000001:00100000:3.0:1788390998.013585:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000001:00080000:3.0:1788390998.013589:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836515 is committed 00000020:00000080:3.0:1788390998.013592:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d69052b000/f8191374-9b73-41ea-ad83-0407a9b7bf5d 00000020:00000080:3.0:1788390998.013615:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d68f044800/0b559db7-d4f9-4591-8d87-f7c547dbb07b 00000020:00080000:3.0:1788390998.013622:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 17179869275 batchid updated 00000020:00080000:3.0:1788390998.013648:0:34467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a70569c0 refcount 1 committed 1 result 0 batchid 17179869275 00000020:00080000:3.0:1788390998.013654:0:34467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68133a3c0 00000020:00080000:3.0:1788390998.013658:0:34467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5880ba000 00000020:00000080:2.0:1788390998.013907:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69052b000/f8191374-9b73-41ea-ad83-0407a9b7bf5d for lustre-MDT0000 00000020:00000080:2.0:1788390998.014003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f044800/0b559db7-d4f9-4591-8d87-f7c547dbb07b for lustre-MDT0000 00000020:00000080:2.0:1788390998.014036:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d69052c800 for lustre-MDT0000 00000020:00000080:2.0:1788390998.014041:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5872c1800 for lustre-MDT0000 00000020:00080000:0.0:1788390998.023472:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d69131b370) has no exports 00000020:00000080:0.0:1788390998.060557:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ee8 00000020:00000080:0.0:1788390998.060574:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a719000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788390998.060597:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788390998.060643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a719000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788390998.060833:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788390998.060843:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788390998.060848:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff95d683d4b370) has no exports 00000020:00000080:1.0:1788390998.061343:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ee1 00000020:00000080:1.0:1788390998.061349:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d6b6532800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788390998.061420:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390998.061427:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788390998.061431:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d6b6536000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788390998.061433:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6536000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788390998.061440:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788390998.061717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6b6532800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788390998.061817:0:37033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6b3271f00 - data ffff95d69272b1b0/ffff95d58644e000 00000020:01000000:1.0:1788390998.061956:0:37033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d682e76000 - data ffff95d6b5edd1b0/ffff95d5872ca800 00000001:00000004:1.0:1788390998.075870:0:37033:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836515 00000100:00080000:0.0:1788390998.126010:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390998.126018:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 4 00000004:00080000:0.0:1788390998.126039:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390998.126042:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788390998.128322:0:34452:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788390998.128329:0:34452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 2 count 1 00000040:00080000:2.0:1788390998.128344:0:34452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:0.0:1788390998.129122:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390998.129128:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 4 00000004:00080000:0.0:1788390998.129148:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390998.129151:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788390998.129405:0:34454:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788390998.129409:0:34454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 1 count 1 00000040:00080000:3.0:1788390998.129416:0:34454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:0.0:1788390998.157692:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34eb0 00000020:00000080:0.0:1788390998.157706:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d585012000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390998.158598:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ec5 00000020:00000080:0.0:1788390998.158605:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a5ff800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390998.158744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585012000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788390998.158805:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788390998.158812:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.158819:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390998.158824:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff95d69131cd28) has no exports 00000004:01000000:0.0:1788390998.158995:0:37033:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788390998.159003:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34f12 00000020:00000080:0.0:1788390998.159007:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a71d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390998.159043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5ff800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788390998.159144:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788390998.159148:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.159153:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390998.159155:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff95d69180cd28) has no exports 00000020:00000080:0.0:1788390998.159160:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34f0b 00000020:00000080:0.0:1788390998.159164:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d682b2b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390998.159238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a71d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788390998.159615:0:37033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788390998.159619:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788390998.159623:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 5 00000004:00080000:0.0:1788390998.159640:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390998.159642:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788390998.159671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682b2b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390998.159745:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.159752:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390998.159756:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34efd 00000020:00000080:0.0:1788390998.159760:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a71d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390998.159780:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d682b29800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788390998.159786:0:8:0:(genops.c:885:class_export_put()) final put ffff95d68a71f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788390998.159793:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a71f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788390998.159797:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788390998.159901:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788390998.159905:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.159909:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390998.159911:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff95d6918099b8) has no exports 00000020:00000080:0.0:1788390998.159915:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ef6 00000020:00000080:0.0:1788390998.159918:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a71c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390998.160019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a71d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788390998.160025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a71c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788390998.160404:0:37033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788390998.160408:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788390998.160410:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 5 00000004:00080000:0.0:1788390998.160414:0:37033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788390998.160415:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390998.160438:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788390998.160482:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bcb46000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788390998.160510:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390998.160514:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a718000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390998.160517:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a718000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788390998.160521:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390998.160628:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.160632:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390998.160635:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d585017000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788390998.160638:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585017000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788390998.160644:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788390998.160727:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ecc 00000020:00000080:0.0:1788390998.160732:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a5f8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788390998.160770:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788390998.160774:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.160782:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788390998.160784:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff95d6913199b8) has no exports 00000020:00000080:0.0:1788390998.160801:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.160804:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788390998.160807:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34ed3 00000020:00000080:0.0:1788390998.160811:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d68a5fd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788390998.160831:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5f8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788390998.160834:0:8:0:(genops.c:885:class_export_put()) final put ffff95d585016000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788390998.160836:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585016000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788390998.160842:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788390998.161043:0:37033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d586120800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788390998.161048:0:37033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d586120800 3 00000020:01000004:0.0:1788390998.161051:0:37033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d586120800 from lustre-MDT0000 00000020:00000080:0.0:1788390998.161078:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.161082:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788390998.161085:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d585010800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788390998.161087:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585010800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788390998.161094:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788390998.161117:0:37033:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788390998.161121:0:37033:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788390998.161124:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788390998.161126:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.161129:0:37033:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390998.161135:0:37033:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff95d68f07e800 c069eaf9-b959-44c7-ac7c-ecadb48df3a5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390998.161140:0:37033:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff95d691808000) has exports, disconnecting them 00000020:00080000:0.0:1788390998.161145:0:37033:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95d68f07e800), last request at 1788390954 00000020:00000080:0.0:1788390998.161158:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34e78 00000020:00010000:0.0:1788390998.161162:0:37033:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d68f07e800: total 1 00000100:00080000:0.0:1788390998.161166:0:37033:0:(import.c:65:import_set_state_nolock()) ffff95d68f07f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788390998.161241:0:37033:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d68f07e800): rc 0 00000020:00080000:0.0:1788390998.161246:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff95d691808000) has no exports 00000020:00000080:3.0:1788390998.161297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a5fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788390998.161339:0:34419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d68f07e800: total 0 00010000:00010000:2.0:1788390998.161370:0:34419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d68f07e800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788390998.161399:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1ec00/0x9aafc5f04cd350f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd350ee expref: 9 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161416:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f800/0x9aafc5f04cd34fd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34fcf expref: 8 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161427:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f62800/0x9aafc5f04cd3511f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35118 expref: 7 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161437:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd34e86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34e7f expref: 6 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161448:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd34f9e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34f97 expref: 5 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161462:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd353e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd353e2 expref: 4 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161481:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd353f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd353f0 expref: 3 pid: 34425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161493:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93200/0x9aafc5f04cd34fac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd34fa5 expref: 2 pid: 34424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390998.161503:0:34419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d68f07e800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788390998.161517:0:34419:0:(genops.c:885:class_export_put()) final put ffff95d68f07e800/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 00010000:00010000:2.0:1788390998.161533:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390998.161535:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390998.161537:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788390998.161570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f07e800/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 for MGS 00000020:00000080:3.0:1788390998.161600:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f07f000 for MGS 00000100:00100000:3.0:1788390998.161774:0:34425:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff95d6a6866600:34425] 2 exiting: rc = 0 00000100:00100000:0.0:1788390998.161917:0:34424:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff95d6bbc07800:34424] 1 exiting: rc = 0 00000100:00100000:0.0:1788390998.162728:0:34423:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff95d68f74bc00:34423] 0 exiting: rc = 1 00000100:00100000:2.0:1788390998.162818:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162825:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162832:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162837:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162842:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162849:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162855:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162860:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162865:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162871:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162877:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162883:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162889:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162895:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162901:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162906:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162911:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162917:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162922:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162935:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.162951:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163259:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163269:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163287:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163293:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163299:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163304:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163310:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163316:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163321:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163327:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163338:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163348:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163355:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163360:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163365:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163371:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163376:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163381:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163386:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163391:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163395:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163400:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163405:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163410:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163415:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163420:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163424:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163429:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163434:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163439:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163444:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163449:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163454:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163459:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163472:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163477:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163481:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163487:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163492:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163497:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163502:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163508:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.163514:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788390998.163878:0:37033:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788390998.163882:0:37033:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788390998.164523:0:37033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc263c60 - data ffff95d6b5e0e0d8/ffff95d586288800 00000020:01000000:0.0:1788390998.164615:0:37033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6c18cd960 - data ffff95d692768288/ffff95d68a549c00 00000020:00000080:0.0:1788390998.165079:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34e5c 00000020:00000080:0.0:1788390998.165085:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d586125800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788390998.165099:0:37033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d586120800 from MGS, refs=2 00000020:01000004:0.0:1788390998.165101:0:37033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d586120800 2 00000020:01000004:0.0:1788390998.165104:0:37033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d586120800 from MGS 00000020:00000080:0.0:1788390998.165125:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.165130:0:37033:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788390998.165132:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d586126000/MGS 00000020:00000080:0.0:1788390998.165134:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586126000/MGS for MGS 00000020:01000000:0.0:1788390998.165140:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788390998.165200:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788390998.165206:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.165213:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788390998.165218:0:37033:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95d69052d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788390998.165224:0:37033:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff95d5873e8000) has exports, disconnecting them 00000020:00080000:0.0:1788390998.165229:0:37033:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95d69052d000), last request at 1788390954 00000020:00000080:0.0:1788390998.165232:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34f4a 00000020:00080000:0.0:1788390998.165238:0:37033:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d69052d000): rc 0 00000020:00000080:0.0:1788390998.165241:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d69052d000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788390998.165860:0:37033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788390998.165865:0:37033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390998.165868:0:37033:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788390998.165874:0:37033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788390998.166038:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.166044:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788390998.166047:0:37033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d586120800 1 00000020:00000080:0.0:1788390998.166052:0:37033:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34e4e 00000020:00000080:0.0:1788390998.166056:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d586125000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788390998.166060:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788390998.166064:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.166067:0:37033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788390998.166078:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff95d69180b370) has no exports 00000020:00000080:0.0:1788390998.166123:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586125800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390998.166314:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d69052d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788390998.166319:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d682b2b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788390998.166325:0:38:0:(genops.c:885:class_export_put()) final put ffff95d68a71b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788390998.166328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68a71b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788390998.166331:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788390998.166372:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586125000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788390998.182703:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788390998.182718:0:37033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788390998.182724:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d586127000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788390998.182728:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586127000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788390998.182739:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788390998.182904:0:37033:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d586124800 00000020:01000000:0.0:1788390998.182927:0:37033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788390998.182931:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788390998.182937:0:37033:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788390998.182942:0:37033:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff95d683d48000) has no exports 00000100:00100000:2.0:1788390998.183375:0:35136:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff95d587061600:35136] 3 exiting: rc = 0 00000100:00100000:2.0:1788390998.183492:0:34431:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff95d695fbb000:34431] 1 exiting: rc = 0 00000100:00100000:1.0:1788390998.183613:0:34432:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff95d68f693400:34432] 2 exiting: rc = 0 00000100:00100000:3.0:1788390998.185232:0:34430:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff95d682e6fe00:34430] 0 exiting: rc = 1 00000100:00100000:2.0:1788390998.185321:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185336:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185348:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185361:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185373:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185385:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185399:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185412:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185428:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185440:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185451:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185463:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185471:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185479:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185485:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185493:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185500:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185506:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185512:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185520:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185527:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185533:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185549:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185559:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185563:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185567:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185571:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185574:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185579:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185582:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185586:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185590:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185594:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185597:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185600:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185604:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185607:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185611:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185614:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185620:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185623:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185626:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185630:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185634:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185638:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185642:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185645:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185651:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185655:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185659:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185665:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185670:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185675:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185681:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185686:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185692:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185697:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185710:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185715:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185720:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185723:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185728:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185732:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.185735:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.189940:0:36301:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff95d5875b7400:36301] 2 exiting: rc = 0 00000100:00100000:1.0:1788390998.190010:0:34434:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95d68f692e00:34434] 1 exiting: rc = 0 00000100:00100000:3.0:1788390998.190409:0:34433:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95d68f692600:34433] 0 exiting: rc = 1 00000100:00100000:2.0:1788390998.190567:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190574:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190579:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190582:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190586:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190590:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190594:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190598:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190601:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190605:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190608:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190611:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190615:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190622:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190626:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190629:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190632:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190635:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190638:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190641:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190644:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190647:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190650:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190653:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190655:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190658:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190663:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190667:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190684:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190690:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190695:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190700:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190706:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190711:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190716:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190720:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190724:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190728:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190731:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190734:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190737:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190741:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190744:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190747:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190750:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190754:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190757:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190759:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190762:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190765:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190768:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190772:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190775:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190778:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190781:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190785:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190788:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190790:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190795:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190799:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190804:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190809:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190814:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.190827:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788390998.193483:0:34435:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff95d6bbfde400:34435] 0 exiting: rc = 1 00000100:00100000:0.0:1788390998.193995:0:34436:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff95d68f693e00:34436] 1 exiting: rc = 0 00000100:00100000:3.0:1788390998.194053:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194062:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194069:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194077:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194085:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194092:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194099:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194106:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194112:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194137:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194144:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194150:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194156:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194162:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194168:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194182:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194190:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194196:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194203:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194211:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194218:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194238:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194245:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194251:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194259:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194267:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194288:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194296:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194302:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194309:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194317:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194323:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194329:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194349:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194357:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194364:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194371:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194377:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194384:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194390:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194396:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194402:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194409:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194486:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194494:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194518:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194525:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194531:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194537:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194543:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194554:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194561:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194567:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194573:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194579:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194585:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194592:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194611:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194618:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194624:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194640:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194646:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194651:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.194658:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.202715:0:34437:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95d68f4f3000:34437] 0 exiting: rc = 1 00000100:00100000:0.0:1788390998.202766:0:34438:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95d68f692200:34438] 1 exiting: rc = 0 00000100:00100000:3.0:1788390998.207061:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207071:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207077:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207083:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207089:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207094:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207100:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207105:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207110:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207116:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207122:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207127:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207132:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207138:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207143:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207150:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207156:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207161:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207166:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207172:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207177:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207202:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207207:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207213:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207218:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207223:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207228:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207233:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207238:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207244:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207249:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207255:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207260:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207266:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207285:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207291:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207297:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207303:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207308:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207314:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207319:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207325:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207330:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207335:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207340:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207346:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207351:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207357:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207362:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207367:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207372:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207378:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207384:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207388:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207393:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207399:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207410:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207416:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207422:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207427:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207432:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207437:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207442:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207447:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.207813:0:34439:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95d685c39c00:34439] 0 exiting: rc = 1 00000100:00100000:0.0:1788390998.207819:0:34440:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95d58719ea00:34440] 1 exiting: rc = 0 00000100:00100000:3.0:1788390998.207900:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207907:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207912:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207918:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207923:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207928:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207933:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207939:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207945:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207951:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207955:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207975:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207984:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207990:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.207995:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208000:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208005:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208010:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208015:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208020:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208025:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208029:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208033:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208038:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208043:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208048:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208053:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208066:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208071:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208077:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208082:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208087:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208092:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208097:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208102:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208107:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208111:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208116:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208121:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208127:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208132:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208137:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208142:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208146:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208151:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208155:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208160:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208164:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208168:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208173:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208178:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208184:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208188:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208193:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208198:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208203:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208208:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208212:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208217:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208222:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208226:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208230:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208241:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788390998.208245:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.208710:0:34441:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff95d685c39e00:34441] 0 exiting: rc = 1 00000100:00100000:0.0:1788390998.208787:0:34442:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff95d58719ee00:34442] 1 exiting: rc = 0 00000100:00100000:0.0:1788390998.208863:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208867:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208871:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208874:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208877:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208880:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208884:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208893:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208897:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208902:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208907:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208912:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208918:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208923:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208927:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208933:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208939:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208944:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208949:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208954:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.208957:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209016:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209019:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209022:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209026:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209031:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209036:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209042:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209046:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209051:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209056:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209061:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209066:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209071:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209076:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209082:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209087:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209093:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209098:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209105:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209111:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209117:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209131:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209136:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209141:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209146:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209150:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209156:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209161:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209166:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209170:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209175:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209181:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209186:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209190:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209196:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209200:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209205:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209210:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209214:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209219:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209224:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209230:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788390998.209235:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213345:0:34445:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff95d6bcb2be00:34445] 2 exiting: rc = 0 00000100:00100000:0.0:1788390998.213395:0:34443:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff95d5863f3a00:34443] 0 exiting: rc = 1 00000100:00100000:2.0:1788390998.213434:0:34444:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff95d695fcb200:34444] 1 exiting: rc = 0 00000100:00100000:1.0:1788390998.213642:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213655:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213661:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213668:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213683:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213691:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213698:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213703:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213709:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213714:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213721:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213727:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213733:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213745:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213751:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213757:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213762:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213767:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213784:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213789:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213795:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213801:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213806:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213811:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213816:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213822:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213827:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213838:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213849:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213863:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213873:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213883:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213891:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213897:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213903:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213909:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213914:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213934:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213940:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213946:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213952:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.213957:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214001:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214008:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214017:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214026:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214036:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214044:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214051:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214057:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214062:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214068:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214073:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214087:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214092:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214098:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214104:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214110:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214115:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214121:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214126:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214131:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214137:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788390998.214143:0:37033:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788390998.219286:0:37033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788390998.219301:0:37033:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788390998.219307:0:37033:0:(genops.c:885:class_export_put()) final put ffff95d5851b4800/MDS_uuid 00000020:00000080:1.0:1788390998.219311:0:37033:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5851b4800/MDS_uuid for MDS 00000020:01000000:1.0:1788390998.219317:0:37033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788390998.219432:0:37033:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788390998.478543:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390999.501040:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788390999.942524:0:37185:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788390999.956192:0:37185:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788390999.956265:0:37185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390999.956285:0:37185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390999.956293:0:37185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390999.956326:0:37185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788390999.956404:0:37185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788390999.956412:0:37185:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788390999.956446:0:37185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788390999.956453:0:37185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788390999.956461:0:37185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788390999.956497:0:37185:0:(import.c:65:import_set_state_nolock()) ffff95d5872c1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788390999.956550:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788390999.956561:0:34419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390999.956562:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103400704:0@lo:39:umount.0 00010000:00010000:2.0:1788390999.956577:0:34419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788390999.956582:0:34419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390999.956592:0:34419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788390999.956601:0:34419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788390999.956608:0:34419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000400:00000100:1.0:1788390999.956641:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103400704 offset 0 length 224: 4 10000000:01000000:2.0:1788390999.956731:0:34419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788390999.956735:0:34419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788390999.956769:0:34419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390999.956775:0:34419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788390999.956813:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103400832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788390999.956854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788390999.956911:0:34419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788390999.956917:0:34419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63c00/0x9aafc5f04cd34fcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd34fd6 expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788390999.956925:0:34417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103400832 00010000:00010000:2.0:1788390999.956928:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390999.956935:0:34417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103400832 00010000:00010000:2.0:1788390999.956937:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788390999.956940:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788390999.957023:0:34417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788390999.957033:0:34417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3288:x1875263103400832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788390999.957042:0:34417:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788390999 with bad export cookie 11146345238637006456 00000100:00100000:0.0:1788390999.970613:0:34417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3288:x1875263103400832:12345-0@lo:103:ldlm_bl.0 Request processed in 13562us (13739us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788390999.970636:0:34417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788390999.970734:0:3288:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788390999.970741:0:3288:0:(import.c:65:import_set_state_nolock()) ffff95d586121000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788390999.970746:0:3288:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788390999.976458:0:3288:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788390999.976466:0:3288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788390999.976481:0:3288:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d584a0f800 x1875263103400832/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788391015 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788390999.976501:0:3288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788390999.976504:0:3288:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788390999.976506:0:3288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788390999.976512:0:3288:0:(import.c:65:import_set_state_nolock()) ffff95d586121000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788390999.976519:0:3288:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 771 00000100:00080000:3.0:1788390999.976531:0:3288:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d586121000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788390999.976581:0:3288:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d69111b480 x1875263103400960/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788390999.976690:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3285:1875263103400960:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788390999.976761:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103400960 offset 0 length 520: 4 00000100:00100000:3.0:1788390999.976849:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3288:1875263103400832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391000.525884:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391001.549128:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788391001.549259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788391001.549267:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788391001.549582:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391001.549611:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103401088:0@lo:400:kworker.0 00000400:00000100:3.0:1788391001.549683:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103401088 offset 0 length 224: 4 00000001:00100000:0.0:1788391001.586932:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788391001.586946:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6a186c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788391001.587060:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a186c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788391001.587145:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a1868000 for lustre-OST0001 00010000:00010000:2.0:1788391002.573205:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391003.597576:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391004.621163:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788391005.581602:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788391005.581612:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788391005.581950:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103401216:0@lo:400:kworker.0 00000400:00000100:3.0:1788391005.582056:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103401216 offset 0 length 224: 4 00010000:00010000:2.0:1788391005.645120:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391006.669594:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391007.693158:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391008.717210:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391009.229310:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390999/real 1788390999] req@ffff95d69111b480 x1875263103400960/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788391009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391009.229344:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d69111b480 x1875263103400960/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788391009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391009.229355:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788390999/real 1788390999] req@ffff95d687861180 x1875263103400704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788391009 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391009.229367:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d687861180 x1875263103400704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788391009 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788391009.229485:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d586121000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788391009.229507:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788391009.229511:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3285:1875263103400960:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788391009.229517:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5872c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788391009.229596:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788391009.229601:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788391009.229603:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d586121000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788391009.229608:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 817 00000100:00080000:1.0:1788391009.229613:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788391009.229619:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d586121000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391009.229659:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d685dc6300 x1875263103401344/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391009.229717:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391009.229729:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103401472:0@lo:400:kworker.0 00000400:00000100:1.0:1788391009.229777:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103401472 offset 0 length 224: 4 00000100:00100000:3.0:1788391009.229907:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103400704:0@lo:39:umount.0 00000100:00100000:3.0:1788391009.229928:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3285:1875263103401344:0@lo:250:kworker.0 00000400:00000100:3.0:1788391009.229947:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103401344 offset 0 length 520: 4 00000100:00080000:0.0:1788391009.230728:0:37185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391009.230734:0:37185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788391009.230739:0:37185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788391009.232904:0:37185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.232923:0:37185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.232931:0:37185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.232938:0:37185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.233008:0:37185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391009.233017:0:37185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.233023:0:37185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.233028:0:37185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.233033:0:37185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391009.233213:0:37185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788391009.233218:0:37185:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788391009.233250:0:37185:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788391009.233255:0:37185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788391009.233260:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391009.233265:0:37185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788391009.233269:0:37185:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d6bc75cd28) has no exports 00000020:00080000:0.0:1788391009.233295:0:37185:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d6bc75cd28) has no exports 00000020:01000000:0.0:1788391009.237714:0:37185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc263240 - data ffff95d6b5e805e8/ffff95d685743000 00000020:01000000:0.0:1788391009.237823:0:37185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6c18bc240 - data ffff95d68b2cf798/ffff95d585370c00 00010000:00010000:1.0:1788391009.238153:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788391009.238163:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238183:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391009.238187:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238197:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391009.238206:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391009.238230:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391009.238232:0:34418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788391009.238235:0:34418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788391009.238303:0:34418:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:1.0:1788391009.238307:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238312:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd34fa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd34fac expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238325:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391009.238328:0:34418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238334:0:34418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391009.238337:0:34418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238343:0:34418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391009.238349:0:34418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391009.238354:0:34418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788391009.238357:0:34418:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788391009.238359:0:34418:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788391009.238364:0:34418:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:1.0:1788391009.238367:0:34418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238574:0:34418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd353f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd353f7 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391009.238584:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391009.238586:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391009.238588:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391009.238708:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788391009.249939:0:37185:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788391009.280954:0:37185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34fba 00000020:00000080:2.0:1788391009.280995:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d6853b8800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788391009.281009:0:37185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d585015800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788391009.281012:0:37185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d585015800 2 00000020:01000004:2.0:1788391009.281015:0:37185:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d585015800 from lustre-OST0000 00000020:00000080:2.0:1788391009.281040:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391009.281049:0:37185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788391009.281052:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d6853bb000/lustre-OST0000_UUID 00000020:00000080:2.0:1788391009.281055:0:37185:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853bb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788391009.281063:0:37185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788391009.281102:0:37185:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788391009.281105:0:37185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788391009.281109:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391009.281113:0:37185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788391009.281119:0:37185:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95d5872c4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788391009.281125:0:37185:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff95d6bc7599b8) has exports, disconnecting them 00000020:00080000:2.0:1788391009.281130:0:37185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95d5872c4000), last request at 1788390962 00000020:00000080:2.0:1788391009.281134:0:37185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34fe4 00000020:00080000:2.0:1788391009.281141:0:37185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d5872c4000): rc 0 00000020:00000080:2.0:1788391009.281155:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d5872c4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788391009.281187:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853b8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788391009.281201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5872c4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788391009.283056:0:37185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788391009.283067:0:37185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788391009.283071:0:37185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788391009.283136:0:37185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788391009.283213:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5872c1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788391009.283702:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391009.283712:0:37185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788391009.283726:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d6853b9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788391009.283729:0:37185:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853b9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788391009.283740:0:37185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788391009.286357:0:37185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d585015800 1 00000020:00000080:3.0:1788391009.286369:0:37185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34f89 00000020:00000080:3.0:1788391009.286377:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d6a6b02800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788391009.286398:0:37185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788391009.286406:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391009.286413:0:37185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788391009.286418:0:37185:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff95d683d4cd28) has no exports 00000020:00000080:1.0:1788391009.286533:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b02800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788391009.303057:0:37185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391009.303142:0:37185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788391009.303148:0:37185:0:(genops.c:885:class_export_put()) final put ffff95d585014000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788391009.303153:0:37185:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585014000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788391009.303160:0:37185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788391009.303393:0:37185:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d585011800 00000020:02000400:3.0:1788391009.303445:0:37185:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788391009.741101:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391010.765565:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788391011.065628:0:37337:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788391011.071094:0:37337:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788391011.071167:0:37337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391011.071183:0:37337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391011.071191:0:37337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391011.071199:0:37337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391011.071272:0:37337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788391011.071278:0:37337:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788391011.071301:0:37337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788391011.071312:0:37337:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d685dc7b80 x1875263103401088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391011.071335:0:37337:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d685dc5f80 x1875263103401216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391011.071353:0:37337:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d685dc5880 x1875263103401472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391011.071361:0:37337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788391011.071366:0:37337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788391011.071392:0:37337:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf79000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788391011.071396:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103401472:0@lo:400:kworker.0 00000100:00100000:2.0:1788391011.071421:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103401216:0@lo:400:kworker.0 00000100:00100000:3.0:1788391011.071425:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103401600:0@lo:39:umount.0 00000400:00000100:3.0:1788391011.071474:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103401600 offset 0 length 224: 4 00000100:00100000:0.0:1788391011.071563:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103401088:0@lo:400:kworker.0 00010000:00010000:1.0:1788391011.071596:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391011.071603:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391011.071611:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391011.071614:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391011.071623:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391011.071630:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391011.071637:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391011.071639:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788391011.071642:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788391011.071660:0:36261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:1.0:1788391011.071664:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391011.071671:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd35118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3511f expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391011.071681:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391011.071683:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391011.071685:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391011.789615:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391012.816268:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391013.839034:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788391014.349236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788391014.349244:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788391014.861158:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391015.885652:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391016.909130:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391017.933128:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391018.957257:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788391019.469206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788391019.469221:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788391019.981358:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391021.007839:0:34419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391021.262008:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788391011/real 1788391011] req@ffff95d69111b480 x1875263103401600/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788391021 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391021.262095:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d69111b480 x1875263103401600/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788391021 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788391021.262121:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bbf79000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788391021.262142:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103401600:0@lo:39:umount.0 00000100:00080000:2.0:1788391021.262215:0:37337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788391021.262222:0:37337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788391021.262228:0:37337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788391021.264322:0:37337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264345:0:37337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264352:0:37337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264359:0:37337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264393:0:37337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391021.264402:0:37337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264409:0:37337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264435:0:37337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264441:0:37337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391021.264553:0:37337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788391021.264560:0:37337:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788391021.264601:0:37337:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788391021.264607:0:37337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788391021.264613:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391021.264620:0:37337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788391021.264625:0:37337:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d68a660000) has no exports 00000020:00080000:2.0:1788391021.264656:0:37337:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d68a660000) has no exports 00000020:01000000:2.0:1788391021.266932:0:37337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6bc263360 - data ffff95d6b5eee360/ffff95d6a1762800 00000020:01000000:2.0:1788391021.267148:0:37337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d686869c60 - data ffff95d6b5e80d80/ffff95d6a1715c00 00010000:00010000:0.0:1788391021.267767:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391021.267781:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.267796:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391021.267800:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.267813:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391021.267822:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391021.267829:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788391021.267832:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788391021.267835:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788391021.267857:0:36261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:0.0:1788391021.267861:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.267867:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd350ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd350f5 expref: -99 pid: 35829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.268084:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391021.268089:0:36261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.268095:0:36261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391021.268098:0:36261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.268105:0:36261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391021.268112:0:36261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391021.268118:0:36261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788391021.268120:0:36261:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788391021.268123:0:36261:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788391021.268130:0:36261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:0.0:1788391021.268133:0:36261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.268139:0:36261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63e00/0x9aafc5f04cd353e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd353e9 expref: -99 pid: 34427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391021.268154:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391021.268155:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391021.268158:0:36261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391021.268247:0:34418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788391021.276841:0:37337:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788391021.295868:0:37337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35103 00000020:00000080:3.0:1788391021.296351:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d586b36800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788391021.296376:0:37337:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d5872c5000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788391021.296380:0:37337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d5872c5000 2 00000020:01000004:3.0:1788391021.296384:0:37337:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d5872c5000 from lustre-OST0001 00000020:00000080:3.0:1788391021.296432:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391021.296444:0:37337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788391021.296449:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d6a6b00800/lustre-OST0001_UUID 00000020:00000080:3.0:1788391021.296452:0:37337:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b00800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788391021.296461:0:37337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788391021.296674:0:37337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c069eaf9-b959-44c7-ac7c-ecadb48df3a5->MGS 00010000:00010000:3.0:1788391021.296696:0:37337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788391021.296711:0:37337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391021.296717:0:37337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788391021.296721:0:37337:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788391021.296725:0:37337:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788391021.296742:0:37337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:3.0:1788391021.296747:0:37337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e800/0x9aafc5f04cd34f97 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd34f9e expref: -99 pid: 35111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391021.296764:0:37337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788391021.296771:0:37337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391021.296776:0:37337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788391021.296779:0:37337:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788391021.296780:0:37337:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788391021.296789:0:37337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d586121000 00010000:00010000:3.0:1788391021.296792:0:37337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a92c00/0x9aafc5f04cd34e7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd34e86 expref: -99 pid: 34412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788391021.296821:0:37337:0:(import.c:65:import_set_state_nolock()) ffff95d586121000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788391021.296825:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788391021.296828:0:37337:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788391021.296829:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788391021.296834:0:37337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788391021.296848:0:37337:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d685dc6300 x1875263103401344/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788391024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788391021.296882:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788391021.296885:0:37337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:0.0:1788391021.297028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d586b36800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788391021.297223:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c069eaf9-b959-44c7-ac7c-ecadb48df3a5:3285:1875263103401344:0@lo:250:kworker.0 10000000:01000000:3.0:1788391021.297287:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788391021.297297:0:37337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd34e6a 00000020:00000080:3.0:1788391021.297304:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d5851b5000/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 00000020:01000000:3.0:1788391021.297312:0:37337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:3.0:1788391021.297318:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391021.297325:0:37337:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788391021.297329:0:37337:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff95d691318000) has no exports 00000020:00000080:0.0:1788391021.297386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5851b5000/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 for MGC192.168.202.101@tcp 10000000:01000000:1.0:1788391021.297441:0:34427:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788391021.297544:0:37337:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:3.0:1788391021.297547:0:37337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788391021.297549:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788391021.297552:0:37337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788391021.297554:0:37337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788391021.297603:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391021.297609:0:37337:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid c069eaf9-b959-44c7-ac7c-ecadb48df3a5) 00000020:01000000:3.0:1788391021.297614:0:37337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788391021.297617:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391021.297620:0:37337:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788391021.297625:0:37337:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95d6a186f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788391021.297631:0:37337:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff95d6bc27cd28) has exports, disconnecting them 00000020:00080000:3.0:1788391021.297636:0:37337:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95d6a186f000), last request at 1788390970 00000020:00000080:3.0:1788391021.297641:0:37337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3512d 00000020:00080000:3.0:1788391021.297661:0:37337:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6a186f000): rc 0 00000020:00000080:3.0:1788391021.297665:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d6a186f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788391021.297990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d586121000 for MGC192.168.202.101@tcp 00000020:00000080:0.0:1788391021.297998:0:8:0:(genops.c:885:class_export_put()) final put ffff95d6bcb30800/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 00000020:00000080:0.0:1788391021.298000:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb30800/c069eaf9-b959-44c7-ac7c-ecadb48df3a5 for MGC192.168.202.101@tcp 00000020:01000000:0.0:1788391021.298006:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (c069eaf9-b959-44c7-ac7c-ecadb48df3a5) 00000020:00000080:0.0:1788391021.298277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a186f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788391021.303274:0:37337:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788391021.303289:0:37337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391021.303294:0:37337:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788391021.303305:0:37337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788391021.303447:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbf79000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788391021.307188:0:34419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788391021.307425:0:36261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788391021.307635:0:34418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788391021.307814:0:34413:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95d682e6fa00:34413] 0 exiting: rc = 1 00000100:00100000:0.0:1788391021.307901:0:34414:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95d682e6e800:34414] 1 exiting: rc = 0 00000100:00100000:1.0:1788391021.308028:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.308436:0:34415:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95d6b327c800:34415] 0 exiting: rc = 1 00000100:00100000:0.0:1788391021.308509:0:34417:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95d68844d600:34417] 2 exiting: rc = 0 00000100:00100000:2.0:1788391021.308761:0:34416:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95d683499600:34416] 1 exiting: rc = 0 00000100:00100000:0.0:1788391021.309304:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309315:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309324:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309331:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309339:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309346:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309351:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309357:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309363:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309370:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309376:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309382:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309389:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309397:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309418:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309425:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309432:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309443:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309449:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309454:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309459:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309465:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309472:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309478:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309484:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309491:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309497:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309503:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309509:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309515:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309807:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309818:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309823:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309829:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309834:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309841:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309847:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309852:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309858:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309864:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309870:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309876:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309882:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309888:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309894:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309899:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309905:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309911:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309917:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309931:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309936:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309942:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309949:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309954:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309986:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.309994:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310000:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310005:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310012:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310018:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310023:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310029:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310034:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.310040:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391021.310912:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788391021.310926:0:37337:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788391021.310934:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d6a186a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788391021.310940:0:37337:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a186a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788391021.310946:0:37337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788391021.311020:0:37337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d5872c5000 1 00000020:00000080:0.0:1788391021.311028:0:37337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd350e7 00000020:00000080:0.0:1788391021.311036:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d5872c0800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788391021.311051:0:37337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788391021.311057:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391021.311072:0:37337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788391021.311077:0:37337:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95d6bc758000) has no exports 00000020:00000080:1.0:1788391021.311870:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5872c0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788391021.323506:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391021.323893:0:37337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788391021.323902:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d5872c0000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788391021.323908:0:37337:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5872c0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788391021.323918:0:37337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788391021.324234:0:37337:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d5872c7000 00000020:01000000:1.0:1788391021.324261:0:37337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788391021.324266:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788391021.324271:0:37337:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788391021.324276:0:37337:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff95d683d499b8) has no exports 00000020:00000080:1.0:1788391021.324305:0:37337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391021.324313:0:37337:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788391021.324316:0:37337:0:(genops.c:885:class_export_put()) final put ffff95d6a6b05000/OSS_uuid 00000020:00000080:1.0:1788391021.324318:0:37337:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b05000/OSS_uuid for OSS 00000020:01000000:1.0:1788391021.324322:0:37337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788391021.324423:0:35112:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff95d6922a8600:35112] 0 exiting: rc = 1 00000100:00080000:2.0:1788391021.324735:0:34426:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788391021.324867:0:35113:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff95d6922a8400:35113] 1 exiting: rc = 0 00000100:00100000:1.0:1788391021.325036:0:35313:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff95d68526e800:35313] 3 exiting: rc = 0 00000100:00100000:3.0:1788391021.325218:0:35114:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff95d6922a9c00:35114] 2 exiting: rc = 0 00000100:00100000:1.0:1788391021.325425:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325434:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325440:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325446:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325454:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325461:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325467:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325473:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325479:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325486:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325492:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325501:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325508:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325514:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325532:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325539:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325547:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325554:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325560:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325565:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325571:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325577:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325586:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325592:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325601:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325607:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325613:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325619:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325624:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325630:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325635:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325641:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325647:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325665:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325672:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325679:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325685:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325691:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325696:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325702:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325707:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325712:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325718:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325724:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325731:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325736:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325742:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325747:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325752:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325758:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325775:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325784:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325789:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325796:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325802:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325808:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325815:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325823:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325829:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325835:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325840:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325847:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325858:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.325864:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391021.328908:0:35116:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95d6922a8800:35116] 0 exiting: rc = 1 00000100:00100000:3.0:1788391021.329080:0:35117:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95d6af660a00:35117] 1 exiting: rc = 0 00000100:00100000:1.0:1788391021.329271:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329281:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329287:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329292:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329314:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329321:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329329:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329335:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329341:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329346:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329351:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329357:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329363:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329370:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329376:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329381:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329387:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329393:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329399:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329404:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329412:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329418:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329424:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329431:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329437:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329443:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329449:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329455:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329461:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329467:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329472:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329478:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329484:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329490:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329496:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329503:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329509:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329515:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329534:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329548:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329555:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329561:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329567:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329573:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329579:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329586:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329595:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329600:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329606:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329613:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329618:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329623:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329629:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329635:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329641:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329652:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329658:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329664:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329670:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329675:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329681:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329687:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329693:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.329699:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.336401:0:35118:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95d6af660800:35118] 0 exiting: rc = 1 00000100:00100000:3.0:1788391021.336718:0:35119:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95d68a4e5000:35119] 1 exiting: rc = 0 00000100:00100000:3.0:1788391021.336860:0:35120:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95d68a4e4000:35120] 2 exiting: rc = 0 00000100:00100000:0.0:1788391021.337219:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337228:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337235:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337241:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337246:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337263:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337270:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337276:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337280:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337285:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337289:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337294:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337299:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337303:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337308:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337313:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337317:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337321:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337325:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337329:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337333:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337338:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337342:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337346:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337350:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337354:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337358:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337361:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337365:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337369:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337382:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337388:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337393:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337398:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337402:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337406:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337410:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337415:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337419:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337423:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337432:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337436:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337441:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337445:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337449:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337453:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337458:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337463:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337467:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337472:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337476:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337480:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337484:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337488:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337500:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337506:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337510:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337515:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337529:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337537:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337543:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337549:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337555:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.337561:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342308:0:35122:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95d6af661800:35122] 1 exiting: rc = 0 00000100:00100000:1.0:1788391021.342647:0:35121:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95d68a4e5400:35121] 0 exiting: rc = 1 00000100:00100000:0.0:1788391021.342771:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342781:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342787:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342793:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342799:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342806:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342813:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342818:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342824:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342831:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342857:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342862:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342868:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342874:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342883:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342891:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342898:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342904:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342910:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342916:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342922:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342928:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342936:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342942:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342951:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.342957:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343046:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343052:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343058:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343077:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343082:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343087:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343092:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343098:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343104:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343110:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343116:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343122:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343128:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343134:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343140:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343147:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343154:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343163:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343169:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343184:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343191:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343197:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343204:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343210:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343217:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343223:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343229:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343236:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343242:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343248:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343254:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343260:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343266:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343272:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343277:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343283:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343289:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.343295:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391021.344465:0:35123:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95d6a3509a00:35123] 0 exiting: rc = 1 00000100:00100000:0.0:1788391021.344675:0:35124:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95d6846d7800:35124] 1 exiting: rc = 0 00000100:00100000:0.0:1788391021.344745:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344763:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344771:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344783:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344806:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344817:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344824:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344831:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344837:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344845:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344852:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344859:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344866:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344873:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344880:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344903:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344926:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344934:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344942:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344948:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344956:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.344994:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345004:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345011:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345018:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345027:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345033:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345039:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345070:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345080:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345092:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345098:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345105:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345112:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345118:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345127:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345134:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345141:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345147:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345154:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345176:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345184:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345191:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345197:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345210:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345217:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345223:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345229:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345236:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345242:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345255:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345261:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345382:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345393:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345398:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345404:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345411:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345417:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345422:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345428:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345446:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345455:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345460:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391021.345473:0:37337:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788391021.356094:0:37337:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788391032.131571:0:37957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788391037.298893:0:38417:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788391037.298899:0:38417:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788391037.299061:0:38417:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d68f07f000 00000020:01000004:3.0:1788391037.299082:0:38417:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788391037.299090:0:38417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788391037.299111:0:38417:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95d6bc7599b8) 00000020:00000080:3.0:1788391037.299133:0:38417:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788391037.317674:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788391037.320879:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x39:0x0] (8/32) 00100000:10000000:2.0:1788391037.321569:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788391037.321706:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788391037.321907:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788391037.322026:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788391037.322171:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788391037.322277:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788391037.322372:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788391037.322620:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788391037.323563:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 68: rc = 0 00100000:10000000:2.0:1788391037.323640:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 68: rc = 0 00100000:10000000:2.0:1788391037.325234:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.325505:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1788391037.325811:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:2.0:1788391037.326216:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.326548:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1788391037.327066:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.327329:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.327588:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1788391037.328521:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.328948:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1788391037.329656:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1788391037.330674:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788391037.331521:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 95: rc = 0 00100000:10000000:2.0:1788391037.332181:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 95: rc = 0 00100000:10000000:2.0:1788391037.332531:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 95: rc = 0 00100000:10000000:2.0:1788391037.332951:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 95: rc = 0 00100000:10000000:2.0:1788391037.333368:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 95: rc = 0 00100000:10000000:2.0:1788391037.333630:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 95: rc = 0 00100000:10000000:2.0:1788391037.334187:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 95: rc = 0 00100000:10000000:2.0:1788391037.334487:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 95: rc = 0 00100000:10000000:2.0:1788391037.334840:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 95: rc = 0 00100000:10000000:2.0:1788391037.335575:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 95: rc = 0 00100000:10000000:2.0:1788391037.336189:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 95: rc = 0 00100000:10000000:2.0:1788391037.336488:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 95: rc = 0 00100000:10000000:2.0:1788391037.336893:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 95: rc = 0 00100000:10000000:2.0:1788391037.337354:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 95: rc = 0 00100000:10000000:2.0:1788391037.337638:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 95: rc = 0 00100000:10000000:2.0:1788391037.338175:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 95: rc = 0 00100000:10000000:2.0:1788391037.338470:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 95: rc = 0 00100000:10000000:2.0:1788391037.338890:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 95: rc = 0 00100000:10000000:2.0:1788391037.339399:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 95: rc = 0 00100000:10000000:2.0:1788391037.339843:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 95: rc = 0 00100000:10000000:2.0:1788391037.340467:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 95: rc = 0 00100000:10000000:2.0:1788391037.340884:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 95: rc = 0 00100000:10000000:2.0:1788391037.341375:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 95: rc = 0 00100000:10000000:2.0:1788391037.341700:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 95: rc = 0 00100000:10000000:2.0:1788391037.342268:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 95: rc = 0 00100000:10000000:2.0:1788391037.342605:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 95: rc = 0 00100000:10000000:2.0:1788391037.343045:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 95: rc = 0 00100000:10000000:2.0:1788391037.343386:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 95: rc = 0 00100000:10000000:2.0:1788391037.344616:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 95: rc = 0 00100000:10000000:2.0:1788391037.345239:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 95: rc = 0 00100000:10000000:2.0:1788391037.345632:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 95: rc = 0 00100000:10000000:2.0:1788391037.346154:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 95: rc = 0 00100000:10000000:2.0:1788391037.346519:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 84: rc = 0 00100000:10000000:2.0:1788391037.347347:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788391037.347523:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 69: rc = 0 00100000:10000000:2.0:1788391037.348300:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788391037.348389:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 69: rc = 0 00100000:10000000:2.0:1788391037.349125:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788391037.349192:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 69: rc = 0 00100000:10000000:2.0:1788391037.349844:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788391037.349953:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 73: rc = 0 00100000:10000000:2.0:1788391037.350322:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788391037.350396:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 73: rc = 0 00100000:10000000:2.0:1788391037.350618:0:38417:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788391037.350687:0:38417:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 73: rc = 0 00000020:00000080:2.0:1788391037.351251:0:38417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788391037.351261:0:38417:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788391037.351272:0:38417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd3558d 00000020:01000004:2.0:1788391037.351287:0:38417:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788391037.351292:0:38417:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788391037.351297:0:38417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d68f07f000 from MGS 00000020:01000004:2.0:1788391037.351301:0:38417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788391037.351317:0:38417:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff95d5873eb370) 00000020:00000080:2.0:1788391037.351330:0:38417:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788391037.351400:0:38417:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68f07f000 from MGS, refs=2 00080000:01000000:2.0:1788391037.351405:0:38417:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788391037.351410:0:38417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd3559b 00000100:00100000:2.0:1788391037.351532:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788391037.352834:0:38417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788391037.352843:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788391037.353516:0:38417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788391037.353523:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788391037.354357:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391037.354508:0:38417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788391037.354513:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788391037.355436:0:38417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788391037.355444:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788391037.358675:0:38417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788391037.358714:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788391037.360044:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.360049:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.360050:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.360334:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.360336:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.360338:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391037.360847:0:38417:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788391037.372354:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788391037.377712:0:38417:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788391037.377812:0:38417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788391037.377815:0:38417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788391037.380857:0:38426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788391037.381064:0:38417:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788391037.381167:0:38417:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788391037.381858:0:38417:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788391037.382421:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391037.382597:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788391037.382603:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788391037.384333:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788391037.384345:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788391037.387647:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788391037.387661:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788391037.388817:0:38431:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788391037.389084:0:38417:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788391037.389105:0:38417:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:2.0:1788391037.389107:0:38417:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788391037.389137:0:38417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:2.0:1788391037.389150:0:38417:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff95d5873ecd28) 00000020:00000080:2.0:1788391037.389165:0:38417:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788391037.389237:0:38417:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d682e3a800@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788391037.389515:0:38417:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:2.0:1788391037.389523:0:38417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788391037.392608:0:38432:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788391037.392724:0:38417:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid f33d137e-f79f-4925-8ad8-5351efff92b3) 00000020:00000080:2.0:1788391037.392746:0:38417:0:(genops.c:1385:class_connect()) connect: client f33d137e-f79f-4925-8ad8-5351efff92b3, cookie 0x9aafc5f04cd355a9 00000100:00080000:2.0:1788391037.392760:0:38417:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788391037.392767:0:38417:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d682e3a800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391037.392807:0:38417:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0c700 x1875263103401728/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788391037.392835:0:38417:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f33d137e-f79f-4925-8ad8-5351efff92b3->MGS 00000020:01000004:2.0:1788391037.392865:0:38417:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788391037.392871:0:38417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788391037.392884:0:38417:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95d5873e99b8) 00000020:00000080:2.0:1788391037.392895:0:38417:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788391037.403052:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f33d137e-f79f-4925-8ad8-5351efff92b3:3285:1875263103401728:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788391037.403144:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391037.403192:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103401728 00000100:00100000:2.0:1788391037.403202:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103401728 00000100:00100000:2.0:1788391037.403471:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391037.403483:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1875263103401728:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788391037.403514:0:38427:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f33d137e-f79f-4925-8ad8-5351efff92b3@0@lo t0 exp 0000000000000000 cur 854 last 0 00000020:00000080:2.0:1788391037.403555:0:38427:0:(genops.c:1385:class_connect()) connect: client f33d137e-f79f-4925-8ad8-5351efff92b3, cookie 0x9aafc5f04cd355b7 00000100:00080000:2.0:1788391037.403724:0:38427:0:(import.c:65:import_set_state_nolock()) ffff95d68f07c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391037.403791:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+5:3285:x1875263103401728:12345-0@lo:250:mount.lustre.0 Request processed in 308us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.403811:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391037.403834:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788391037.403844:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:1.0:1788391037.403851:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788391037.403856:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788391037.403866:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d682e3a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788391037.403869:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788391037.403889:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788391037.403894:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f33d137e-f79f-4925-8ad8-5351efff92b3:3285:1875263103401728:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788391037.404833:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391037.405104:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788391037.405111:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788391037.407677:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788391037.407692:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788391037.411375:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788391037.411388:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788391037.412100:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788391037.412323:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788391037.412328:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788391037.413192:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788391037.413201:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788391037.447158:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391037.447370:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788391037.447377:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788391037.448453:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788391037.448462:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788391037.449179:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391037.449348:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788391037.449562:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788391037.450274:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788391037.450281:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788391037.450798:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391037.455141:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788391037.455154:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788391037.455804:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788391037.455811:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788391037.456598:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391037.456760:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788391037.456765:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788391037.457400:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788391037.457408:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788391037.471228:0:38417:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391037.471441:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788391037.471448:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788391037.472784:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788391037.472795:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788391037.473736:0:38417:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788391037.473744:0:38417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788391037.477771:0:38417:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788391037.477905:0:38417:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788391037.477912:0:38417:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788391037.478223:0:38417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788391037.478264:0:38417:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788391037.478268:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788391037.478270:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788391037.478271:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391037.478272:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391037.478273:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391037.478275:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391037.478276:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788391037.478277:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788391037.478279:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391037.478281:0:38417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391037.478283:0:38417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788391037.478285:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788391037.478287:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788391037.478288:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391037.478289:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391037.478290:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391037.478291:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391037.478292:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788391037.478293:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788391037.478294:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391037.478295:0:38417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391037.478328:0:38417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788391037.478403:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103401856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788391037.478480:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.478526:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.478583:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103401856 00000100:00100000:2.0:1788391037.478591:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103401856 00000100:00100000:2.0:1788391037.478681:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788391037.478692:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+5:38417:x1875263103401856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788391037.478747:0:38430:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788391037.478751:0:38430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788391037.478754:0:38430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788391037.479407:0:38451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788391037.480241:0:38430:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 17 20000000:01000000:0.0:1788391037.481592:0:38452:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788391037.481600:0:38452:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788391037.481603:0:38452:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788391037.481650:0:38452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788391037.482269:0:38430:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788391037.482282:0:38430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788391037.490712:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+5:38417:x1875263103401856:12345-0@lo:253:mount.lustre.0 Request processed in 12007us (12216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.490736:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391037.490904:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103401856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788391037.490933:0:38417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788391037.490936:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788391037.490938:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788391037.490939:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391037.490940:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391037.490941:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391037.490942:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391037.490944:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788391037.490945:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788391037.490947:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391037.490948:0:38417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788391037.491133:0:38417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d68f07f000 from lustre-MDT0000 10000000:01000000:3.0:1788391037.491164:0:38417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788391037.491167:0:38417:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788391037.491177:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d5873ecd28 10000000:01000000:3.0:1788391037.491182:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788391037.491191:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d5873ecd28 from 1 10000000:01000000:3.0:1788391037.491201:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788391037.491243:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.491255:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.491266:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.491302:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103401984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391037.491340:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.491420:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.491469:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103401984 00000100:00100000:2.0:1788391037.491475:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103401984 00000100:00100000:2.0:1788391037.491554:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391037.491565:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+5:38417:x1875263103401984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391037.491583:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391037.491598:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d5877abc00/0x9aafc5f04cd355c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd355be expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.491628:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877abc00/0x9aafc5f04cd355c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd355be expref: 6 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.491644:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d5877abc00/0x9aafc5f04cd355c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd355be expref: 6 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.491653:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877abc00, rc 0) 00000100:00100000:2.0:1788391037.491708:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+6:38417:x1875263103401984:12345-0@lo:101:mount.lustre.0 Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.491715:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391037.491792:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103401984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391037.491813:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.491836:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.491895:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391037.491940:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.492168:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391037.492242:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402112 00000100:00100000:0.0:1788391037.492247:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402112 00000100:00100000:0.0:1788391037.492271:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391037.492279:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+6:38417:x1875263103402112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.492506:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+6:38417:x1875263103402112:12345-0@lo:501:mount.lustre.0 Request processed in 227us (565us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788391037.492514:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391037.492592:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788391037.492618:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788391037.492641:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.492650:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391037.492658:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d68f07f000 10000000:01000000:3.0:1788391037.492663:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788391037.492667:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d68f07f000 10000000:01000000:3.0:1788391037.492669:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788391037.492672:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d68f07f000 from 1 10000000:01000000:3.0:1788391037.492679:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788391037.492698:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.492705:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.492713:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.492726:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391037.492751:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.492762:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391037.492827:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402240 00000100:00100000:0.0:1788391037.492831:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402240 00000100:00100000:0.0:1788391037.492848:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391037.492853:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+6:38417:x1875263103402240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391037.492860:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391037.492870:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93800/0x9aafc5f04cd355d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd355cc expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.492884:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93800/0x9aafc5f04cd355d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd355cc expref: 7 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.492891:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93800/0x9aafc5f04cd355d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd355cc expref: 7 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.492908:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93800, rc 0) 00000100:00100000:0.0:1788391037.492955:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+7:38417:x1875263103402240:12345-0@lo:101:mount.lustre.0 Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391037.492992:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391037.493089:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391037.493106:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.493114:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391037.493125:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788391037.493139:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.493146:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391037.493152:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788391037.493156:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788391037.493166:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d68f07f000 10000000:01000000:3.0:1788391037.493169:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788391037.493172:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788391037.493173:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788391037.493187:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.493194:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.493201:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.493212:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391037.493235:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.493253:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391037.493362:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402368 00000100:00100000:0.0:1788391037.493366:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402368 00000100:00100000:0.0:1788391037.493384:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391037.493389:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+7:38417:x1875263103402368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391037.493404:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391037.493413:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92c00/0x9aafc5f04cd355e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd355da expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.493427:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92c00/0x9aafc5f04cd355e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd355da expref: 8 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.493442:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a92c00/0x9aafc5f04cd355e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd355da expref: 8 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.493455:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:0.0:1788391037.493507:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+8:38417:x1875263103402368:12345-0@lo:101:mount.lustre.0 Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391037.493513:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788391037.493598:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391037.493608:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.493616:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.493671:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391037.493715:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.493732:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391037.494489:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402496 00000100:00100000:0.0:1788391037.494504:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402496 00000100:00100000:0.0:1788391037.494542:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391037.494550:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+8:38417:x1875263103402496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.495114:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38417:x1875263103402496:12345-0@lo:501:mount.lustre.0 Request processed in 563us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391037.495122:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788391037.495219:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391037.495258:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391037.495308:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.495342:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.495411:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402624 00000100:00100000:2.0:1788391037.495416:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402624 00000100:00100000:2.0:1788391037.495445:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788391037.495452:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38417:x1875263103402624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391037.498176:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38417:x1875263103402624:12345-0@lo:503:mount.lustre.0 Request processed in 2714us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.498192:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788391037.500059:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103402624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391037.504377:0:38453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38453:1875263103402752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391037.504472:0:38453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391037.504548:0:38453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065180 going to sleep for 11 seconds 00000100:00100000:0.0:1788391037.508909:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103402752 00000100:00100000:0.0:1788391037.508936:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103402752 00000100:00100000:0.0:1788391037.509145:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788391037.509157:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38453:x1875263103402752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788391037.509546:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38453:x1875263103402752:12345-0@lo:502:llog_process_th.0 Request processed in 391us (5073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391037.509554:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788391037.509665:0:38453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38453:1875263103402752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788391037.509703:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788391037.509715:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391037.509718:0:38453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788391037.509724:0:38453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788391037.509727:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788391037.509742:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95d68a663370) 00000020:00000080:1.0:1788391037.509762:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788391037.509767:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788391037.509841:0:38453:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788391037.509852:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd355ef 00000020:00000080:1.0:1788391037.510117:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788391037.510122:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788391037.510132:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391037.510134:0:38453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788391037.510137:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788391037.510140:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391037.510141:0:38453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788391037.510144:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788391037.510153:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95d68a6619b8) 00000020:00000080:1.0:1788391037.510161:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788391037.510165:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788391037.510167:0:38453:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788391037.510169:0:38453:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788391037.510175:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788391037.510225:0:38453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68f07f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788391037.510240:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95d68a664d28) 00000020:00000080:1.0:1788391037.510248:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788391037.510307:0:38453:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788391037.510313:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd35604 00000020:00000080:1.0:1788391037.510410:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788391037.510416:0:38453:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788391037.510420:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aafc5f04cd3560b 00080000:01000000:1.0:1788391037.510425:0:38453:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788391037.510428:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd35612 00010000:00010000:3.0:1788391037.611050:0:38453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788391037.611631:0:38453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 21474836515 00000001:00080000:3.0:1788391037.611800:0:38453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788391037.612559:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95d6bc758000) 00000020:00000080:3.0:1788391037.612578:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788391037.612645:0:38453:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788391037.612652:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd35620 00000020:00000080:2.0:1788391037.613523:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788391037.621133:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aafc5f04cd35627 00000020:00000080:2.0:1788391037.622313:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788391037.622328:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391037.622344:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.622347:0:38453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788391037.622351:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391037.622357:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.622359:0:38453:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788391037.622363:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788391037.622402:0:38453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788391037.622418:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391037.622420:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.622422:0:38453:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788391037.622424:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788391037.622426:0:38453:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788391037.622428:0:38453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391037.622429:0:38453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391037.622431:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788391037.622433:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.622435:0:38453:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788391037.622437:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788391037.622440:0:38453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788391037.622443:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.622445:0:38453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788391037.622448:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788391037.622453:0:38453:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1788391037.622474:0:38453:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788391037.622476:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788391037.622489:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95d5873e8000) 00000020:00000080:2.0:1788391037.622503:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788391037.622507:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788391037.622551:0:38453:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788391037.622567:0:38453:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788391037.622573:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd35635 00010000:00080000:2.0:1788391037.622597:0:38453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6a0fad000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788391037.622774:0:38453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788391037.623370:0:38453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788391037.623414:0:38453:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788391037.625433:0:38453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391037.625505:0:38453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:2.0:1788391037.625679:0:38453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:3.0:1788391037.626361:0:38457:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788391037.626366:0:38457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788391037.632370:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788391037.632386:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788391037.632446:0:38453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788391037.632465:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd3563c 00000100:00080000:0.0:1788391037.632475:0:38453:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788391037.632480:0:38453:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6a0fad000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391037.632513:0:38453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687862a00 x1875263103402880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788391037.632547:0:38453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788391037.632582:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103402880:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788391037.632638:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103402880 offset 0 length 520: 4 00000020:01000000:0.0:1788391037.632721:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391037.632726:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.632728:0:38453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788391037.632731:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788391037.632733:0:38453:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788391037.632735:0:38453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788391037.632736:0:38453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788391037.632737:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788391037.632740:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.632741:0:38453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788391037.632744:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788391037.632748:0:38453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788391037.632751:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.632753:0:38453:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788391037.632756:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788391037.632760:0:38453:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:0.0:1788391037.632779:0:38453:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788391037.632781:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788391037.632793:0:38453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95d6bc27cd28) 00000020:00000080:0.0:1788391037.632803:0:38453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788391037.632808:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788391037.632874:0:38453:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788391037.632880:0:38453:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788391037.632886:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd3564a 00010000:00080000:0.0:1788391037.632946:0:38453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6865e0000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788391037.633182:0:38453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788391037.633378:0:38453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788391037.633400:0:38453:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788391037.635068:0:38453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788391037.635142:0:38453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:0.0:1788391037.635224:0:38453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 64 off8256 00000040:00080000:1.0:1788391037.635674:0:38459:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788391037.635677:0:38459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788391037.637764:0:38453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788391037.637778:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788391037.637814:0:38453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788391037.637837:0:38453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd35651 00000100:00080000:2.0:1788391037.637847:0:38453:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788391037.637854:0:38453:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6865e0000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391037.637899:0:38453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0dc00 x1875263103403008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391037.637990:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103403008:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788391037.638046:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103403008 offset 0 length 520: 4 00000100:00080000:2.0:1788391037.638114:0:38453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788391037.638179:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391037.638184:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.638186:0:38453:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788391037.638189:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391037.638192:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.638194:0:38453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788391037.638197:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788391037.638199:0:38453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788391037.638201:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391037.638203:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.638204:0:38453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788391037.638206:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391037.638208:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391037.638209:0:38453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788391037.638213:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788391037.638241:0:38453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38453:1875263103403136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788391037.638305:0:38453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391037.638338:0:38453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69194d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788391037.639013:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403136 00000100:00100000:3.0:1788391037.639021:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403136 00000100:00100000:3.0:1788391037.639067:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391037.639078:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38453:x1875263103403136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391037.639367:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38453:x1875263103403136:12345-0@lo:502:llog_process_th.0 Request processed in 290us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391037.639375:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788391037.639564:0:38453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38453:1875263103403136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788391037.639596:0:38453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391037.639602:0:38453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.639604:0:38453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788391037.639608:0:38453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788391037.640642:0:38417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788391037.640672:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788391037.640734:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.640748:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391037.640757:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68f07f000 from 1 10000000:01000000:3.0:1788391037.640768:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788391037.640803:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.640811:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.640821:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391037.640843:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391037.640895:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391037.640950:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.640992:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403264 00000100:00100000:1.0:1788391037.640999:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403264 00000100:00100000:1.0:1788391037.641040:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788391037.641053:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+9:38417:x1875263103403264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391037.641064:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391037.641076:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35658 expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.641094:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 10 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.641102:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 10 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.641109:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63c00, rc 0) 00000100:00100000:1.0:1788391037.641147:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+10:38417:x1875263103403264:12345-0@lo:101:mount.lustre.0 Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.641152:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391037.641205:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391037.641220:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.641230:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391037.641726:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403392:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788391037.641762:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391037.641793:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69194d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391037.641958:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403392 00000100:00100000:3.0:1788391037.641983:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403392 00000100:00100000:3.0:1788391037.642007:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391037.642013:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+10:38417:x1875263103403392:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788391037.642026:0:38428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788391037.642030:0:38428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788391037.642084:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+10:38417:x1875263103403392:12345-0@lo:256:mount.lustre.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391037.642089:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788391037.642107:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403392:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788391037.642792:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788391037.642910:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.642931:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391037.642938:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68f07f000 from 1 10000000:01000000:2.0:1788391037.642941:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788391037.643002:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.643009:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.643017:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391037.643086:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788391037.643121:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391037.643153:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69194d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391037.643193:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403520 00000100:00100000:3.0:1788391037.643199:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403520 00000100:00100000:3.0:1788391037.643239:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391037.643248:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+10:38417:x1875263103403520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391037.643258:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391037.643273:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35666 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.643305:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 11 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.643316:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 11 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391037.643324:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:3.0:1788391037.643367:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103403520:12345-0@lo:101:mount.lustre.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391037.643374:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788391037.643469:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391037.643482:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.643491:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391037.643539:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.643566:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.643589:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.643621:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403648 00000100:00100000:1.0:1788391037.643626:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403648 00000100:00100000:1.0:1788391037.643694:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788391037.643703:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103403648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391037.644130:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103403648:12345-0@lo:501:mount.lustre.0 Request processed in 427us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.644137:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788391037.644468:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.644507:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391037.644550:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.644579:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.644592:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403776 00000100:00100000:2.0:1788391037.644598:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403776 00000100:00100000:2.0:1788391037.644661:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788391037.644669:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103403776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391037.644818:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103403776:12345-0@lo:503:mount.lustre.0 Request processed in 150us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.644825:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788391037.644901:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103403776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391037.645861:0:38461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38461:1875263103403904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788391037.645925:0:38461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.645957:0:38461:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.646030:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103403904 00000100:00100000:1.0:1788391037.646036:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103403904 00000100:00100000:1.0:1788391037.646143:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391037.646153:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38461:x1875263103403904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391037.649207:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38461:x1875263103403904:12345-0@lo:502:llog_process_th.0 Request processed in 3045us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.649249:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788391037.649355:0:38461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38461:1875263103403904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788391037.649423:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391037.649434:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.649437:0:38461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788391037.649444:0:38461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d68f07f000 00000020:00000080:0.0:1788391037.649447:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788391037.649456:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391037.649459:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.649460:0:38461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788391037.649463:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391037.649465:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.649467:0:38461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788391037.649470:0:38461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d68f07f000 00000020:00000080:0.0:1788391037.649472:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788391037.649528:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391037.649532:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.649534:0:38461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788391037.649536:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391037.649539:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.649540:0:38461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788391037.649544:0:38461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d68f07f000 00000020:00000080:0.0:1788391037.649546:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788391037.649595:0:38461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38461:1875263103404032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788391037.649645:0:38461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.656699:0:38461:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332840 going to sleep for 11 seconds 00000100:00100000:3.0:1788391037.656766:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404032 00000100:00100000:3.0:1788391037.656777:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404032 00000100:00100000:3.0:1788391037.656863:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788391037.656881:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38461:x1875263103404032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391037.657429:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38461:x1875263103404032:12345-0@lo:502:llog_process_th.0 Request processed in 555us (7781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391037.657438:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391037.657517:0:38461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38461:1875263103404032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788391037.657551:0:38461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391037.657559:0:38461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391037.657561:0:38461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788391037.657565:0:38461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788391037.657907:0:38417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788391037.657941:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788391037.657984:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.657997:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391037.658055:0:38417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788391037.658058:0:38417:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d68f07f000 10000000:01000000:1.0:1788391037.658061:0:38417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d68f07f000 10000000:01000000:1.0:1788391037.658065:0:38417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391037.658075:0:38417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d68f07f000 from 1 10000000:01000000:1.0:1788391037.658078:0:38417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788391037.658111:0:38417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.658118:0:38417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.658128:0:38417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391037.658147:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391037.658204:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391037.658288:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.658424:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404160 00000100:00100000:1.0:1788391037.658430:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404160 00000100:00100000:1.0:1788391037.658474:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788391037.658483:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103404160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391037.658495:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391037.658516:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd3567b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35674 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.659416:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd3567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35674 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.659430:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd3567b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35674 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391037.659440:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63a00, rc 0) 00000100:00100000:1.0:1788391037.659885:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404160:12345-0@lo:101:mount.lustre.0 Request processed in 1400us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.659894:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391037.660067:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391037.660095:0:38417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.660105:0:38417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391037.660205:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.660353:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.660393:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.660464:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404288 00000100:00100000:1.0:1788391037.660469:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404288 00000100:00100000:1.0:1788391037.660531:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788391037.660541:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391037.662122:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404288:12345-0@lo:501:mount.lustre.0 Request processed in 1575us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.662133:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391037.662750:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391037.662800:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391037.662849:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.662886:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.663333:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404416 00000100:00100000:1.0:1788391037.663341:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404416 00000100:00100000:1.0:1788391037.663380:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788391037.663388:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391037.664696:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404416:12345-0@lo:503:mount.lustre.0 Request processed in 1302us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.664715:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788391037.664832:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391037.666711:0:38464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38464:1875263103404544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391037.666786:0:38464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391037.666837:0:38464:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.667002:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404544 00000100:00100000:2.0:1788391037.667010:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404544 00000100:00100000:2.0:1788391037.667060:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788391037.667071:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38464:x1875263103404544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788391037.667489:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38464:x1875263103404544:12345-0@lo:502:llog_process_th.0 Request processed in 419us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.667497:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788391037.667649:0:38464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38464:1875263103404544:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788391037.667712:0:38464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788391037.667729:0:38464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95d68a660000) 00000020:00000080:1.0:1788391037.667750:0:38464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788391037.667822:0:38464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d68f07f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788391037.667827:0:38464:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d68f07f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788391037.667829:0:38464:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d68f07f000 4 00010000:00080000:1.0:1788391037.667868:0:38464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6a6912000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1788391037.674973:0:38464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788391037.675190:0:38464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788391037.675225:0:38464:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788391037.675240:0:38464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aafc5f04cd35689 00000100:00080000:1.0:1788391037.675250:0:38464:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788391037.675255:0:38464:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d6a6912000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391037.675291:0:38464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d685dc5500 x1875263103404672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391037.675335:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103404672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788391037.675409:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391037.675478:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404672 00000100:00100000:1.0:1788391037.675485:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404672 00000100:00100000:1.0:1788391037.675516:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391037.675523:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103404672:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788391037.676865:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103404672:12345-0@lo:38:llog_process_th.0 Request processed in 1337us (1452us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788391037.676875:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788391037.676905:0:38464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788391037.677159:0:38464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38464:1875263103404800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391037.677212:0:38464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391037.677240:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404800 00000100:00100000:1.0:1788391037.677246:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404800 00000100:00100000:1.0:1788391037.677287:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788391037.677295:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38464:x1875263103404800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391037.677522:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38464:x1875263103404800:12345-0@lo:502:llog_process_th.0 Request processed in 227us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.677530:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788391037.677583:0:38464:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138540 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.677603:0:38464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f33d137e-f79f-4925-8ad8-5351efff92b3:38464:1875263103404800:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788391037.677632:0:38464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788391037.677692:0:38417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788391037.677716:0:38417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788391037.677731:0:38417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.677741:0:38417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788391037.677782:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788391037.677784:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788391037.677786:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788391037.677787:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788391037.677788:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788391037.677789:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788391037.677790:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788391037.677791:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788391037.677793:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788391037.677794:0:38417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788391037.677797:0:38417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788391037.677798:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788391037.677799:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788391037.677800:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788391037.677800:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788391037.677801:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788391037.677802:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788391037.677802:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788391037.677803:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788391037.677804:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788391037.677804:0:38417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788391037.677816:0:38417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788391037.677827:0:38417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788391037.677864:0:38417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391037.677878:0:38417:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391037.679008:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103404928 00000100:00100000:1.0:1788391037.679016:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103404928 00000100:00100000:1.0:1788391037.679062:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788391037.679071:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38417:x1875263103404928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788391037.679098:0:38430:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788391037.679113:0:38430:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788391037.683017:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788391037.683031:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a6912000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788391037.683038:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788391037.683043:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103404672:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788391037.731127:0:38430:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788391037.731144:0:38430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788391037.731191:0:38451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788391037.731195:0:38451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788391037.731218:0:38451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731237:0:38451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 12 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731324:0:38451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731366:0:38451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 12 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731380:0:38451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 12 pid: 38427 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391037.731395:0:38451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103405056:0@lo:104: 00000100:00100000:0.0:1788391037.731461:0:38451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.731510:0:38451:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391037.731646:0:38418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405056 00000100:00100000:2.0:1788391037.731655:0:38418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405056 00000100:00100000:2.0:1788391037.731713:0:38418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391037.731724:0:38418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103405056:12345-0@lo:104: 00010000:00010000:2.0:1788391037.731737:0:38418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391037.731798:0:38418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788391037.731809:0:38418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103405056:12345-0@lo:104: Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391037.731816:0:38418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788391037.731939:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391037.731945:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731952:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391037.731956:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.731985:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391037.731991:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391037.731997:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788391037.732027:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732042:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391037.732063:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732070:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd35658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3565f expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732088:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.732090:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391037.732092:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391037.732115:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103405184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391037.732144:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391037.732196:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405184 00000100:00100000:0.0:1788391037.732200:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405184 00010000:00010000:0.0:1788391037.732219:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 13 pid: 38427 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391037.732239:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391037.732246:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+13:3288:x1875263103405184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788391037.732257:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391037.732262:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 13 pid: 38427 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732272:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 13 pid: 38427 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732288:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732307:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788391037.732319:0:38420:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001123793s 00010000:00010000:0.0:1788391037.732323:0:38420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732330:0:38420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732337:0:38420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732343:0:38420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732348:0:38420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391037.732352:0:38420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732358:0:38420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732366:0:38420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732374:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391037.732403:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+13:3288:x1875263103405184:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391037.732411:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391037.732454:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103405184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788391037.732480:0:38451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63c00/0x9aafc5f04cd3565f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35658 expref: 12 pid: 38427 timeout: 954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391037.732490:0:38451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103405056:0@lo:104: 00010000:00010000:0.0:1788391037.732500:0:38451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732508:0:38451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732520:0:38451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391037.732525:0:38451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92800/0x9aafc5f04cd35690 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391037.743716:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38417:x1875263103404928:12345-0@lo:253:mount.lustre.0 Request processed in 64636us (65842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391037.743732:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788391037.743885:0:38417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:38417:1875263103404928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788391037.743902:0:38417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788391037.743906:0:38417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788391037.743908:0:38417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788391037.743909:0:38417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788391037.743919:0:38417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788391037.743920:0:38417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788391037.743922:0:38417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788391037.743923:0:38417:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788391037.743925:0:38417:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788391037.743927:0:38417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788391037.743928:0:38417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788391037.743942:0:38417:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788391037.749399:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.749574:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391037.750184:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.750387:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391037.750703:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.751230:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391037.752331:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.752500:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391037.752768:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.753116:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391037.753379:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391037.753536:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788391037.779933:0:38417:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 17179869275 00000040:01000000:3.0:1788391037.780311:0:38417:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788391037.780607:0:38474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788391037.780667:0:38474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391037.782931:0:38474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788391037.783040:0:38474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788391037.783045:0:38474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788391037.785748:0:38417:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788391037.792162:0:38417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788391037.792601:0:38417:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788391037.792615:0:38417:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788391037.792804:0:38417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788391037.793209:0:38473:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 17179869275 00000020:00080000:0.0:1788391037.793215:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000040:00080000:2.0:1788391037.794956:0:38417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788391037.795584:0:38417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788391037.795614:0:38417:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788391037.796258:0:38417:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 4, last_idx 5 00080000:10000000:2.0:1788391037.797281:0:38417:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/8/4) registered 00000001:00000004:3.0:1788391037.802677:0:38417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:3.0:1788391037.833384:0:38417:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788391037.833419:0:38417:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba858152f988 00100000:10000000:3.0:1788391037.833428:0:38417:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788391037.834452:0:38417:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788391037.834475:0:38417:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788391037.834491:0:38417:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788391037.834519:0:38417:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788391038.413156:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391038.734184:0:38470:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788391038.734194:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391038.734550:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:3.0:1788391038.734557:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 10000000:01000000:2.0:1788391039.374122:0:38432:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788391039.374128:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68f07f000 from 18 10000000:01000000:2.0:1788391039.374132:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788391039.374168:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391039.374177:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391039.374192:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391039.374211:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103405312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788391039.374267:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391039.374301:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391039.377114:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405312 00000100:00100000:1.0:1788391039.377127:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405312 00000100:00100000:1.0:1788391039.377219:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788391039.377231:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38432:x1875263103405312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391039.377248:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391039.377268:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35697 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391039.377297:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391039.377308:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391039.377317:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a0f63400, rc 0) 00000100:00100000:1.0:1788391039.377400:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103405312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391039.377406:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788391039.377484:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103405312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391039.377502:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391039.377511:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391039.377570:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103405440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788391039.377611:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391039.382201:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391039.382336:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405440 00000100:00100000:2.0:1788391039.382345:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405440 00000100:00100000:2.0:1788391039.382397:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788391039.382407:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103405440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788391039.382431:0:38427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788391039.382445:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788391039.382448:0:38427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 18 00000100:00100000:2.0:1788391039.382560:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103405440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391039.382568:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788391039.382664:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103405440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788391039.382713:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788391039.382723:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391039.382734:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391039.439156:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391039.768433:0:38470:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788391039.768442:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391039.768469:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:0.0:1788391039.768474:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:0.0:1788391040.464043:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788391040.978141:0:38718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788391041.493609:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391042.509318:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788391042.855924:0:38868:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe051508a0 20000000:00000080:2.0:1788391042.855941:0:38868:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d6b6b96400 uarg=0000000000000000 20000000:01000000:2.0:1788391042.856118:0:38868:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788391042.856124:0:38868:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788391042.856129:0:38868:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788391042.856801:0:38869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788391042.857123:0:38868:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788391042.870662:0:38868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788391042.870693:0:38868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.870713:0:38868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 11 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.870732:0:38868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.870790:0:38868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 11 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.870806:0:38868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 11 pid: 38430 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391042.870823:0:38868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38868:1875263103405568:0@lo:104: 00000100:00100000:2.0:1788391042.870912:0:38868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391042.870952:0:38868:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69194d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391042.871027:0:38418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405568 00000100:00100000:1.0:1788391042.871035:0:38418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405568 00000100:00100000:1.0:1788391042.871096:0:38418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391042.871107:0:38418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38868:x1875263103405568:12345-0@lo:104: 00010000:00010000:1.0:1788391042.871119:0:38418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391042.871165:0:38418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788391042.871171:0:38418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38868:x1875263103405568:12345-0@lo:104: Request processed in 67us (259us total) trans 0 rc 0/0 00010000:00010000:3.0:1788391042.871183:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788391042.871184:0:38418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788391042.871190:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.871197:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788391042.871201:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.871271:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788391042.871281:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391042.871287:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788391042.871321:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.871397:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788391042.871484:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103405696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391042.871513:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391042.871543:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.871551:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d5877aa800/0x9aafc5f04cd35666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3566d expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.871568:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391042.871570:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391042.871572:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391042.871891:0:38868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:38868:1875263103405568:0@lo:104: 00010000:00010000:2.0:1788391042.871909:0:38868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391042.872084:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405696 00000100:00100000:2.0:1788391042.872088:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405696 00010000:00010000:2.0:1788391042.872103:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 12 pid: 38430 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391042.872126:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788391042.872133:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:3289:x1875263103405696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391042.872144:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391042.872149:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 12 pid: 38430 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872159:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 12 pid: 38430 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872179:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd200/0x9aafc5f04cd3566d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35666 expref: 12 pid: 38430 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872189:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872195:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872204:0:38422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872208:0:38422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872215:0:38422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872222:0:38422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872227:0:38422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391042.872231:0:38422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872238:0:38422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872260:0:38422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.872278:0:38868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391042.872279:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391042.872285:0:38868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391042.872291:0:38868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877aae00/0x9aafc5f04cd356a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391042.872311:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+11:3289:x1875263103405696:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391042.872317:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391042.872442:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103405696:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788391043.021096:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788391043.021103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788391043.021106:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788391043.021109:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788391043.021112:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788391043.021115:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788391043.021119:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6a6912000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788391043.021130:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d6a6912000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391043.021152:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d685dc5180 x1875263103405952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391043.021495:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103405824:0@lo:400:kworker.0 00000100:00100000:1.0:1788391043.021564:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391043.021645:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103405952:0@lo:38:kworker.0 00000100:00100000:1.0:1788391043.021677:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391043.021941:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405824 00000100:00100000:1.0:1788391043.021950:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405824 00000100:00100000:1.0:1788391043.022020:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788391043.022030:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:3286:x1875263103405824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391043.022083:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+11:3286:x1875263103405824:12345-0@lo:400:kworker.0 Request processed in 54us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391043.022104:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788391043.022197:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103405824:0@lo:400:kworker.0 00000100:00100000:3.0:1788391043.022631:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103405952 00000100:00100000:3.0:1788391043.022637:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103405952 00000100:00100000:3.0:1788391043.022662:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391043.022667:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103405952:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788391043.022707:0:38437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 860 last 0 00000020:00000080:3.0:1788391043.022906:0:38437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aafc5f04cd356ac 00000004:00100000:3.0:1788391043.022922:0:38437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788391043.023071:0:38437:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788391043.023676:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103405952:12345-0@lo:38:kworker.0 Request processed in 1006us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391043.023684:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788391043.024585:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d685dc5180 x1875263103405952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788391043.024603:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1788391043.024612:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788391043.024616:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788391043.024620:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a6912000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788391043.024627:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103405952:0@lo:38:kworker.0 00010000:00010000:0.0:1788391043.537580:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391044.558744:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788391044.621115:0:38432:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788391044.621236:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68f07f000 from 10 10000000:01000000:1.0:1788391044.621242:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788391044.621294:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391044.621318:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391044.621330:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391044.621354:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788391044.621422:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391044.621540:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391044.621906:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406080 00000100:00100000:2.0:1788391044.621914:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406080 00000100:00100000:2.0:1788391044.622014:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788391044.622025:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+11:38432:x1875263103406080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391044.622038:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391044.622053:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd356b3 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391044.622075:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391044.622085:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391044.622093:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877ab200, rc 0) 00000100:00100000:2.0:1788391044.622146:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103406080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391044.622153:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788391044.622295:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391044.622376:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391044.622386:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391044.622441:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788391044.622469:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391044.622542:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:0.0:1788391044.622631:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406208 00000100:00100000:0.0:1788391044.622636:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406208 00000100:00100000:0.0:1788391044.622705:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391044.622724:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103406208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391044.623044:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103406208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391044.623052:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788391044.623136:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391044.623174:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391044.623212:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391044.623999:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391044.624204:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406336 00000100:00100000:1.0:1788391044.624211:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406336 00000100:00100000:1.0:1788391044.624257:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788391044.624266:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103406336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788391044.624562:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:38432:x1875263103406336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391044.624570:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788391044.624653:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103406336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788391044.625576:0:38988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788391044.625648:0:38432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788391044.625668:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788391044.625677:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391044.625687:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391045.582217:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788391046.226349:0:39117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788391046.226362:0:39117:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788391046.226545:0:39117:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d6bbee1000 00000020:01000004:3.0:1788391046.226557:0:39117:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788391046.226567:0:39117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788391046.226577:0:39117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d6bc75cd28) 00000020:00000080:3.0:1788391046.226588:0:39117:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788391046.240957:0:39117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788391046.241290:0:39117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788391046.246450:0:39117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788391046.246710:0:39117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788391046.247177:0:39117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:3.0:1788391046.247864:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 657: rc = 0 00100000:10000000:3.0:1788391046.248051:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 657: rc = 0 00100000:10000000:3.0:1788391046.248142:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 657: rc = 0 00100000:10000000:3.0:1788391046.249442:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 571: rc = 0 00100000:10000000:3.0:1788391046.249712:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 571: rc = 0 00100000:10000000:3.0:1788391046.255726:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 571: rc = 0 00100000:10000000:3.0:1788391046.256188:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 571: rc = 0 00100000:10000000:3.0:1788391046.256572:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 571: rc = 0 00100000:10000000:3.0:1788391046.256821:0:39117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 571: rc = 0 00000020:00000080:2.0:1788391046.263942:0:39117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788391046.263955:0:39117:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788391046.264074:0:39117:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd356c8 00000020:01000004:2.0:1788391046.264083:0:39117:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788391046.264105:0:39117:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788391046.264118:0:39117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788391046.264125:0:39117:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788391046.264131:0:39117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788391046.264148:0:39117:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d6a6bd19b8) 00000020:00000080:2.0:1788391046.264159:0:39117:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788391046.267151:0:39117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391046.267329:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788391046.267335:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788391046.275411:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788391046.275427:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788391046.278350:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788391046.278415:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788391046.279949:0:39117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391046.280312:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788391046.280318:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788391046.281253:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788391046.281263:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788391046.300382:0:39117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391046.300602:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788391046.300609:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788391046.301813:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788391046.301822:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788391046.302383:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788391046.302391:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788391046.303818:0:39117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391046.304936:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788391046.304944:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788391046.305431:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788391046.305438:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788391046.338870:0:39117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391046.339103:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788391046.339110:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788391046.340097:0:39117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788391046.340105:0:39117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788391046.340437:0:39117:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788391046.340659:0:39117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788391046.340666:0:39117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788391046.355777:0:39117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788391046.355827:0:39117:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788391046.355845:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788391046.355847:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391046.355848:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391046.355849:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391046.355851:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391046.355852:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391046.355855:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391046.355856:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391046.355858:0:39117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391046.355861:0:39117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788391046.355864:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788391046.355865:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391046.355866:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391046.355867:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391046.355868:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391046.355870:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391046.355871:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391046.355872:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391046.355873:0:39117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391046.355907:0:39117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788391046.355929:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788391046.356201:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.356329:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.356475:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406464 00000100:00100000:1.0:1788391046.356484:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406464 00000100:00100000:1.0:1788391046.356591:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788391046.356601:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:39117:x1875263103406464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788391046.356632:0:38427:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788391046.356635:0:38427:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788391046.356639:0:38427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788391046.360858:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:39117:x1875263103406464:12345-0@lo:253:mount.lustre.0 Request processed in 4252us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391046.361063:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788391046.361075:0:39117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788391046.361078:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788391046.361079:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391046.361080:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391046.361081:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391046.361082:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391046.361083:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391046.361084:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391046.361085:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391046.361086:0:39117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788391046.361101:0:39117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d6bbee1000 from lustre-OST0000 10000000:01000000:3.0:1788391046.361119:0:39117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788391046.361120:0:39117:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788391046.361125:0:39117:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d5873ecd28 local copy 00010000:00010000:3.0:1788391046.361133:0:39117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391046.361350:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391046.361380:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.361407:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.361426:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406592 00000100:00100000:2.0:1788391046.361434:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406592 00000100:00100000:0.0:1788391046.361463:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788391046.361642:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788391046.361941:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:39117:x1875263103406592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391046.362122:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+12:39117:x1875263103406592:12345-0@lo:501:mount.lustre.0 Request processed in 472us (742us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391046.362129:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788391046.362140:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406592:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788391046.362153:0:39117:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788391046.362401:0:39117:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788391046.362408:0:39117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.362429:0:39117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391046.362449:0:39117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6bbee1000 10000000:01000000:3.0:1788391046.362453:0:39117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788391046.362458:0:39117:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d5873ecd28 10000000:01000000:3.0:1788391046.362460:0:39117:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788391046.362464:0:39117:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d5873ecd28 from 1 10000000:01000000:3.0:1788391046.362467:0:39117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788391046.362489:0:39117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.362497:0:39117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.362507:0:39117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391046.362520:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391046.362547:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.362579:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788391046.362844:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406720 00000100:00100000:0.0:1788391046.362850:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406720 00000100:00100000:0.0:1788391046.362945:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788391046.362954:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+12:39117:x1875263103406720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391046.362982:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391046.362997:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93600/0x9aafc5f04cd356dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd356d6 expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.363030:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93600/0x9aafc5f04cd356dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd356d6 expref: 13 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.363039:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93600/0x9aafc5f04cd356dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd356d6 expref: 13 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.363050:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93600, rc 0) 00000100:00100000:0.0:1788391046.363090:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+13:39117:x1875263103406720:12345-0@lo:101:mount.lustre.0 Request processed in 137us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391046.363096:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788391046.363172:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391046.363446:0:39117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.363456:0:39117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391046.363486:0:39117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788391046.363494:0:39117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.363501:0:39117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391046.363509:0:39117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788391046.363513:0:39117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788391046.363518:0:39117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788391046.363521:0:39117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788391046.363539:0:39117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.363546:0:39117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.363553:0:39117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391046.363565:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391046.363593:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.363680:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.363716:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406848 00000100:00100000:2.0:1788391046.363721:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406848 00000100:00100000:2.0:1788391046.363751:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788391046.363757:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+13:39117:x1875263103406848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391046.363773:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391046.363781:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d5877ab000/0x9aafc5f04cd356eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd356e4 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.363795:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877ab000/0x9aafc5f04cd356eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd356e4 expref: 14 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.363803:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d5877ab000/0x9aafc5f04cd356eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd356e4 expref: 14 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.363808:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877ab000, rc 0) 00000100:00100000:2.0:1788391046.363895:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103406848:12345-0@lo:101:mount.lustre.0 Request processed in 137us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391046.363902:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391046.364031:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391046.364042:0:39117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.364049:0:39117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391046.364740:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:3.0:1788391046.365664:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391046.365905:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:3.0:1788391046.365948:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:3.0:1788391046.366115:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:3.0:1788391046.366145:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:3.0:1788391046.366164:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:3.0:1788391046.366180:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:3.0:1788391046.366202:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:3.0:1788391046.366220:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:3.0:1788391046.366236:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:3.0:1788391046.366274:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:3.0:1788391046.366303:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:3.0:1788391046.366330:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:3.0:1788391046.366361:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:3.0:1788391046.366366:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:3.0:1788391046.366427:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391046.366474:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.366509:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.366675:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103406976 00000100:00100000:1.0:1788391046.366682:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103406976 00000100:00100000:1.0:1788391046.366725:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391046.366748:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103406976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391046.367076:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103406976:12345-0@lo:501:mount.lustre.0 Request processed in 340us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.367090:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788391046.367114:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103406976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391046.367143:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391046.367171:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.367195:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391046.367228:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407104 00000100:00100000:0.0:1788391046.367233:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407104 00000100:00100000:0.0:1788391046.367278:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788391046.367286:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391046.367596:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407104:12345-0@lo:503:mount.lustre.0 Request processed in 311us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391046.367603:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788391046.367660:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788391046.369711:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788391046.369787:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391046.369866:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391046.369910:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.369940:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407232 00000100:00100000:1.0:1788391046.369948:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407232 00000100:00100000:1.0:1788391046.370010:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788391046.370019:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391046.370250:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407232:12345-0@lo:502:mount.lustre.0 Request processed in 232us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.370261:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788391046.370287:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.370586:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:3.0:1788391046.370643:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:3.0:1788391046.370677:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:3.0:1788391046.370726:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:3.0:1788391046.370761:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:3.0:1788391046.370805:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:3.0:1788391046.370867:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:3.0:1788391046.370903:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:3.0:1788391046.370936:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:3.0:1788391046.371001:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:3.0:1788391046.371027:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:3.0:1788391046.371065:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:3.0:1788391046.371090:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.371199:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.371233:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391046.371257:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407360 00000100:00100000:0.0:1788391046.371263:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407360 00000100:00100000:0.0:1788391046.371305:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788391046.371314:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391046.371482:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407360:12345-0@lo:502:mount.lustre.0 Request processed in 169us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391046.371490:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788391046.372053:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.372130:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:3.0:1788391046.372140:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788391046.374194:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788391046.374206:0:39131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788391046.374213:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.374215:0:39131:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788391046.374223:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788391046.374239:0:39131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d6bc75b370) 00000020:00000080:3.0:1788391046.374272:0:39131:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788391046.374279:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788391046.374366:0:39131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bbee1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788391046.374374:0:39131:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788391046.374381:0:39131:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd356f9 00010000:00010000:3.0:1788391046.377595:0:39131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788391046.379093:0:39131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836486 00080000:10000000:3.0:1788391046.383614:0:39131:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:3.0:1788391046.385349:0:39131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788391046.385360:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.385366:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385369:0:39131:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788391046.385372:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788391046.385374:0:39131:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788391046.385376:0:39131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788391046.385377:0:39131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788391046.385379:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788391046.385381:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385382:0:39131:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788391046.385385:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391046.385387:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385388:0:39131:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788391046.385391:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788391046.385392:0:39131:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788391046.385394:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.385396:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385398:0:39131:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788391046.385400:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391046.385402:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385403:0:39131:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788391046.385406:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788391046.385457:0:39131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.385460:0:39131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.385462:0:39131:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788391046.385464:0:39131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:0.0:1788391046.389076:0:39117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788391046.389118:0:39117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788391046.389146:0:39117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.389159:0:39117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391046.389167:0:39117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bbee1000 from 1 10000000:01000000:0.0:1788391046.389170:0:39117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788391046.389212:0:39117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.389220:0:39117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.389232:0:39117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391046.389256:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788391046.389333:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391046.389375:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.389456:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407488 00000100:00100000:2.0:1788391046.389465:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407488 00000100:00100000:2.0:1788391046.389512:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788391046.389522:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+14:39117:x1875263103407488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391046.389535:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391046.389548:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35700 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.389573:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 15 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.389597:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 15 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.389606:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877aa000, rc 0) 00000100:00100000:2.0:1788391046.389660:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407488:12345-0@lo:101:mount.lustre.0 Request processed in 140us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391046.389667:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391046.389698:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391046.389718:0:39117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.389727:0:39117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391046.390389:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:0.0:1788391046.391681:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788391046.391943:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:0.0:1788391046.392018:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:0.0:1788391046.392070:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:0.0:1788391046.392105:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:0.0:1788391046.392134:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:0.0:1788391046.392180:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:0.0:1788391046.392213:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:0.0:1788391046.392274:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:0.0:1788391046.392340:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:0.0:1788391046.392349:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:0.0:1788391046.392428:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391046.392496:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391046.392540:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574900 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.392553:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407616 00000100:00100000:1.0:1788391046.392561:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407616 00000100:00100000:1.0:1788391046.392607:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788391046.392616:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391046.392858:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407616:12345-0@lo:501:mount.lustre.0 Request processed in 243us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.392866:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788391046.393174:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391046.393211:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391046.393252:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391046.393267:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca92180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.393419:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407744 00000100:00100000:1.0:1788391046.393424:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407744 00000100:00100000:1.0:1788391046.393489:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788391046.393497:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391046.393702:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407744:12345-0@lo:503:mount.lustre.0 Request processed in 205us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.393710:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788391046.393819:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788391046.394300:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788391046.394353:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.394392:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.396542:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.396593:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103407872 00000100:00100000:2.0:1788391046.396602:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103407872 00000100:00100000:2.0:1788391046.396648:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788391046.396657:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391046.398215:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103407872:12345-0@lo:502:mount.lustre.0 Request processed in 1553us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391046.398228:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788391046.398254:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103407872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.398473:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788391046.398533:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1788391046.398561:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1788391046.398580:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1788391046.398595:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:3.0:1788391046.398618:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1788391046.398635:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:3.0:1788391046.398656:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:3.0:1788391046.398692:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.398737:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.398775:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.399050:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408000 00000100:00100000:2.0:1788391046.399057:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408000 00000100:00100000:2.0:1788391046.399088:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788391046.399096:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103408000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391046.399271:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103408000:12345-0@lo:502:mount.lustre.0 Request processed in 174us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391046.399279:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788391046.399292:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.399466:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1788391046.399476:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788391046.400190:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391046.400198:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400200:0:39135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788391046.400203:0:39135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bbee1000 00000020:00000080:3.0:1788391046.400205:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788391046.400210:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.400211:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400212:0:39135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788391046.400214:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391046.400215:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400216:0:39135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788391046.400218:0:39135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bbee1000 00000020:00000080:3.0:1788391046.400219:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788391046.400261:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.400263:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400264:0:39135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788391046.400265:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391046.400273:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400274:0:39135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788391046.400276:0:39135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6bbee1000 00000020:00000080:3.0:1788391046.400278:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788391046.400309:0:39135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391046.400313:0:39135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391046.400314:0:39135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788391046.400317:0:39135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:2.0:1788391046.408004:0:39117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788391046.408046:0:39117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788391046.408073:0:39117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408086:0:39117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391046.408133:0:39117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788391046.408136:0:39117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6bbee1000 10000000:01000000:2.0:1788391046.408140:0:39117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6bbee1000 10000000:01000000:2.0:1788391046.408143:0:39117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788391046.408149:0:39117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6bbee1000 from 1 10000000:01000000:2.0:1788391046.408152:0:39117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788391046.408186:0:39117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408194:0:39117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408203:0:39117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391046.408225:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788391046.408289:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391046.408326:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408128 00000100:00100000:2.0:1788391046.408333:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408128 00000100:00100000:2.0:1788391046.408376:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788391046.408386:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103408128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391046.408396:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391046.408415:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d5877ab600/0x9aafc5f04cd35715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3570e expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408436:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d5877ab600/0x9aafc5f04cd35715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3570e expref: 16 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408446:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d5877ab600/0x9aafc5f04cd35715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3570e expref: 16 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408454:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d5877ab600, rc 0) 00000100:00100000:2.0:1788391046.408484:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408128:12345-0@lo:101:mount.lustre.0 Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391046.408490:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788391046.408531:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.408550:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391046.408563:0:39117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391046.408571:0:39117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391046.409397:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:2.0:1788391046.412066:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391046.412387:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:2.0:1788391046.412432:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:2.0:1788391046.412454:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:2.0:1788391046.412500:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:2.0:1788391046.412526:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:2.0:1788391046.412549:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:2.0:1788391046.412566:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:2.0:1788391046.412592:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:2.0:1788391046.412617:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:2.0:1788391046.412634:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:2.0:1788391046.412650:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:2.0:1788391046.412672:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:2.0:1788391046.414869:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:2.0:1788391046.414940:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:2.0:1788391046.415064:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:2.0:1788391046.415134:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:2.0:1788391046.415180:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:2.0:1788391046.415254:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:2.0:1788391046.415300:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:2.0:1788391046.415348:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:2.0:1788391046.415397:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:2.0:1788391046.415434:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:2.0:1788391046.415467:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:2.0:1788391046.415515:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:2.0:1788391046.415562:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:2.0:1788391046.415609:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:2.0:1788391046.415674:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:2.0:1788391046.416859:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:2.0:1788391046.416896:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:2.0:1788391046.416951:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:2.0:1788391046.417001:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:2.0:1788391046.417055:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:2.0:1788391046.417093:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:2.0:1788391046.417153:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:2.0:1788391046.417206:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:2.0:1788391046.417257:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:2.0:1788391046.417293:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:2.0:1788391046.417327:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:2.0:1788391046.417370:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:2.0:1788391046.417403:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:2.0:1788391046.417512:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:2.0:1788391046.417520:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:2.0:1788391046.417619:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391046.418783:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391046.418843:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.418871:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408256 00000100:00100000:1.0:1788391046.418879:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408256 00000100:00100000:1.0:1788391046.418935:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788391046.418946:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391046.419300:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408256:12345-0@lo:501:mount.lustre.0 Request processed in 355us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.419308:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788391046.419787:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391046.419846:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391046.419891:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391046.419934:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.420175:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408384 00000100:00100000:1.0:1788391046.420180:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408384 00000100:00100000:1.0:1788391046.420216:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391046.420225:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391046.420378:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408384:12345-0@lo:503:mount.lustre.0 Request processed in 154us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.420386:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788391046.420515:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788391046.421459:0:39117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788391046.421534:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.421589:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.421626:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391046.421636:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408512 00000100:00100000:1.0:1788391046.421641:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408512 00000100:00100000:1.0:1788391046.421680:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788391046.421689:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391046.421865:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408512:12345-0@lo:502:mount.lustre.0 Request processed in 176us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.421873:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788391046.422197:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.422398:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788391046.422447:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:3.0:1788391046.422479:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:3.0:1788391046.422549:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:3.0:1788391046.422590:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:3.0:1788391046.422628:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:3.0:1788391046.422663:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:3.0:1788391046.422871:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:3.0:1788391046.422924:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1788391046.423005:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:3.0:1788391046.423046:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:3.0:1788391046.423107:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:3.0:1788391046.423145:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:3.0:1788391046.423255:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:3.0:1788391046.423317:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:3.0:1788391046.423353:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:3.0:1788391046.423399:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:3.0:1788391046.423442:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:3.0:1788391046.423472:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:3.0:1788391046.423516:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:3.0:1788391046.423561:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:3.0:1788391046.423594:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:3.0:1788391046.423622:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:3.0:1788391046.423662:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:3.0:1788391046.423865:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:3.0:1788391046.423902:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:3.0:1788391046.423956:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:3.0:1788391046.424524:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:3.0:1788391046.424571:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:3.0:1788391046.424635:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:3.0:1788391046.424674:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:3.0:1788391046.424893:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:3.0:1788391046.424929:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:3.0:1788391046.425016:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:3.0:1788391046.425078:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:3.0:1788391046.425153:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:3.0:1788391046.425465:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:3.0:1788391046.425502:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:3.0:1788391046.425543:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:3.0:1788391046.425570:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:3.0:1788391046.425618:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.425762:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.425809:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.425861:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408640 00000100:00100000:2.0:1788391046.425868:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408640 00000100:00100000:2.0:1788391046.425922:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788391046.425932:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391046.428933:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408640:12345-0@lo:502:mount.lustre.0 Request processed in 2997us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391046.428947:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788391046.429909:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391046.430266:0:39117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:3.0:1788391046.430293:0:39117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788391046.431246:0:39140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788391046.431264:0:39140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d6bc2799b8) 00000020:00000080:0.0:1788391046.431285:0:39140:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788391046.431475:0:39140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bbee1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788391046.431478:0:39140:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6bbee1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788391046.431480:0:39140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bbee1000 3 00010000:00080000:0.0:1788391046.431501:0:39140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d587169800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788391046.432726:0:39140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788391046.432885:0:39140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788391046.432908:0:39140:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788391046.432917:0:39140:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd35723 00000100:00080000:0.0:1788391046.432925:0:39140:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788391046.432929:0:39140:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d587169800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391046.433167:0:39140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687860700 x1875263103408768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788391046.433196:0:39140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788391046.433685:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103408768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788391046.433766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391046.434370:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408768 00000100:00100000:0.0:1788391046.434382:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408768 00000100:00100000:0.0:1788391046.434421:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788391046.434427:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103408768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788391046.434451:0:38436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 863 last 0 00000020:00000080:0.0:1788391046.434481:0:38436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd3572a 00000004:00100000:0.0:1788391046.434495:0:38436:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788391046.434524:0:38436:0:(import.c:65:import_set_state_nolock()) ffff95d58716c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391046.434578:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103408768:12345-0@lo:38:llog_process_th.0 Request processed in 149us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391046.434585:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788391046.434613:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d687860700 x1875263103408768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391046.434623:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788391046.434632:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00080000:1.0:1788391046.434639:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788391046.434643:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788391046.434645:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d587169800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788391046.434650:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103408768:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788391046.434717:0:39140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000020:01000000:1.0:1788391046.434785:0:39117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788391046.434815:0:39117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788391046.434879:0:39117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391046.434891:0:39117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788391046.434946:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788391046.434949:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788391046.434950:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391046.434951:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391046.434952:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391046.434953:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391046.434955:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391046.434956:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391046.434957:0:39117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391046.434976:0:39117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788391046.434978:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788391046.434979:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788391046.434980:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391046.434981:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391046.434982:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391046.434983:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391046.434984:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391046.434985:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391046.434986:0:39117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391046.435012:0:39117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788391046.435027:0:39117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788391046.435064:0:39117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391046.435084:0:39117:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391046.435205:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103408896 00000100:00100000:2.0:1788391046.435210:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103408896 00000100:00100000:2.0:1788391046.435248:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788391046.435255:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39117:x1875263103408896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788391046.435274:0:38430:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788391046.435287:0:38430:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788391046.436048:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391046.436054:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788391046.436056:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391046.436059:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788391046.436117:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103409024:0@lo:400:kworker.0 00000100:00100000:1.0:1788391046.436157:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391046.436703:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409024 00000100:00100000:1.0:1788391046.436709:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409024 00000100:00100000:1.0:1788391046.436783:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391046.436792:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103409024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391046.436863:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103409024:12345-0@lo:400:kworker.0 Request processed in 73us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.436870:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788391046.437020:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d687861880 x1875263103409024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391046.437035:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103409024:0@lo:400:kworker.0 20000000:01000000:1.0:1788391046.454951:0:38430:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788391046.455058:0:38430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788391046.455176:0:38451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788391046.455181:0:38451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788391046.455201:0:38451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.455218:0:38451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 16 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.455226:0:38451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.455262:0:38451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 16 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.455287:0:38451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 16 pid: 38428 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391046.455303:0:38451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103409152:0@lo:104: 00000100:00100000:0.0:1788391046.455364:0:38451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391046.455446:0:38451:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788391046.455569:0:38419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409152 00000100:00100000:3.0:1788391046.455576:0:38419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409152 00000100:00100000:3.0:1788391046.456990:0:38419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391046.457003:0:38419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103409152:12345-0@lo:104: 00010000:00010000:3.0:1788391046.457018:0:38419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457085:0:38419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788391046.457091:0:38419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103409152:12345-0@lo:104: Request processed in 92us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391046.457099:0:38419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788391046.457122:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391046.457128:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457135:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aaa00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788391046.457139:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457148:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788391046.457156:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391046.457162:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788391046.457192:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457210:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788391046.457212:0:38451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103409152:0@lo:104: 00010000:00010000:3.0:1788391046.457229:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.457230:0:38451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457236:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d5877aaa00/0x9aafc5f04cd35697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3569e expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391046.457249:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788391046.457253:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391046.457255:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391046.457256:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391046.457259:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103409280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391046.457289:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391046.457370:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409280 00000100:00100000:3.0:1788391046.457376:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409280 00010000:00010000:3.0:1788391046.457395:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 17 pid: 38428 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391046.457457:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391046.457465:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:3289:x1875263103409280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391046.457475:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391046.457480:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 17 pid: 38428 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457491:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 17 pid: 38428 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457503:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63400/0x9aafc5f04cd3569e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35697 expref: 17 pid: 38428 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457516:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457534:0:38421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788391046.457546:0:38421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002365176s 00010000:00010000:3.0:1788391046.457550:0:38421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457557:0:38421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457563:0:38421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457570:0:38421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457575:0:38421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391046.457579:0:38421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457586:0:38421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457605:0:38421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391046.457615:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391046.457643:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+16:3289:x1875263103409280:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391046.457650:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788391046.457809:0:38451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.457817:0:38451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391046.457822:0:38451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93000/0x9aafc5f04cd35731 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391046.457856:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103409280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788391046.461450:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+15:39117:x1875263103408896:12345-0@lo:253:mount.lustre.0 Request processed in 26187us (26376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391046.461460:0:39117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39117:1875263103408896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788391046.461465:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 10000000:01000000:1.0:1788391046.461474:0:39117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788391046.461477:0:39117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788391046.461478:0:39117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788391046.461480:0:39117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391046.461481:0:39117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391046.461482:0:39117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391046.461483:0:39117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391046.461484:0:39117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391046.461486:0:39117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391046.461487:0:39117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788391046.461501:0:39117:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788391046.462053:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391046.462225:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391046.462387:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391046.462538:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391046.462693:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391046.463074:0:39117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788391046.463632:0:39117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:1.0:1788391046.488404:0:39117:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788391046.488413:0:39117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788391046.488447:0:39117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788391046.488500:0:39117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788391046.488512:0:39117:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788391046.488544:0:39117:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788391046.606069:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391047.439068:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788391037/real 1788391037] req@ffff95d584a0dc00 x1875263103403008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391047.439105:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d584a0dc00 x1875263103403008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391047.439117:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788391037/real 1788391037] req@ffff95d687862a00 x1875263103402880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391047.439129:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d687862a00 x1875263103402880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788391047.439154:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788391047.439175:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788391047.439179:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103403008:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788391047.439186:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fad000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788391047.439192:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788391047.439195:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103402880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788391047.439574:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391047.439579:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788391047.439582:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fad000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391047.439587:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 854 00000100:00080000:0.0:1788391047.439602:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788391047.439610:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6a0fad000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391047.439646:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687861f80 x1875263103409536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788391047.439662:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391047.439666:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788391047.439668:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391047.439671:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 854 00000100:00080000:0.0:1788391047.439673:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788391047.439678:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6865e0000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391047.439689:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687860a80 x1875263103409664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788391047.439733:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391047.439748:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103409408:0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.439859:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391047.439932:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103409792:0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440013:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391047.440037:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391047.440043:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103409920:0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440072:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391047.440108:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409408 00000100:00100000:0.0:1788391047.440117:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409408 00000100:00100000:0.0:1788391047.440172:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788391047.440182:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+15:3288:x1875263103409408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440237:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+15:3288:x1875263103409408:12345-0@lo:400:kworker.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391047.440253:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788391047.440293:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409792 00000100:00100000:0.0:1788391047.440297:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409792 00000100:00100000:0.0:1788391047.440321:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409920 00000100:00100000:0.0:1788391047.440325:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409920 00000100:00100000:0.0:1788391047.440351:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391047.440357:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103409792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440393:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103409792:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391047.440399:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391047.440411:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788391047.440417:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103409920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440442:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103409920:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391047.440448:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788391047.440492:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687863100 x1875263103409920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391047.440507:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103409920:0@lo:400:kworker.0 00010000:00080000:0.0:1788391047.440517:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687863480 x1875263103409792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391047.440525:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103409792:0@lo:400:kworker.0 00000100:00100000:0.0:1788391047.440548:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103409536:0@lo:8:kworker.0 00000100:00100000:0.0:1788391047.440597:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391047.440625:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103409664:0@lo:8:kworker.0 00000100:00100000:0.0:1788391047.440657:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391047.440693:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409536 00000100:00100000:0.0:1788391047.440697:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409536 00000100:00100000:0.0:1788391047.440713:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103409664 00000100:00100000:0.0:1788391047.440715:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103409664 00000100:00100000:0.0:1788391047.440724:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391047.440729:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103409536:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788391047.440757:0:39120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 864 last 0 00000020:00000080:0.0:1788391047.440791:0:39120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd35738 00002000:00100000:0.0:1788391047.440809:0:39120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d58716e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788391047.440813:0:39120:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788391047.440817:0:39120:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788391047.441297:0:39120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788391047.441328:0:39120:0:(import.c:65:import_set_state_nolock()) ffff95d58716b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391047.441376:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103409536:12345-0@lo:8:kworker.0 Request processed in 645us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391047.441384:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391047.441402:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391047.441407:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103409664:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788391047.441416:0:39120:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788391047.441786:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391047.446141:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103409408:0@lo:400:kworker.0 00010000:00080000:1.0:1788391047.450076:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687861f80 x1875263103409536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788391062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391047.450091:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788391047.450104:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1788391047.450114:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788391047.450121:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788391047.450124:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fad000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788391047.450145:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788391047.450152:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103409536:0@lo:8:kworker.0 00000004:00080000:2.0:1788391047.450228:0:38458:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x82:0x0] 00000100:00100000:2.0:1788391047.450257:0:38458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38458:1875263103410176:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788391047.450340:0:38458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391047.450374:0:38458:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b64053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391047.450402:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391047.450416:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103410048:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788391047.450482:0:38457:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788391047.450878:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391047.450984:0:39118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788391047.450993:0:39118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1788391047.451007:0:38457:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 864558044988ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788391047.451164:0:39122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410048 00000100:00100000:1.0:1788391047.451173:0:39122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410048 00000100:00100000:2.0:1788391047.451218:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410176 00000100:00100000:2.0:1788391047.451222:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410176 00000100:00100000:1.0:1788391047.451316:0:39122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391047.451329:0:39122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103410048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391047.451358:0:39122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391047.451415:0:39122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103410048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391047.451423:0:39122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788391047.451468:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391047.451549:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391047.451557:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:38458:x1875263103410176:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1788391047.452000:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d584a0dc00 x1875263103410048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788391063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391047.452023:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103410048:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788391047.455447:0:39118:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788391047.455461:0:39118:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -31 00002000:02000040:2.0:1788391047.455467:0:39118:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) 00000100:00100000:0.0:1788391047.461713:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103409664:12345-0@lo:8:kworker.0 Request processed in 20298us (21049us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788391047.461727:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788391047.461877:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788391047.461888:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788391047.461893:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103409664:0@lo:8:kworker.0 00002000:00010000:2.0:1788391047.476404:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.476423:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.476445:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.476452:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.476472:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.476619:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.476650:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.476658:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.476684:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.476831:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.476846:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.476860:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.476865:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.476878:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.476907:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.476917:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3573f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.476946:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.476949:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.476951:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.477847:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.477857:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.477868:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.477872:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.477878:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.477890:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.477900:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.477907:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.477944:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.478133:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.478219:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.478250:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.478256:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.478269:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.478293:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.478302:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036934fe0/0x9aafc5f04cd35746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.478325:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.478328:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.478331:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.478597:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.478715:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.478725:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.478728:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.478733:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.478743:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.478752:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.478759:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.478859:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.479259:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.479269:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.479279:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.479286:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.479298:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.479324:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.479332:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4eb89b/0x9aafc5f04cd3574d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.479351:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.479353:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.479355:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.480128:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.480138:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.480150:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.480160:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.480165:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.480175:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.480183:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.480190:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.480211:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.480248:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.480258:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.480284:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aac00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.480289:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.480298:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.480313:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.480321:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057124837/0x9aafc5f04cd35754 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.480344:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.480347:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.480349:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391047.482078:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788391047.482190:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.482204:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.482219:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.482223:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.482229:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.482242:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.482251:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.482265:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.482290:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.482318:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.482330:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.482344:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.482350:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.482362:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.482386:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.482395:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a6a0f9/0x9aafc5f04cd3575b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.482444:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.482449:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.482452:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.483332:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.483342:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.483354:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.483357:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.483361:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.483372:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.483381:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.483389:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.483409:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.483442:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.483453:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.483464:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877abe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.483469:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.483479:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.483506:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.483514:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003750344f/0x9aafc5f04cd35762 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.483536:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.483538:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.483540:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.484143:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.484151:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.484166:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.484169:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.484172:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.484182:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.484191:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.484199:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.484229:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.484681:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.484689:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.484697:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.484702:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.484712:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.484730:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.484738:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008244ceb3/0x9aafc5f04cd35769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.484758:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.484760:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.484842:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.485182:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.485190:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.485200:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.485203:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.485208:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.485218:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.485238:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.485245:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.485266:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.485337:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.485351:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.485364:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.485371:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.485383:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.485406:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.485414:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022b08626/0x9aafc5f04cd35770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.485464:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.485466:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.485468:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.486219:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.486227:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486237:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.486240:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.486245:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486255:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486262:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486269:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486339:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788391047.486783:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.486789:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486797:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.486801:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.486804:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486813:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486821:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.486838:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487120:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391047.487128:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487148:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aaa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.487153:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487162:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487178:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487186:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a307ae3a/0x9aafc5f04cd35777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487205:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.487208:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487215:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877aa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.487218:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487225:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487235:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.487248:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.487250:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.487252:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391047.487309:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788391047.487315:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdc2457/0x9aafc5f04cd3577e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.487328:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391047.488103:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391047.488110:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.488126:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=864s v=(0 0) 00010000:00010000:2.0:1788391047.488129:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391047.488134:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.488145:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.488153:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.488161:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.488185:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.488558:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.488563:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.488572:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.488576:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.488585:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.488600:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.488685:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35785 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.488704:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.488706:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.488708:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.491572:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.491591:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.491630:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.491636:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.491644:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.491662:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.491673:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.491682:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.491710:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.493266:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.493284:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.493299:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.493306:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.493319:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.493345:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.493353:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c718e1c/0x9aafc5f04cd3578c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.493424:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.493426:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.493428:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.495157:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.495170:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.495188:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.495193:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.495201:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.495216:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.495241:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.495250:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.495276:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.495316:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.495330:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.495365:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.495371:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.495383:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.495410:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.495418:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000165f498b/0x9aafc5f04cd35793 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.495449:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.495453:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.495458:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.497492:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.497507:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.497526:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.497532:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.497538:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.497556:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.497568:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.497577:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.497617:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.498329:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.498340:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.498362:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.498368:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.498379:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.498406:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.498414:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036e61e71/0x9aafc5f04cd3579a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.498442:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.498444:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.498446:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.501636:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.501651:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.501674:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.501680:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.501687:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.501788:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.501803:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.501812:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.501851:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.501896:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.501913:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.501928:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.501934:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.501946:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502007:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502017:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c7d784/0x9aafc5f04cd357a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502050:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.502053:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.502055:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.502404:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.502410:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502421:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.502430:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.502435:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502445:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502454:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502462:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502487:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.502582:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.502593:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502616:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.502623:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502634:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502653:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502662:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad0d6b79/0x9aafc5f04cd357a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.502703:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.502705:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.502707:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.502935:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.502943:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502952:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.502955:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.502980:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.502992:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503002:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503015:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503036:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.503062:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.503070:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503079:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.503083:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503091:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503111:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503119:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008230128e/0x9aafc5f04cd357af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503140:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.503142:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.503144:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.503538:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.503545:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503555:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.503558:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.503562:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503572:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503580:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503587:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.503606:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.503683:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.503691:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503716:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.503721:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503730:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503743:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.503751:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6f194a/0x9aafc5f04cd357b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391047.504330:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.504338:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.504355:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.504358:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.504363:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.504373:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.504381:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.504389:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.504502:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.504683:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.504690:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.504700:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.504704:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.504713:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.504728:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.504744:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006857acd6/0x9aafc5f04cd357bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.504776:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.504777:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.504783:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.504786:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.505330:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.505344:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.505355:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.505359:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.505363:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.505376:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.505397:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.505404:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.505462:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391047.506058:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.506066:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.506076:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.506080:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.506084:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.506095:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.506103:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.506112:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.506592:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391047.506605:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.506615:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.506621:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.506645:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.506668:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.506676:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d6a4b8c/0x9aafc5f04cd357c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.506786:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.506798:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.506810:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.506815:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.506835:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.506856:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.506867:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.506869:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391047.506873:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391047.506881:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004036a6f4/0x9aafc5f04cd357cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391047.507611:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.507620:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.507632:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.507637:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.507643:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.507656:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.507666:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.507675:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.507842:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.507851:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.507860:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.507865:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.507875:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.507891:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.507903:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.507905:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.507917:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.509283:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391047.509647:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391047.509660:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000020d0aa9/0x9aafc5f04cd357d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.510324:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.512735:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.512754:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.512775:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.512780:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.512789:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.512806:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.512832:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.512842:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.512871:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.513596:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.513680:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.513705:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.513710:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.513720:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.513738:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391047.514648:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.514660:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.514675:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.514679:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.514692:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.514720:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee697c8/0x9aafc5f04cd357d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.514751:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.514753:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.514755:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391047.514888:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.514901:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.514911:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.515069:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391047.515638:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.515644:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.515655:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.515658:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.515663:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.515675:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.515684:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.515718:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515820:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391047.515838:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515847:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.515853:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515863:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515883:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515890:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084fe08d/0x9aafc5f04cd357e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515912:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.515916:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515923:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.515927:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.515950:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.516002:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.516012:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.516014:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.516016:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.516741:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391047.518037:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391047.518056:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004855ea1e/0x9aafc5f04cd357e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391047.519459:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.519474:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.519495:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.519501:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.519509:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.519526:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.519539:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.519548:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.519595:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.519807:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.519816:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.519838:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.519843:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.519854:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.519877:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.519886:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeecb4d2/0x9aafc5f04cd357ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.519925:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.519927:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.519929:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.520400:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.520408:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.520418:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.520421:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.520427:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.520438:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.520446:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.520453:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.520485:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391047.521020:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.521031:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.521041:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.521046:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.521071:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.521089:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.521096:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd543ef/0x9aafc5f04cd357f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.521125:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.521127:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.521129:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.521565:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.521573:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.521583:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.521594:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.521600:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.521613:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.521622:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.521630:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.521695:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391047.522296:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.522303:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.522312:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.522315:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.522320:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.522331:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.522340:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.522355:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522463:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391047.522472:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522481:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.522485:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522494:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522511:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522519:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002173571f/0x9aafc5f04cd357fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522541:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.522545:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522553:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.522566:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522575:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522587:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.522596:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.522598:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.522600:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391047.522679:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391047.522685:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049c885ac/0x9aafc5f04cd35803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.523140:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.523596:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.523605:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.523617:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.523620:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.523625:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.523637:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.523645:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.523651:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.523797:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391047.525080:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391047.525095:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.525108:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391047.525114:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.525126:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.525152:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.525160:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066818016/0x9aafc5f04cd3580a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391047.525211:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.525214:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391047.525218:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391047.525801:0:39118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391047.525812:0:39118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.525835:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=864s v=(0 0) 00010000:00010000:1.0:1788391047.525840:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391047.525845:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.525860:0:39118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.525871:0:39118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.525880:0:39118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391047.525944:0:39118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788391047.526355:0:39118:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:130 00000100:00100000:1.0:1788391047.526500:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:38458:x1875263103410176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74938us (76153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391047.526519:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391047.526792:0:38458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38458:1875263103410176:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788391047.526818:0:38458:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xa1:0x0] from OST, last_created [0x240000400:0xa1:0x0]last_used is [0x240000400:0x82:0x0] 00000100:00100000:3.0:1788391047.526891:0:38458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38458:1875263103410304:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788391047.526935:0:38458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391047.527021:0:38458:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc711180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391047.527085:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410304 00000100:00100000:1.0:1788391047.527100:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410304 00000100:00100000:1.0:1788391047.527164:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391047.527175:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:38458:x1875263103410304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788391047.527227:0:39225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 162 00010000:00010000:0.0:1788391047.530933:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391047.530951:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.530980:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391047.530987:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.531001:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.531036:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.531058:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ade054/0x9aafc5f04cd35811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391047.531101:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.531104:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391047.531107:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391047.534883:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:38458:x1875263103410304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7697us (7934us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1788391047.534902:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391047.535009:0:38458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:38458:1875263103410304:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788391047.535031:0:38458:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xa1:0x0]-[0x240000400:0xc1:0x0] 00010000:00010000:3.0:1788391047.629115:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788391047.695861:0:38432:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788391047.695868:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68f07f000 from 19 10000000:01000000:2.0:1788391047.695873:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788391047.695914:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.695925:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.695936:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391047.695974:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103410432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788391047.696068:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391047.696119:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b64056c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391047.696142:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410432 00000100:00100000:2.0:1788391047.696150:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410432 00000100:00100000:2.0:1788391047.696200:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788391047.696210:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+15:38432:x1875263103410432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391047.696223:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391047.696235:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35818 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.696254:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 16 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.696264:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 16 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.696273:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391047.696309:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:38432:x1875263103410432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391047.696316:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788391047.696364:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103410432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391047.696380:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.696388:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391047.696433:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103410560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788391047.696467:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391047.696482:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391047.696493:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410560 00000100:00100000:2.0:1788391047.696496:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410560 00000100:00100000:2.0:1788391047.696516:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788391047.696522:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:38432:x1875263103410560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788391047.696534:0:38427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788391047.696548:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788391047.696552:0:38427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 19 00000100:00100000:2.0:1788391047.696618:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:38432:x1875263103410560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391047.696625:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788391047.696653:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103410560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788391047.696703:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788391047.696710:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391047.696718:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391048.654142:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391049.677183:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391049.997135:0:38470:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788391049.997156:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391049.997650:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 1 00000040:00080000:0.0:1788391049.997708:0:38470:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391049.997745:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 1 00000001:02000400:0.0:1788391050.547289:0:39485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788391050.701651:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391051.726370:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788391051.782365:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788391051.782384:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00000100:00080000:0.0:1788391052.749171:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391052.749178:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788391052.749183:0:38:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391052.749192:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 864 00010000:00010000:3.0:1788391052.749195:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788391052.749198:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788391052.749206:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6865e0000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391052.749230:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687860a80 x1875263103410944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788391052.749238:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788391052.749279:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103411072:0@lo:400:kworker.0 00000100:00100000:3.0:1788391052.749325:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391052.749337:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391052.749427:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410816 00000100:00100000:3.0:1788391052.749445:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410816 00000100:00100000:1.0:1788391052.749486:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103411200:0@lo:400:kworker.0 00000100:00100000:3.0:1788391052.749504:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788391052.749517:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103410816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391052.749525:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391052.749544:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411072 00000100:00100000:0.0:1788391052.749550:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411072 00000100:00100000:1.0:1788391052.749555:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391052.749563:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103410688:0@lo:400:kworker.0 00000100:00100000:3.0:1788391052.749578:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103410816:12345-0@lo:400:kworker.0 Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391052.749583:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411200 00000100:00100000:3.0:1788391052.749589:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391052.749589:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411200 00000100:00100000:1.0:1788391052.749601:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391052.749617:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391052.749627:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103411072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391052.749647:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103410944:0@lo:8:kworker.0 00000100:00100000:3.0:1788391052.749648:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:3.0:1788391052.749670:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788391052.749676:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103411072:12345-0@lo:400:kworker.0 Request processed in 48us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391052.749685:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391052.749702:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391052.749710:0:38436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788391052.749711:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103411200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391052.749726:0:38436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788391052.749752:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103411200:12345-0@lo:400:kworker.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391052.749758:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788391052.750046:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687861f80 x1875263103411072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391052.750058:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391052.750062:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103411072:0@lo:400:kworker.0 00000100:00100000:0.0:1788391052.750098:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410688 00000100:00100000:0.0:1788391052.750103:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410688 00010000:00080000:1.0:1788391052.750126:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687862300 x1875263103411200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391052.750132:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788391052.750145:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103411200:0@lo:400:kworker.0 00000100:00100000:0.0:1788391052.750146:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+16:3288:x1875263103410688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391052.750178:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+16:3288:x1875263103410688:12345-0@lo:400:kworker.0 Request processed in 36us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391052.750181:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788391052.750205:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391052.750208:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391052.750232:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103410688:0@lo:400:kworker.0 00000100:00100000:1.0:1788391052.750275:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103410944 00000100:00100000:1.0:1788391052.750279:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103410944 00000100:00100000:1.0:1788391052.750299:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391052.750312:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1875263103410944:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788391052.750329:0:39121:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788391052.750365:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1875263103410944:12345-0@lo:8:kworker.0 Request processed in 53us (666us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788391052.750371:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788391052.750396:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788391052.750400:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788391052.750404:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103410944:0@lo:8:kworker.0 00000100:00100000:1.0:1788391052.750613:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103411328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391052.751019:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391052.751051:0:39122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411328 00000100:00100000:1.0:1788391052.751056:0:39122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411328 00000100:00100000:1.0:1788391052.751090:0:39122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391052.751098:0:39122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103411328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391052.751121:0:39122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391052.751159:0:39122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103411328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391052.751166:0:39122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391052.751197:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103411328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391053.777873:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391054.797187:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788391055.510796:0:39836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788391055.510801:0:39836:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788391055.510934:0:39836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d58716d800 00000020:01000004:0.0:1788391055.510954:0:39836:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788391055.511542:0:39836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788391055.511563:0:39836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d6bc27b370) 00000020:00000080:0.0:1788391055.511638:0:39836:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788391055.533123:0:39836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788391055.533543:0:39836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788391055.536225:0:39836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788391055.536496:0:39836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788391055.537118:0:39836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:0.0:1788391055.537917:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:0.0:1788391055.538209:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:0.0:1788391055.538370:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:0.0:1788391055.539166:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788391055.539562:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:0.0:1788391055.539945:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788391055.540351:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:0.0:1788391055.541032:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:0.0:1788391055.541285:0:39836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:0.0:1788391055.541947:0:39836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788391055.542211:0:39836:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788391055.542227:0:39836:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd3582d 00000020:01000004:0.0:1788391055.542237:0:39836:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788391055.542262:0:39836:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788391055.542267:0:39836:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788391055.542274:0:39836:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788391055.542304:0:39836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788391055.542318:0:39836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788391055.550539:0:39836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788391055.550580:0:39836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788391055.550583:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788391055.550585:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.550586:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.550587:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.550588:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.550589:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.550593:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.550595:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.550596:0:39836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788391055.550599:0:39836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788391055.550601:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788391055.550602:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.550603:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.550603:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.550604:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.550605:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.550605:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.550606:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.550606:0:39836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788391055.550639:0:39836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788391055.550660:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788391055.550762:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.551256:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411456 00000100:00100000:2.0:1788391055.551268:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411456 00000100:00100000:2.0:1788391055.551341:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788391055.551353:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39836:x1875263103411456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788391055.551395:0:38430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788391055.551399:0:38430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788391055.551404:0:38430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788391055.552841:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391055.562680:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39836:x1875263103411456:12345-0@lo:253:mount.lustre.0 Request processed in 11315us (11915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391055.562700:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788391055.562715:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788391055.562737:0:39836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788391055.562741:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788391055.562744:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.562745:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.562747:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.562760:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.562762:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.562764:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.562767:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.562769:0:39836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788391055.562798:0:39836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d58716d800 from lustre-OST0001 10000000:01000000:1.0:1788391055.562829:0:39836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788391055.562833:0:39836:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788391055.562842:0:39836:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d5873ecd28 local copy 00010000:00010000:1.0:1788391055.562855:0:39836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.563155:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391055.563209:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.563251:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727240 going to sleep for 11 seconds 00000100:00100000:2.0:1788391055.563260:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411584 00000100:00100000:2.0:1788391055.563270:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411584 00000100:00100000:2.0:1788391055.563321:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788391055.563333:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39836:x1875263103411584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391055.563610:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39836:x1875263103411584:12345-0@lo:501:mount.lustre.0 Request processed in 278us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391055.563618:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788391055.563652:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411584:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788391055.563669:0:39836:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788391055.563836:0:39836:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788391055.563844:0:39836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.563855:0:39836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391055.563878:0:39836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d58716d800 10000000:01000000:1.0:1788391055.563883:0:39836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788391055.563888:0:39836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788391055.563891:0:39836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391055.563895:0:39836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788391055.563899:0:39836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788391055.563927:0:39836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.563936:0:39836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.563946:0:39836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.563986:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391055.564014:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.564089:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727240 going to sleep for 11 seconds 00000100:00100000:3.0:1788391055.564125:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411712 00000100:00100000:3.0:1788391055.564128:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411712 00000100:00100000:3.0:1788391055.564154:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788391055.564160:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:39836:x1875263103411712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391055.564169:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391055.564182:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd3583b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35834 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.564203:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd3583b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35834 expref: 17 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.564214:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd3583b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35834 expref: 17 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.564224:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:3.0:1788391055.564301:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103411712:12345-0@lo:101:mount.lustre.0 Request processed in 141us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391055.564306:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788391055.564391:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391055.564401:0:39836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.564408:0:39836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391055.564946:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000040:00080000:1.0:1788391055.565692:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788391055.565902:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788391055.565945:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:1.0:1788391055.566037:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:1.0:1788391055.566078:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:1.0:1788391055.566098:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:1.0:1788391055.566115:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:1.0:1788391055.566138:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:1.0:1788391055.566156:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:1.0:1788391055.566181:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 120 off9752 00000040:00080000:1.0:1788391055.566210:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9976 00000040:00080000:1.0:1788391055.566215:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 10 count 11 00000100:00100000:1.0:1788391055.566329:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391055.566381:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.566416:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.566425:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411840 00000100:00100000:0.0:1788391055.566433:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411840 00000100:00100000:0.0:1788391055.566494:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788391055.566504:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103411840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391055.567010:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103411840:12345-0@lo:501:mount.lustre.0 Request processed in 506us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.567020:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788391055.567032:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391055.567064:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391055.567097:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.567164:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391055.567327:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103411968 00000100:00100000:2.0:1788391055.567333:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103411968 00000100:00100000:2.0:1788391055.567373:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788391055.567383:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103411968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391055.567736:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103411968:12345-0@lo:503:mount.lustre.0 Request processed in 354us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391055.567746:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788391055.567767:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103411968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788391055.568202:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788391055.568251:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391055.568517:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.568581:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391055.568609:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412096 00000100:00100000:3.0:1788391055.568613:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412096 00000100:00100000:3.0:1788391055.568671:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788391055.568680:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103412096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391055.568877:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103412096:12345-0@lo:502:mount.lustre.0 Request processed in 199us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391055.568890:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788391055.568984:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788391055.569139:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1788391055.569168:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:1.0:1788391055.569184:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:1.0:1788391055.569208:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:1.0:1788391055.569226:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:1.0:1788391055.569241:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:1.0:1788391055.569264:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:1.0:1788391055.569297:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:1.0:1788391055.569322:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 120 off9752 00000100:00100000:1.0:1788391055.569340:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391055.569368:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.569492:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.569514:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412224 00000100:00100000:0.0:1788391055.569518:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412224 00000100:00100000:0.0:1788391055.569545:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788391055.569551:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103412224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391055.569687:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103412224:12345-0@lo:502:mount.lustre.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.569694:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788391055.569760:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788391055.569819:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9976 00000040:00080000:1.0:1788391055.569829:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788391055.570916:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788391055.570927:0:39837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788391055.570934:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.570937:0:39837:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788391055.570944:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788391055.571088:0:39837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d683d499b8) 00000020:00000080:1.0:1788391055.571117:0:39837:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788391055.571124:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788391055.571215:0:39837:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d58716d800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788391055.571224:0:39837:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788391055.571232:0:39837:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd35849 00010000:00010000:1.0:1788391055.582243:0:39837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788391055.582919:0:39837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 21474836481 00080000:10000000:1.0:1788391055.585676:0:39837:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:1.0:1788391055.587863:0:39837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788391055.587878:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788391055.587886:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.587889:0:39837:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788391055.587892:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788391055.587897:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.587899:0:39837:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788391055.587902:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788391055.587904:0:39837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788391055.587906:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788391055.587909:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.587910:0:39837:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788391055.587912:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788391055.587914:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.587915:0:39837:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788391055.587919:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788391055.588017:0:39837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788391055.588022:0:39837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788391055.588024:0:39837:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788391055.588028:0:39837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000020:01000000:2.0:1788391055.588137:0:39836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788391055.588167:0:39836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788391055.588192:0:39836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.588206:0:39836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391055.588216:0:39836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d58716d800 from 1 10000000:01000000:2.0:1788391055.588219:0:39836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788391055.588267:0:39836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.588277:0:39836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.588311:0:39836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391055.588344:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788391055.588447:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.588547:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.588917:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412352 00000100:00100000:0.0:1788391055.588928:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412352 00000100:00100000:0.0:1788391055.589067:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788391055.589083:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+17:39836:x1875263103412352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391055.589101:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391055.589119:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35850 expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.589149:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 18 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.589160:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 18 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.589184:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93e00, rc 0) 00000100:00100000:0.0:1788391055.589242:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412352:12345-0@lo:101:mount.lustre.0 Request processed in 165us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.589251:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788391055.589330:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391055.589347:0:39836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.589357:0:39836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391055.590141:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:2.0:1788391055.591031:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391055.591305:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:2.0:1788391055.591348:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:2.0:1788391055.591394:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:2.0:1788391055.591427:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:2.0:1788391055.591458:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:2.0:1788391055.591501:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:2.0:1788391055.591531:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:2.0:1788391055.591560:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:2.0:1788391055.591670:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:2.0:1788391055.591682:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:2.0:1788391055.591798:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391055.591885:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.591955:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788391055.593100:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412480 00000100:00100000:3.0:1788391055.593113:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412480 00000100:00100000:3.0:1788391055.593173:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788391055.593185:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391055.594176:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412480:12345-0@lo:501:mount.lustre.0 Request processed in 987us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391055.594188:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788391055.600825:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391055.601917:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391055.602034:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391055.602076:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412608 00000100:00100000:2.0:1788391055.602081:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.602085:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412608 00000100:00100000:0.0:1788391055.602151:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788391055.602161:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391055.602620:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412608:12345-0@lo:503:mount.lustre.0 Request processed in 460us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.602629:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788391055.602652:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788391055.603257:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788391055.603326:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391055.603375:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.603420:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.603424:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412736 00000100:00100000:0.0:1788391055.603431:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412736 00000100:00100000:0.0:1788391055.603469:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788391055.603477:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391055.603735:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412736:12345-0@lo:502:mount.lustre.0 Request processed in 257us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.603745:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788391055.603770:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788391055.604019:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:2.0:1788391055.604090:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:2.0:1788391055.604138:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:2.0:1788391055.604174:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:2.0:1788391055.604210:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:2.0:1788391055.604274:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:2.0:1788391055.604328:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:2.0:1788391055.604494:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:2.0:1788391055.604522:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391055.604563:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.604597:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.604609:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412864 00000100:00100000:0.0:1788391055.604615:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412864 00000100:00100000:0.0:1788391055.604650:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788391055.604715:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391055.604890:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412864:12345-0@lo:502:mount.lustre.0 Request processed in 176us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.604898:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788391055.604919:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788391055.605019:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:2.0:1788391055.605029:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788391055.606068:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391055.606082:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606084:0:39841:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788391055.606100:0:39841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d58716d800 00000020:00000080:2.0:1788391055.606103:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391055.606113:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391055.606115:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606116:0:39841:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788391055.606119:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391055.606122:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606123:0:39841:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788391055.606126:0:39841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d58716d800 00000020:00000080:2.0:1788391055.606128:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391055.606188:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391055.606190:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606191:0:39841:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788391055.606193:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391055.606195:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606196:0:39841:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788391055.606198:0:39841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d58716d800 00000020:00000080:2.0:1788391055.606199:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391055.606223:0:39841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391055.606225:0:39841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391055.606225:0:39841:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788391055.606227:0:39841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:1.0:1788391055.606350:0:39836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788391055.606400:0:39836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788391055.606425:0:39836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.606452:0:39836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391055.606512:0:39836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788391055.606516:0:39836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d58716d800 10000000:01000000:1.0:1788391055.606520:0:39836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d58716d800 10000000:01000000:1.0:1788391055.606525:0:39836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391055.606532:0:39836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d58716d800 from 1 10000000:01000000:1.0:1788391055.606535:0:39836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788391055.607233:0:39836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.607247:0:39836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.607262:0:39836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.607357:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391055.607437:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.607498:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6837270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391055.607635:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103412992 00000100:00100000:3.0:1788391055.607645:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103412992 00000100:00100000:3.0:1788391055.607707:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788391055.607718:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103412992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391055.607736:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391055.607764:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3585e expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.607794:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3585e expref: 19 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.607806:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3585e expref: 19 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391055.607817:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd800, rc 0) 00000100:00100000:3.0:1788391055.607872:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584b1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103412992:12345-0@lo:101:mount.lustre.0 Request processed in 155us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391055.607881:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788391055.607907:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103412992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391055.607925:0:39836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.607935:0:39836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391055.608615:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:2.0:1788391055.609947:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391055.610315:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:2.0:1788391055.610370:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:2.0:1788391055.610489:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:2.0:1788391055.610551:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:2.0:1788391055.610773:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:2.0:1788391055.610844:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:2.0:1788391055.610894:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:2.0:1788391055.610938:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:2.0:1788391055.611061:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:2.0:1788391055.611102:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:2.0:1788391055.611154:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:2.0:1788391055.611198:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:2.0:1788391055.611228:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:2.0:1788391055.611259:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:2.0:1788391055.611305:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:2.0:1788391055.611340:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:2.0:1788391055.611369:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:2.0:1788391055.611520:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:2.0:1788391055.611560:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:2.0:1788391055.611770:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:2.0:1788391055.611826:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:2.0:1788391055.611862:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:2.0:1788391055.611893:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:2.0:1788391055.611935:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:2.0:1788391055.611997:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:2.0:1788391055.612031:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:2.0:1788391055.612102:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:2.0:1788391055.612143:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:2.0:1788391055.612174:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:2.0:1788391055.612222:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:2.0:1788391055.612264:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:2.0:1788391055.612294:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:2.0:1788391055.612323:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:2.0:1788391055.612368:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:2.0:1788391055.612493:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:2.0:1788391055.612548:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:2.0:1788391055.612651:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:2.0:1788391055.612815:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:2.0:1788391055.612870:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:2.0:1788391055.612905:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:2.0:1788391055.613230:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:2.0:1788391055.613239:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:2.0:1788391055.613387:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391055.614143:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.614197:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.614520:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413120 00000100:00100000:0.0:1788391055.614530:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413120 00000100:00100000:0.0:1788391055.614600:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788391055.614612:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391055.615341:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413120:12345-0@lo:501:mount.lustre.0 Request processed in 729us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.615350:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788391055.615457:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391055.615510:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391055.615560:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.615628:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.615663:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413248 00000100:00100000:0.0:1788391055.615668:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413248 00000100:00100000:0.0:1788391055.615735:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788391055.615746:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391055.616141:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413248:12345-0@lo:503:mount.lustre.0 Request processed in 396us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.616150:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788391055.616217:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788391055.620235:0:39836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788391055.620724:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391055.620840:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.620898:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727240 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.622339:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413376 00000100:00100000:0.0:1788391055.622353:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413376 00000100:00100000:0.0:1788391055.622422:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788391055.622434:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391055.622843:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413376:12345-0@lo:502:mount.lustre.0 Request processed in 411us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.622851:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788391055.623318:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788391055.623661:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1788391055.623724:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:1.0:1788391055.623774:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:1.0:1788391055.623831:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:1.0:1788391055.623872:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:1.0:1788391055.623953:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:1.0:1788391055.624095:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:2.0:1788391055.627221:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:2.0:1788391055.627349:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:2.0:1788391055.627390:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:2.0:1788391055.627446:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:2.0:1788391055.627547:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:2.0:1788391055.627589:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:2.0:1788391055.627626:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:2.0:1788391055.627722:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:2.0:1788391055.627799:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:2.0:1788391055.627862:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:2.0:1788391055.627947:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:2.0:1788391055.628260:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:2.0:1788391055.628297:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:2.0:1788391055.628347:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:2.0:1788391055.628387:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:2.0:1788391055.628439:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:2.0:1788391055.628501:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:2.0:1788391055.628538:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:2.0:1788391055.628568:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:2.0:1788391055.628763:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:2.0:1788391055.628843:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:2.0:1788391055.628896:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:2.0:1788391055.628985:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:2.0:1788391055.629027:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:2.0:1788391055.629074:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:2.0:1788391055.629116:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:2.0:1788391055.629179:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:2.0:1788391055.629214:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:2.0:1788391055.629259:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:2.0:1788391055.629291:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:2.0:1788391055.629321:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:2.0:1788391055.629364:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:2.0:1788391055.629398:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:2.0:1788391055.629463:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391055.629564:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391055.629620:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391055.630341:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413504 00000100:00100000:0.0:1788391055.630352:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413504 00000100:00100000:0.0:1788391055.630421:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788391055.630434:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391055.630957:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413504:12345-0@lo:502:mount.lustre.0 Request processed in 525us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.630999:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788391055.631931:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788391055.632089:0:39836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:2.0:1788391055.632111:0:39836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788391055.635578:0:39846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788391055.635602:0:39846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d6a6bd4d28) 00000020:00000080:2.0:1788391055.635628:0:39846:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788391055.635882:0:39846:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d58716d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788391055.635887:0:39846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d58716d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788391055.635890:0:39846:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58716d800 3 00010000:00080000:2.0:1788391055.635951:0:39846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d5866e7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788391055.641448:0:39846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788391055.642680:0:39846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788391055.642734:0:39846:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788391055.642760:0:39846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd35873 00000100:00080000:2.0:1788391055.642774:0:39846:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788391055.642782:0:39846:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5866e7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391055.642830:0:39846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0dc00 x1875263103413632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788391055.642857:0:39846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1788391055.643156:0:39846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000100:00100000:1.0:1788391055.643413:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103413632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788391055.643512:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788391055.643579:0:39836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788391055.643606:0:39836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788391055.643625:0:39836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.643638:0:39836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788391055.643717:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788391055.643720:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.643721:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.643723:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.643724:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.643726:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.643728:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.643731:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.643732:0:39836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391055.643737:0:39836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788391055.643739:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788391055.643740:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.643741:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.643742:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.643742:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.643743:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.643757:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.643758:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.643759:0:39836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391055.643780:0:39836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788391055.643794:0:39836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788391055.643835:0:39836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.643851:0:39836:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727e40 going to sleep for 11 seconds 00000100:00080000:0.0:1788391055.644744:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391055.644760:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788391055.644766:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391055.644773:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 869 00000100:00100000:1.0:1788391055.644777:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103413888:0@lo:400:kworker.0 00000100:00080000:0.0:1788391055.644782:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788391055.644792:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6865e0000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391055.644819:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687861880 x1875263103414016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391055.644836:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391055.644896:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413632 00000100:00100000:0.0:1788391055.644905:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413632 00000100:00100000:1.0:1788391055.644927:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391055.644936:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103414144:0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.644956:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391055.644988:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391055.645264:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103413632:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788391055.645296:0:38437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 872 last 0 00000020:00000080:0.0:1788391055.645355:0:38437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd3587a 00000004:00100000:0.0:1788391055.645375:0:38437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788391055.645437:0:38437:0:(import.c:65:import_set_state_nolock()) ffff95d584a11800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391055.645504:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103413632:12345-0@lo:38:llog_process_th.0 Request processed in 498us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.645514:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391055.645536:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414144 00000100:00100000:0.0:1788391055.645540:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414144 00000100:00100000:0.0:1788391055.645594:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391055.645602:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103414144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.645647:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103414144:12345-0@lo:400:kworker.0 Request processed in 46us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.645664:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391055.645698:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103414272:0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.645731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391055.645783:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414272 00000100:00100000:0.0:1788391055.645787:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414272 00000100:00080000:1.0:1788391055.645831:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391055.645836:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391055.645846:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103414272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.645886:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103414272:12345-0@lo:400:kworker.0 Request processed in 41us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391055.645894:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788391055.645921:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687860380 x1875263103414272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391055.645935:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103414016:0@lo:8:kworker.0 00000100:00100000:1.0:1788391055.645939:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103414272:0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.645996:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.646027:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413888 00000100:00100000:1.0:1788391055.646032:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413888 00010000:00080000:0.0:1788391055.646050:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d584a0dc00 x1875263103413632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391055.646061:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788391055.646069:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00100000:1.0:1788391055.646074:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414016 00000100:00080000:0.0:1788391055.646079:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:1.0:1788391055.646080:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414016 00000100:00080000:0.0:1788391055.646088:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788391055.646091:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788391055.646099:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103413632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788391055.646104:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391055.646115:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103413888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.646139:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391055.646147:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103414016:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788391055.646156:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103413888:12345-0@lo:400:kworker.0 Request processed in 42us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391055.646164:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788391055.646192:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391055.646199:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103414016:12345-0@lo:8:kworker.0 Request processed in 50us (201us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788391055.646217:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788391055.646249:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687860700 x1875263103414144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391055.646260:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103414144:0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.646273:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103413888:0@lo:400:kworker.0 00000100:00100000:0.0:1788391055.646298:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788391055.646302:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788391055.646306:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788391055.646309:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103414016:0@lo:8:kworker.0 00000100:00100000:0.0:1788391055.646430:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103413760 00000100:00100000:0.0:1788391055.646435:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103413760 00000100:00100000:0.0:1788391055.646471:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788391055.646480:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:39836:x1875263103413760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788391055.646508:0:38427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788391055.646525:0:38427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788391055.685172:0:38427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788391055.685193:0:38427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788391055.685606:0:38451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788391055.685613:0:38451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788391055.685645:0:38451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.685798:0:38451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 19 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.685810:0:38451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.685866:0:38451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 19 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.685907:0:38451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 19 pid: 38430 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391055.685928:0:38451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103414400:0@lo:104: 00000100:00100000:0.0:1788391055.686102:0:38451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391055.686452:0:38451:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788391055.686623:0:38418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414400 00000100:00100000:2.0:1788391055.686633:0:38418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414400 00000100:00100000:2.0:1788391055.686746:0:38418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788391055.686768:0:38418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103414400:12345-0@lo:104: 00010000:00010000:2.0:1788391055.686784:0:38418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391055.686909:0:38418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788391055.686917:0:38418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+3:38451:x1875263103414400:12345-0@lo:104: Request processed in 153us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391055.686925:0:38418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788391055.686946:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391055.687001:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687028:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391055.687033:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687044:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391055.687052:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391055.687058:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788391055.687113:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687121:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391055.687164:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687172:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1ea00/0x9aafc5f04cd35818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3581f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687190:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391055.687192:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391055.687194:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391055.687580:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391055.687614:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103414528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788391055.687674:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391055.687745:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414528 00000100:00100000:1.0:1788391055.687764:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414528 00010000:00010000:1.0:1788391055.687809:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 20 pid: 38430 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.687860:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391055.687880:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+20:3288:x1875263103414528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391055.687895:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391055.687901:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 20 pid: 38430 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687915:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 20 pid: 38430 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687936:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687945:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788391055.687985:0:38420:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002365176s 00010000:00010000:1.0:1788391055.687991:0:38420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.687999:0:38420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688006:0:38420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688013:0:38420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688029:0:38420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391055.688034:0:38420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688053:0:38420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688066:0:38420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391055.688078:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391055.688087:0:38451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f600/0x9aafc5f04cd3581f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35818 expref: 20 pid: 38430 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391055.688104:0:38451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:38451:1875263103414400:0@lo:104: 00010000:00010000:0.0:1788391055.688129:0:38451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.688141:0:38451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391055.688149:0:38451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.688158:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3288:x1875263103414528:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (478us total) trans 0 rc 0/0 00010000:00010000:0.0:1788391055.688170:0:38451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd35881 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 38451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391055.688171:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391055.688430:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103414528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788391055.692372:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:39836:x1875263103413760:12345-0@lo:253:mount.lustre.0 Request processed in 45883us (48526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391055.692388:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788391055.692498:0:39836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f33d137e-f79f-4925-8ad8-5351efff92b3:39836:1875263103413760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788391055.692513:0:39836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788391055.692517:0:39836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788391055.692518:0:39836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788391055.692520:0:39836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391055.692521:0:39836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391055.692522:0:39836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391055.692523:0:39836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391055.692525:0:39836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788391055.692527:0:39836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391055.692528:0:39836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788391055.692541:0:39836:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788391055.693024:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391055.693226:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391055.693393:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391055.693565:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391055.693723:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391055.693946:0:39836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788391055.703185:0:39836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:2.0:1788391055.739618:0:39836:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788391055.739659:0:39836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788391055.739707:0:39836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788391055.739812:0:39836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788391055.739839:0:39836:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788391055.739876:0:39836:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788391055.821150:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391056.847991:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788391057.485438:0:38432:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788391057.485449:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d68f07f000 from 20 10000000:01000000:3.0:1788391057.485455:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788391057.485516:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391057.485526:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391057.485536:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391057.485562:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103414656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788391057.485656:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391057.485742:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684690900 going to sleep for 11 seconds 00000100:00100000:0.0:1788391057.486063:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414656 00000100:00100000:0.0:1788391057.486074:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414656 00000100:00100000:0.0:1788391057.486147:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788391057.486159:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103414656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788391057.486175:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391057.486193:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd3588f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35888 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391057.486242:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd3588f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35888 expref: 19 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391057.486254:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd3588f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35888 expref: 19 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391057.486264:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:0.0:1788391057.486324:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103414656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391057.486332:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788391057.486430:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103414656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391057.486448:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391057.486458:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391057.486509:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103414784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788391057.486541:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391057.486602:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684690900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391057.486812:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414784 00000100:00100000:2.0:1788391057.486816:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414784 00000100:00100000:2.0:1788391057.486845:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788391057.486853:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103414784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788391057.486869:0:38427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788391057.486890:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788391057.486898:0:38427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 20 00000100:00100000:2.0:1788391057.487100:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103414784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 248us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391057.487106:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788391057.487179:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103414784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788391057.487244:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788391057.487252:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391057.487260:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391057.869147:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391057.870172:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391057.870203:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103414912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391057.870296:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391057.870441:0:39122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103414912 00000100:00100000:1.0:1788391057.870459:0:39122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103414912 00000100:00100000:1.0:1788391057.870540:0:39122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391057.870551:0:39122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103414912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391057.870599:0:39122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391057.870665:0:39122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103414912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391057.870674:0:39122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788391057.870751:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391057.870794:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103414912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788391058.895379:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391059.215287:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788391059.423084:0:40187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788391059.917091:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391060.627740:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.627883:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094029952 00000100:00100000:0.0:1788391060.627894:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094029952 00000100:00100000:0.0:1788391060.627948:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1788391060.628003:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1875263094029952:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788391060.628035:0:38430:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3aafef2f-890d-4372-806a-7a8032c96dbb@192.168.202.1@tcp t0 exp 0000000000000000 cur 877 last 0 00000020:00000080:0.0:1788391060.628078:0:38430:0:(genops.c:1385:class_connect()) connect: client 3aafef2f-890d-4372-806a-7a8032c96dbb, cookie 0x9aafc5f04cd35896 00000100:00080000:0.0:1788391060.628226:0:38430:0:(import.c:65:import_set_state_nolock()) ffff95d584a17000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391060.628302:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+5:2355:x1875263094029952:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 343us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.628310:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1788391060.636433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.636537:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030080 00000100:00100000:1.0:1788391060.636548:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030080 00000100:00100000:1.0:1788391060.636720:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788391060.636733:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+5:28419:x1875263094030080:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788391060.636750:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391060.636768:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3589d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff861 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.636799:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3589d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff861 expref: 6 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.636809:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3589d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff861 expref: 6 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.636819:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:1.0:1788391060.637765:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+6:28419:x1875263094030080:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 1029us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.637774:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788391060.652453:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.652559:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030208 00000100:00100000:2.0:1788391060.652569:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030208 00000100:00100000:2.0:1788391060.652740:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391060.652751:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+6:28419:x1875263094030208:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788391060.653125:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+6:28419:x1875263094030208:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 374us (682us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391060.653134:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788391060.655416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.655547:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030336 00000100:00100000:1.0:1788391060.655666:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030336 00000100:00100000:1.0:1788391060.655795:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788391060.655808:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+6:28419:x1875263094030336:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788391060.655829:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391060.655850:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd358a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff868 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.655884:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd358a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff868 expref: 7 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.655895:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd358a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff868 expref: 7 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.655906:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1600, rc 0) 00000100:00100000:1.0:1788391060.655997:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+7:28419:x1875263094030336:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 191us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.656005:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788391060.657766:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.657903:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030464 00000100:00100000:0.0:1788391060.657913:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030464 00000100:00100000:0.0:1788391060.658002:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788391060.658013:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+7:28419:x1875263094030464:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788391060.658328:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28419:x1875263094030464:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 316us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.658337:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788391060.660143:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.660224:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030592 00000100:00100000:2.0:1788391060.660239:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030592 00000100:00100000:2.0:1788391060.660348:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1788391060.660360:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28419:x1875263094030592:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788391060.660690:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28419:x1875263094030592:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.660724:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788391060.662577:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.662662:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030720 00000100:00100000:1.0:1788391060.662677:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030720 00000100:00100000:1.0:1788391060.662759:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788391060.662772:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28437:x1875263094030720:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788391060.663327:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28437:x1875263094030720:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 556us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.663338:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391060.682994:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.683067:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030848 00000100:00100000:2.0:1788391060.683085:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030848 00000100:00100000:2.0:1788391060.683169:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1788391060.683273:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28437:x1875263094030848:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391060.683652:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28437:x1875263094030848:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 380us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.683664:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788391060.688396:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.688669:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094030976 00000100:00100000:1.0:1788391060.688697:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094030976 00000100:00100000:1.0:1788391060.688798:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391060.688806:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+8:28419:x1875263094030976:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788391060.688820:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391060.688835:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd358ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff892 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.688857:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd358ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff892 expref: 9 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.688864:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd358ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff892 expref: 9 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.688871:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:1.0:1788391060.688917:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+9:28419:x1875263094030976:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 112us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.688921:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391060.692043:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391060.692131:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031104 00000100:00100000:3.0:1788391060.692140:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031104 00000100:00100000:3.0:1788391060.692215:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788391060.692224:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+9:28419:x1875263094031104:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788391060.692255:0:38428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788391060.692286:0:38428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788391060.692290:0:38428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788391060.692293:0:38428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788391060.692295:0:38428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:1.0:1788391060.693406:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+9:28419:x1875263094031104:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1178us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.693415:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788391060.696696:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.696800:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031232 00000100:00100000:0.0:1788391060.696809:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031232 00000100:00100000:0.0:1788391060.696857:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788391060.696863:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+9:28419:x1875263094031232:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788391060.696879:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391060.696898:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff899 expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.696927:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 10 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.696936:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 10 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.696943:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92a00, rc 0) 00000100:00100000:0.0:1788391060.697052:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28419:x1875263094031232:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 188us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.697057:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788391060.698230:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.698373:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031360 00000100:00100000:1.0:1788391060.698379:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031360 00000100:00100000:1.0:1788391060.698412:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:1.0:1788391060.698418:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28419:x1875263094031360:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788391060.698697:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28419:x1875263094031360:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 278us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.698721:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788391060.700443:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.700528:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031488 00000100:00100000:2.0:1788391060.700535:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031488 00000100:00100000:2.0:1788391060.700620:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788391060.700631:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28419:x1875263094031488:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788391060.700863:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28419:x1875263094031488:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 229us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.700872:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391060.708034:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.708280:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031616 00000100:00100000:0.0:1788391060.708290:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031616 00000100:00100000:0.0:1788391060.708363:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788391060.708374:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28442:x1875263094031616:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391060.708638:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28442:x1875263094031616:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 265us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.708647:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788391060.719653:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.719950:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031744 00000100:00100000:2.0:1788391060.719993:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031744 00000100:00100000:2.0:1788391060.720060:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788391060.720072:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28442:x1875263094031744:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788391060.720343:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28442:x1875263094031744:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 273us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.720351:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788391060.726160:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.726751:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094031872 00000100:00100000:0.0:1788391060.726766:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094031872 00000100:00100000:0.0:1788391060.726844:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1788391060.726854:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263094031872:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788391060.726891:0:38435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp t0 exp 0000000000000000 cur 877 last 0 00000020:00000080:0.0:1788391060.726954:0:38435:0:(genops.c:1385:class_connect()) connect: client 27474853-4920-4406-9272-38eff2ad2609, cookie 0x9aafc5f04cd358b9 00000004:00100000:0.0:1788391060.727252:0:38435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788391060.727260:0:38435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000100:00080000:0.0:1788391060.769906:0:38435:0:(import.c:65:import_set_state_nolock()) ffff95d584a11000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391060.770097:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+6:2355:x1875263094031872:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 43240us (43947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.770112:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788391060.773412:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391060.773552:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.773865:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032128 00000100:00100000:0.0:1788391060.773879:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032128 00000100:00080000:3.0:1788391060.773981:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391060.774114:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032000 00000100:00100000:2.0:1788391060.774119:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032000 00000100:00100000:2.0:1788391060.774249:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391060.774262:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+7:28419:x1875263094032128:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788391060.774317:0:39647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788391060.774527:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788391060.774537:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+7:0:x1875263094032000:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788391060.774552:0:38435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788391060.774623:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+7:28419:x1875263094032128:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 363us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.774631:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788391060.775027:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+6:0:x1875263094032000:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 491us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.775035:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788391060.780497:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.780594:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032256 00000100:00100000:2.0:1788391060.780617:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032256 00000100:00100000:2.0:1788391060.780690:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788391060.780711:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+6:28419:x1875263094032256:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788391060.780824:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+6:28419:x1875263094032256:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.780832:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391060.784765:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.784802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391060.784825:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391060.785020:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032640 00000100:00100000:2.0:1788391060.785031:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032640 00000100:00100000:2.0:1788391060.785074:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391060.785083:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+6:28419:x1875263094032640:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788391060.785683:0:38438:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 524us 00000100:00100000:0.0:1788391060.787329:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032384 00000100:00100000:0.0:1788391060.787342:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032384 00000100:00100000:0.0:1788391060.787385:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032512 00000100:00100000:0.0:1788391060.787389:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032512 00000100:00100000:0.0:1788391060.787418:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788391060.787428:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263094032384:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788391060.787463:0:39121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp t0 exp 0000000000000000 cur 877 last 0 00000020:00000080:0.0:1788391060.787508:0:39121:0:(genops.c:1385:class_connect()) connect: client 27474853-4920-4406-9272-38eff2ad2609, cookie 0x9aafc5f04cd358c0 00002000:00100000:0.0:1788391060.787522:0:39121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 27474853-4920-4406-9272-38eff2ad2609/ffff95d584a10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788391060.787555:0:39121:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788391060.787990:0:39121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788391060.788032:0:39121:0:(import.c:65:import_set_state_nolock()) ffff95d584a16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391060.788118:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2355:x1875263094032384:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 690us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.788127:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788391060.788149:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788391060.788155:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263094032512:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788391060.788186:0:39121:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp t0 exp 0000000000000000 cur 877 last 0 00000020:00000080:0.0:1788391060.788206:0:39121:0:(genops.c:1385:class_connect()) connect: client 27474853-4920-4406-9272-38eff2ad2609, cookie 0x9aafc5f04cd358c7 00002000:00100000:0.0:1788391060.788213:0:39121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 27474853-4920-4406-9272-38eff2ad2609/ffff95d584a17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788391060.788230:0:39121:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788391060.788461:0:39121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788391060.788477:0:39121:0:(import.c:65:import_set_state_nolock()) ffff95d584a14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391060.788500:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2355:x1875263094032512:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 344us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.788518:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000004:00200000:0.0:1788391060.796802:0:38438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788391060.796951:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+6:28419:x1875263094032640:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 11860us (12191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.796985:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391060.916622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391060.916682:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032768 00000100:00100000:0.0:1788391060.916696:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032768 00000100:00100000:0.0:1788391060.916992:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391060.917007:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+6:28463:x1875263094032768:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1788391060.917036:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391060.917072:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd358ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff8c3 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917178:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917195:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917215:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391060.917265:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391060.917270:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391060.917823:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917858:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd358ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8c3 expref: 8 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917900:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8c3 expref: 7 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.917911:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:0.0:1788391060.917914:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391060.917918:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92200, rc 0) 00000100:00100000:0.0:1788391060.918087:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+7:28463:x1875263094032768:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 1082us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391060.918095:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:1.0:1788391060.941315:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788391060.941503:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788391060.941509:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788391060.941514:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788391060.941530:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6865e0000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391060.941564:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d584a0fb80 x1875263103415296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391060.941637:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103415552:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.941744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.941826:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788391060.941833:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103415040:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.941889:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.941915:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103415680:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.941942:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.941994:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103415168:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942023:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.942045:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391060.942051:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103415424:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942074:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.942110:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415552 00000100:00100000:2.0:1788391060.942120:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415552 00000100:00100000:2.0:1788391060.942189:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415680 00000100:00100000:2.0:1788391060.942193:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415680 00000100:00100000:2.0:1788391060.942209:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415424 00000100:00100000:2.0:1788391060.942212:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415424 00000100:00100000:2.0:1788391060.942229:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788391060.942239:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103415552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942305:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103415552:12345-0@lo:400:kworker.0 Request processed in 66us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.942312:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788391060.942332:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391060.942337:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103415680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942361:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103415680:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.942366:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391060.942376:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391060.942380:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103415424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942419:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103415424:12345-0@lo:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.942426:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391060.942444:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415040 00000100:00100000:2.0:1788391060.942447:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415040 00000100:00100000:2.0:1788391060.942470:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788391060.942475:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103415040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942501:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103415040:12345-0@lo:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.942507:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788391060.942539:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415168 00000100:00100000:2.0:1788391060.942543:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415168 00000100:00100000:2.0:1788391060.942577:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391060.942584:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103415168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942616:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103415168:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.942622:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788391060.942638:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391060.942644:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391060.942692:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103415424:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942718:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103415168:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942755:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103415040:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942765:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103415680:0@lo:400:kworker.0 00000100:00100000:2.0:1788391060.942776:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103415552:0@lo:400:kworker.0 00000100:00100000:0.0:1788391060.942892:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103415296:0@lo:8:kworker.0 00000100:00100000:0.0:1788391060.942926:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391060.944503:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415296 00000100:00100000:2.0:1788391060.944517:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415296 00000100:00100000:2.0:1788391060.944560:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391060.944568:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1875263103415296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788391060.944615:0:39120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 878 last 0 00000020:00000080:2.0:1788391060.944692:0:39120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd358dc 00002000:00100000:2.0:1788391060.944723:0:39120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d5866e7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788391060.944729:0:39120:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788391060.944732:0:39120:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788391060.945083:0:39120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788391060.945118:0:39120:0:(import.c:65:import_set_state_nolock()) ffff95d5866e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391060.945216:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103415296:12345-0@lo:8:kworker.0 Request processed in 647us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391060.945225:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788391060.946105:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d584a0fb80 x1875263103415296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788391085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788391060.946128:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1788391060.946139:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788391060.946146:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788391060.946149:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788391060.946168:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788391060.946187:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103415296:0@lo:8:kworker.0 00000004:00080000:1.0:1788391060.946270:0:38460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x62:0x0] 00000100:00100000:1.0:1788391060.946300:0:38460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38460:1875263103415936:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788391060.946358:0:38460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391060.946385:0:38460:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a7056000 going to sleep for 11 seconds 00000004:00080000:1.0:1788391060.946405:0:38459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788391060.946896:0:38459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 878053934160ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788391060.946948:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391060.946993:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391060.947032:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391060.947066:0:39122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415808 00000100:00100000:1.0:1788391060.947073:0:39122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415808 00000100:00100000:1.0:1788391060.947142:0:39122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391060.947152:0:39122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103415808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391060.947179:0:39122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788391060.947228:0:39122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103415808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391060.947236:0:39122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788391060.947262:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788391060.947284:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d685dc5500 x1875263103415808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788391076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391060.947302:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391060.947328:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103415936 00000100:00100000:1.0:1788391060.947332:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103415936 00000100:00100000:1.0:1788391060.947360:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788391060.947368:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:38460:x1875263103415936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788391060.950660:0:39121:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788391060.950674:0:39121:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -63 00002000:02000040:1.0:1788391060.950682:0:39121:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:161) 00002000:00010000:1.0:1788391060.978869:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391060.978885:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.978907:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391060.978913:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391060.978921:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.978941:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979013:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979024:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979067:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391060.979081:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391060.979088:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979096:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391060.979101:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979111:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979132:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979140:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd358e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979160:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.979167:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.979169:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391060.979681:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391060.979688:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979697:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391060.979713:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391060.979718:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979729:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979738:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979745:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979761:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391060.979771:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391060.979776:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979784:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391060.979788:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979808:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979819:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979827:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd358ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.979840:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.979842:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.979843:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391060.983080:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.983095:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983114:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.983119:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.983126:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983144:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983156:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983177:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983200:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788391060.983765:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.983772:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983782:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.983785:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.983789:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983799:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983807:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983815:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.983833:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788391060.984267:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.984273:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984289:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.984292:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.984297:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984308:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984316:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984324:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984334:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788391060.984721:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.984727:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984736:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.984739:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.984743:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984751:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984769:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984776:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.984783:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788391060.985200:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.985206:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985215:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.985218:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.985222:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985232:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985241:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985248:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985268:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788391060.985677:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.985683:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.985692:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.985695:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391060.989458:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788391060.989477:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989494:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.989500:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989512:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989542:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989551:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebd9ba3c/0x9aafc5f04cd358f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989591:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788391060.989595:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989602:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.989613:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989621:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989633:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989640:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b31d44f/0x9aafc5f04cd358f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989654:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788391060.989658:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989665:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.989669:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989688:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989711:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989719:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b62179/0x9aafc5f04cd358ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989733:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391060.989736:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989743:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.989746:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989754:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989764:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989771:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1ffe2a/0x9aafc5f04cd35906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989796:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391060.989800:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989806:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.989809:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989817:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989826:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989834:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002633cab1/0x9aafc5f04cd3590d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.989844:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.989846:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.989848:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.989854:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391060.990753:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.990781:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.990793:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.990800:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.990828:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788391060.991515:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.991524:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.991538:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.991549:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.991556:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.991568:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.991577:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.991585:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.991601:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788391060.992019:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.992026:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992034:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.992037:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.992042:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992052:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992061:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992074:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992082:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788391060.992482:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.992489:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992498:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.992501:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.992506:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992515:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992523:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992531:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992539:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788391060.992924:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.992930:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992945:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.992948:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.992952:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992987:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.992997:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993005:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993015:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788391060.993411:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391060.993417:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993426:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=878s v=(0 0) 00010000:00010000:0.0:1788391060.993429:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391060.993433:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993443:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993463:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993471:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391060.993481:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788391060.997169:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391060.997188:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.997208:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391060.997214:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391060.997220:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.997237:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.997248:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.997262:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.997277:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788391060.998034:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788391060.998045:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998055:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998069:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998080:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998104:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998112:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002650bcbf/0x9aafc5f04cd35914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998137:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788391060.998141:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998148:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998151:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998159:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998169:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998177:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c493e1/0x9aafc5f04cd3591b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998198:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788391060.998202:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998209:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998212:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998220:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998231:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998238:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c22ccd/0x9aafc5f04cd35922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998250:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788391060.998254:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998261:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998264:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998284:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998295:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998302:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055e3010b/0x9aafc5f04cd35929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998318:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788391060.998321:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998328:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998330:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998338:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998348:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998355:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd35930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998381:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391060.998385:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998392:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998395:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998403:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998413:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998420:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000655c202a/0x9aafc5f04cd35937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998432:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391060.998436:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998442:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391060.998446:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998464:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998475:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998481:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd3593e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391060.998494:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.998496:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.998498:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391060.998506:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391060.999160:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391060.999170:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999184:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391060.999188:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391060.999195:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999208:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999217:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999226:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999245:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391060.999257:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391060.999261:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999274:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391060.999277:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999286:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999298:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999305:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd35945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391060.999318:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.999320:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391060.999321:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391061.000106:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.000115:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000126:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.000130:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.000135:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000146:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000163:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000170:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000227:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391061.000670:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.000675:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000685:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.000687:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.000691:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000712:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000721:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.000729:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001083:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391061.001092:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001101:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.001105:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001115:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001133:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001142:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd3594c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001162:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391061.001173:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001181:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.001184:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001192:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001203:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.001211:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.001213:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.001215:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391061.001767:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391061.001775:0:39121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391061.002406:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.002413:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.002425:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.002429:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.002435:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.002448:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.002458:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.002466:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.002493:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391061.003055:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.003062:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003079:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.003082:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.003087:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003098:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003106:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003113:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003122:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788391061.003543:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.003549:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003558:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.003562:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.003566:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003576:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.003596:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003814:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788391061.003823:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003833:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391061.003838:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003849:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003871:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003886:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd3595a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003914:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391061.003918:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003925:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391061.003928:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003936:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003946:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003954:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd35961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391061.003998:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391061.004000:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391061.004002:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.004193:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391061.004250:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.004756:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391061.005406:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.005416:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.005431:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.005435:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.005442:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.005458:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.005468:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.005476:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.005501:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788391061.006031:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391061.006041:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006052:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.006056:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006066:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006103:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006110:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004855ea1e/0x9aafc5f04cd35968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006135:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391061.006138:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006144:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.006147:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006155:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006164:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006170:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd3596f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.006182:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.006183:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.006191:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.006200:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391061.008736:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.008750:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.008771:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.008777:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.008783:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.008801:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.008813:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.008821:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.008839:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391061.009370:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.009376:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009386:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.009396:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.009400:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009411:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009420:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009428:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009440:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788391061.009849:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.009857:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009866:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.009869:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.009873:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009883:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009892:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009906:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.009915:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788391061.010388:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.010396:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010405:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.010409:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.010413:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010423:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010432:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010439:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010448:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788391061.010837:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.010843:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010857:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.010860:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.010865:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010876:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010884:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010892:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.010901:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788391061.011339:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.011345:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.011354:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.011357:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.011362:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.011372:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.011392:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.011399:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.011407:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788391061.012141:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788391061.012151:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012162:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012168:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012178:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012201:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012209:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd35976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012238:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788391061.012243:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012250:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012253:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012275:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012287:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012295:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066818016/0x9aafc5f04cd3597d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012311:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788391061.012314:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012321:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012324:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012333:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012343:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012351:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084fe08d/0x9aafc5f04cd35984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012376:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788391061.012380:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012387:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012390:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012399:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012409:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012416:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd3598b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012427:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391061.012430:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012436:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012439:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012458:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012470:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012477:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd35992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012491:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391061.012495:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012501:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.012505:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012512:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012522:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012529:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069311ed7/0x9aafc5f04cd35999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.012552:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.012554:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.012556:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.012564:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391061.016178:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.016197:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.016219:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.016223:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.016230:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.016247:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.016258:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.016266:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.016302:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391061.017191:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.017200:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017212:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.017216:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.017220:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017230:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017239:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017245:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017261:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788391061.017785:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.017792:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017802:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.017812:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.017817:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017828:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017837:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017844:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.017853:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788391061.018342:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.018348:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.018357:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.018360:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.018365:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.018376:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.018385:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.018399:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.018409:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788391061.018925:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788391061.018935:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.018946:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.018952:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.018979:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019002:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019010:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a29dd51/0x9aafc5f04cd359a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019031:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788391061.019034:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019042:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.019052:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019060:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019072:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019079:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd359a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019092:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391061.019096:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019103:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.019106:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019113:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019124:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019131:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009845f1f7/0x9aafc5f04cd359ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019152:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391061.019155:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019162:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.019165:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019173:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019183:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019191:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e01d751d/0x9aafc5f04cd359b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.019203:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.019205:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.019207:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.019216:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391061.020062:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391061.020071:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.020083:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=878s v=(0 0) 00010000:00010000:1.0:1788391061.020087:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391061.020092:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.020104:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.020113:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.020121:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391061.020141:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391061.020730:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391061.020737:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.020745:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391061.020759:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.020768:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.020782:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.020791:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be70e084/0x9aafc5f04cd359bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391061.020810:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.020812:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391061.020814:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788391061.021205:0:39121:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:98 00000100:00100000:1.0:1788391061.021329:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:38460:x1875263103415936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73957us (74966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391061.021347:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788391061.021763:0:38460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38460:1875263103415936:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788391061.021783:0:38460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xa1:0x0] from OST, last_created [0x280000400:0xa1:0x0]last_used is [0x280000400:0x62:0x0] 00000100:00100000:0.0:1788391061.021847:0:38460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38460:1875263103416064:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788391061.021892:0:38460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391061.021938:0:38460:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788391061.023676:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416064 00000100:00100000:2.0:1788391061.023692:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416064 00000100:00100000:2.0:1788391061.023766:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391061.023787:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:38460:x1875263103416064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788391061.023846:0:39120:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 162 00000001:00100000:1.0:1788391061.026848:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000100:00100000:2.0:1788391061.032868:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:38460:x1875263103416064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9069us (10960us total) trans 25769803777 rc 0/0 00000100:00100000:2.0:1788391061.032887:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788391061.033095:0:38460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:38460:1875263103416064:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788391061.033114:0:38460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xa1:0x0]-[0x280000400:0xc1:0x0] 00000001:00100000:2.0:1788391061.035855:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000004:00080000:2.0:1788391061.036061:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788391061.970380:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788391062.006237:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000100:00100000:1.0:1788391062.631425:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.638229:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094032896 00000100:00100000:2.0:1788391062.638253:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094032896 00000100:00100000:2.0:1788391062.638375:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788391062.638393:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+6:28515:x1875263094032896:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:2.0:1788391062.638455:0:39647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788391062.638586:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+6:28515:x1875263094032896:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 200us (7175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.638594:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:1.0:1788391062.638701:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391062.641909:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.642217:0:39122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033024 00000100:00100000:2.0:1788391062.642230:0:39122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033024 00000100:00100000:2.0:1788391062.642327:0:39122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391062.642341:0:39122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27474853-4920-4406-9272-38eff2ad2609+5:28515:x1875263094033024:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:2.0:1788391062.642391:0:39122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391062.642539:0:39122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27474853-4920-4406-9272-38eff2ad2609+5:28515:x1875263094033024:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 201us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.642549:0:39122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00080000:1.0:1788391062.642850:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391062.644665:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391062.644945:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033152 00000100:00100000:3.0:1788391062.644957:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033152 00000100:00100000:3.0:1788391062.645075:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788391062.645088:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27474853-4920-4406-9272-38eff2ad2609+5:28515:x1875263094033152:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1788391062.645116:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391062.645220:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:27474853-4920-4406-9272-38eff2ad2609+5:28515:x1875263094033152:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 134us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391062.645228:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00080000:2.0:1788391062.645423:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391062.776895:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.777039:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033280 00000100:00100000:2.0:1788391062.777051:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033280 00000100:00100000:2.0:1788391062.777146:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1788391062.777157:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+10:28546:x1875263094033280:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788391062.777178:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391062.777200:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1e400/0x9aafc5f04cd359c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff8ca expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391062.777236:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1e400/0x9aafc5f04cd359c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8ca expref: 11 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391062.777247:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1e400/0x9aafc5f04cd359c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8ca expref: 11 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391062.777257:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e400, rc 0) 00000100:00100000:2.0:1788391062.777327:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033280:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 172us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.777334:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788391062.786314:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.786436:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033408 00000100:00100000:2.0:1788391062.786451:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033408 00000100:00100000:2.0:1788391062.786526:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:2.0:1788391062.786539:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033408:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788391062.786999:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033408:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 420us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.787009:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788391062.793552:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391062.794027:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033536 00000100:00100000:1.0:1788391062.794041:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033536 00000100:00100000:1.0:1788391062.794112:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391062.794125:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033536:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788391062.794429:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033536:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 305us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391062.794438:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391062.800225:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.802150:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033664 00000100:00100000:0.0:1788391062.802169:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033664 00000100:00100000:0.0:1788391062.802266:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788391062.802282:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28555:x1875263094033664:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391062.804887:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28555:x1875263094033664:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 2591us (4656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.804909:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391062.822093:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.822255:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033792 00000100:00100000:2.0:1788391062.822268:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033792 00000100:00100000:2.0:1788391062.822344:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1788391062.822357:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28555:x1875263094033792:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788391062.822729:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28555:x1875263094033792:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 373us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.822738:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1788391062.830882:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391062.831919:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094033920 00000100:00100000:1.0:1788391062.832088:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094033920 00000100:00100000:1.0:1788391062.832168:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788391062.832182:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28546:x1875263094033920:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788391062.832210:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391062.832244:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4df7800/0x9aafc5f04cd359ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff8f4 expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391062.832345:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df7800/0x9aafc5f04cd359ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8f4 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391062.832365:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4df7800/0x9aafc5f04cd359ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8f4 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391062.832382:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7800, rc 0) 00000100:00100000:1.0:1788391062.832500:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28546:x1875263094033920:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 318us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391062.832513:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788391062.836842:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.837013:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034048 00000100:00100000:0.0:1788391062.837026:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034048 00000100:00100000:0.0:1788391062.837084:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788391062.837095:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28546:x1875263094034048:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788391062.837126:0:38427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788391062.837185:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788391062.837190:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788391062.837193:0:38427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788391062.837196:0:38427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:0.0:1788391062.842104:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28546:x1875263094034048:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 4995us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.842123:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391062.846138:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.846262:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034176 00000100:00100000:0.0:1788391062.846276:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034176 00000100:00100000:0.0:1788391062.846353:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788391062.846366:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28546:x1875263094034176:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788391062.846387:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391062.846412:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff8fb expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391062.846448:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 13 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391062.846462:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 13 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391062.846491:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a000, rc 0) 00000100:00100000:0.0:1788391062.846691:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28546:x1875263094034176:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 318us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.846699:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788391062.863803:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.863958:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034304 00000100:00100000:0.0:1788391062.863996:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034304 00000100:00100000:0.0:1788391062.864055:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788391062.864068:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28546:x1875263094034304:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788391062.864450:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28546:x1875263094034304:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 383us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.864460:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1788391062.867338:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.868341:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034432 00000100:00100000:0.0:1788391062.868358:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034432 00000100:00100000:0.0:1788391062.868492:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:0.0:1788391062.868506:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28546:x1875263094034432:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788391062.868810:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28546:x1875263094034432:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 305us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.868818:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788391062.874376:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391062.875042:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034560 00000100:00100000:1.0:1788391062.875057:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034560 00000100:00100000:1.0:1788391062.875135:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:1.0:1788391062.875149:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28558:x1875263094034560:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788391062.875485:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28558:x1875263094034560:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 338us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391062.875495:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:1.0:1788391062.880467:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.880572:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034688 00000100:00100000:0.0:1788391062.880585:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034688 00000100:00100000:0.0:1788391062.880655:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788391062.880667:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28558:x1875263094034688:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391062.881146:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28558:x1875263094034688:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 479us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.881169:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788391062.887616:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.887792:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034816 00000100:00100000:2.0:1788391062.887807:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034816 00000100:00100000:2.0:1788391062.887874:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391062.887885:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263094034816:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788391062.887920:0:38435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp t0 exp 0000000000000000 cur 879 last 0 00000020:00000080:2.0:1788391062.888167:0:38435:0:(genops.c:1385:class_connect()) connect: client 14847363-0daa-48dd-bf83-08d2101df15c, cookie 0x9aafc5f04cd359d8 00000004:00100000:2.0:1788391062.888198:0:38435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788391062.888788:0:38435:0:(import.c:65:import_set_state_nolock()) ffff95d6a6b03000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391062.888870:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+6:2355:x1875263094034816:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 986us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.888879:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788391062.896606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391062.896666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.898870:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035072 00000100:00100000:0.0:1788391062.898889:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035072 00000100:00080000:1.0:1788391062.899202:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391062.901068:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094034944 00000100:00100000:2.0:1788391062.901083:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094034944 00000100:00100000:2.0:1788391062.901165:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391062.901178:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+7:0:x1875263094034944:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788391062.901236:0:38437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788391062.902020:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+7:0:x1875263094034944:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 842us (5350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.902029:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788391062.902803:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391062.902816:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035072:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788391062.902838:0:39647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788391062.902887:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035072:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 76us (6296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391062.902894:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391062.914035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391062.914301:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035200 00000100:00100000:0.0:1788391062.914315:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035200 00000100:00100000:0.0:1788391062.914393:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391062.914404:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035200:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788391062.914520:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035200:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 117us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391062.914529:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788391062.920343:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.920746:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035328 00000100:00100000:2.0:1788391062.920776:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035328 00000100:00100000:2.0:1788391062.920833:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391062.920842:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875263094035328:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788391062.920882:0:39225:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp t0 exp 0000000000000000 cur 880 last 0 00000020:00000080:2.0:1788391062.921026:0:39225:0:(genops.c:1385:class_connect()) connect: client 14847363-0daa-48dd-bf83-08d2101df15c, cookie 0x9aafc5f04cd359df 00002000:00100000:2.0:1788391062.921044:0:39225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14847363-0daa-48dd-bf83-08d2101df15c/ffff95d6a6b02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788391062.921059:0:39225:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788391062.921361:0:39225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788391062.921402:0:39225:0:(import.c:65:import_set_state_nolock()) ffff95d58716f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391062.921490:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:2355:x1875263094035328:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 646us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.921498:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788391062.922127:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391062.922232:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035456 00000100:00100000:1.0:1788391062.922238:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035456 00000100:00100000:1.0:1788391062.922273:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391062.922290:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263094035456:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788391062.922311:0:39118:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp t0 exp 0000000000000000 cur 880 last 0 00000020:00000080:1.0:1788391062.922339:0:39118:0:(genops.c:1385:class_connect()) connect: client 14847363-0daa-48dd-bf83-08d2101df15c, cookie 0x9aafc5f04cd359e6 00002000:00100000:1.0:1788391062.922348:0:39118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14847363-0daa-48dd-bf83-08d2101df15c/ffff95d585fc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788391062.922367:0:39118:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788391062.922660:0:39118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788391062.922681:0:39118:0:(import.c:65:import_set_state_nolock()) ffff95d585fc0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788391062.922729:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14847363-0daa-48dd-bf83-08d2101df15c+6:2355:x1875263094035456:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 438us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391062.922738:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391062.923217:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391062.923454:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035584 00000100:00100000:2.0:1788391062.923459:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035584 00000100:00100000:2.0:1788391062.923503:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788391062.923511:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035584:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788391062.923611:0:38439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788391062.923675:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:28546:x1875263094035584:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 165us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391062.923693:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00010000:00010000:0.0:1788391062.989375:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391062.989555:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391062.989593:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103416192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391062.989700:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391062.989821:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416192 00000100:00100000:1.0:1788391062.989833:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416192 00000100:00100000:1.0:1788391062.989907:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391062.989918:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103416192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391062.989957:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391062.990029:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103416192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391062.990037:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788391062.990271:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103416192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788391062.991862:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391063.072487:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391063.072579:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035712 00000100:00100000:3.0:1788391063.072602:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035712 00000100:00100000:3.0:1788391063.072690:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788391063.072703:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:28579:x1875263094035712:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:3.0:1788391063.072729:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391063.072759:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd359ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff925 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.072850:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.072867:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.072899:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391063.073141:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391063.073146:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391063.073175:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.073207:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd359ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 8 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.073229:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 7 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391063.073239:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788391063.073242:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391063.073247:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:3.0:1788391063.073370:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+7:28579:x1875263094035712:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 669us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391063.073378:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:0.0:1788391064.013383:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391064.932382:0:40392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788391065.037769:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391066.063835:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103416320:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.063909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788391066.065545:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391066.065856:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416320 00000100:00100000:1.0:1788391066.065867:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416320 00000100:00100000:1.0:1788391066.065916:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788391066.065925:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103416320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.066017:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103416320:12345-0@lo:400:kworker.0 Request processed in 93us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391066.066034:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788391066.069743:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103416448:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.069794:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103416576:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.069869:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391066.069916:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103417088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391066.069937:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391066.069975:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391066.069982:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103416704:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.070005:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391066.070427:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416576 00000100:00100000:1.0:1788391066.070435:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416576 00000100:00100000:1.0:1788391066.070490:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391066.070498:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103416576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.070553:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103416576:12345-0@lo:400:kworker.0 Request processed in 55us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391066.070560:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391066.070581:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417088 00000100:00100000:1.0:1788391066.070585:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417088 00000100:00100000:1.0:1788391066.070608:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788391066.070614:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103417088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391066.070785:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788391066.070821:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103417088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391066.070827:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788391066.070845:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391066.072479:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416704 00000100:00100000:1.0:1788391066.072494:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416704 00000100:00100000:1.0:1788391066.072545:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788391066.072553:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103416704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.072626:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103416704:12345-0@lo:400:kworker.0 Request processed in 73us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391066.072645:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788391066.074257:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103416320:0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.074273:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103416832:0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.074334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391066.074412:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391066.074438:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416448 00000100:00100000:1.0:1788391066.074444:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416448 00000100:00100000:1.0:1788391066.074494:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391066.074503:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103416448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.074545:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103416448:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391066.074551:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788391066.074571:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391066.074591:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103416448:0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.074598:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103416960:0@lo:400:kworker.0 00000100:00100000:1.0:1788391066.074621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391066.083021:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416832 00000100:00100000:3.0:1788391066.083035:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416832 00000100:00100000:3.0:1788391066.083090:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103416960 00000100:00100000:3.0:1788391066.083094:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103416960 00000100:00100000:3.0:1788391066.083117:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391066.083126:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103416832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391066.083218:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103416832:12345-0@lo:400:kworker.0 Request processed in 93us (8883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391066.083237:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391066.083255:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391066.083261:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103416960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391066.085442:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103416960:12345-0@lo:400:kworker.0 Request processed in 2172us (10811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391066.085457:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788391066.085491:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391066.085539:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103416832:0@lo:400:kworker.0 00000100:00100000:3.0:1788391066.085950:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103416960:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.090001:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103416704:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.090023:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103416576:0@lo:400:kworker.0 00000100:00100000:2.0:1788391066.090043:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103417088:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788391066.149214:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000001:00100000:1.0:1788391066.163351:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000001:00080000:1.0:1788391066.163394:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803777 is committed 00000001:00100000:1.0:1788391066.163404:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788391067.085371:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788391067.114598:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000020:00000080:2.0:1788391067.296106:0:40543:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc3bd6b80 20000000:00000080:2.0:1788391067.296124:0:40543:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d68433dc00 uarg=0000000000000000 20000000:01000000:2.0:1788391067.296159:0:40543:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788391067.296165:0:40543:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788391067.296171:0:40543:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788391067.298704:0:40544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788391067.298868:0:40543:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788391067.298875:0:40543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788391067.298891:0:40543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298906:0:40543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298911:0:40543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298927:0:40543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 18 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298934:0:40543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 12 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298938:0:40543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 12 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.298942:0:40543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299006:0:40543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 12 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299021:0:40543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 12 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.299046:0:40543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417216:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391067.299146:0:40543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 12 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299155:0:40543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 12 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.299164:0:40543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417344:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391067.299194:0:40543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 18 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299212:0:40543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 18 pid: 38427 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.299222:0:40543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417472:0@lo:104: 00000100:00100000:1.0:1788391067.299259:0:40543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391067.299287:0:40543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299292:0:40543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 18 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.299297:0:40543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417600:0@lo:104: 00000100:00100000:1.0:1788391067.299309:0:40543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391067.299334:0:40543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391067.299341:0:40543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 18 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.299349:0:40543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417728:0@lo:104: 00000100:00100000:1.0:1788391067.299371:0:40543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391067.299380:0:40543:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788391067.299493:0:38419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788391067.299509:0:38419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417472 00000100:00100000:0.0:1788391067.299514:0:38419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417472 00000100:00100000:0.0:1788391067.299548:0:38419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417600 00000100:00100000:0.0:1788391067.299551:0:38419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417600 00000100:00100000:0.0:1788391067.299562:0:38419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417728 00000100:00100000:0.0:1788391067.299564:0:38419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417728 00000100:00100000:0.0:1788391067.299576:0:38419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391067.299584:0:38419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+5:40543:x1875263103417472:12345-0@lo:104: 00010000:00010000:0.0:1788391067.299595:0:38419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299666:0:38419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788391067.299673:0:38419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+5:40543:x1875263103417472:12345-0@lo:104: Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391067.299680:0:38419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391067.299698:0:38419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391067.299705:0:38419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+4:40543:x1875263103417600:12345-0@lo:104: 00010000:00010000:0.0:1788391067.299712:0:38419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299746:0:38419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788391067.299752:0:38419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+4:40543:x1875263103417600:12345-0@lo:104: Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391067.299758:0:38419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391067.299776:0:38419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391067.299783:0:38419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+3:40543:x1875263103417728:12345-0@lo:104: 00010000:00010000:0.0:1788391067.299791:0:38419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299819:0:38419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788391067.299824:0:38419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+3:40543:x1875263103417728:12345-0@lo:104: Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391067.299830:0:38419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788391067.299875:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788391067.299882:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299890:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391067.299900:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299909:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391067.299917:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391067.299922:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788391067.299975:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.299981:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391067.299998:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300005:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1f400/0x9aafc5f04cd35850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35857 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300016:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391067.300020:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300025:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93a00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391067.300033:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300040:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391067.300056:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391067.300062:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788391067.300076:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300082:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391067.300093:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300100:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a6a93a00/0x9aafc5f04cd35700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd35707 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300108:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391067.300111:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300116:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f63200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391067.300119:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300126:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391067.300132:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391067.300137:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788391067.300155:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300161:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391067.300167:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300173:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f63200/0x9aafc5f04cd356b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd356ba expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.300184:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391067.300186:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391067.300188:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391067.300194:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391067.300294:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103417856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788391067.300329:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391067.300342:0:40543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417472:0@lo:104: 00000100:00100000:1.0:1788391067.300355:0:40543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417600:0@lo:104: 00000100:00100000:1.0:1788391067.300366:0:40543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417728:0@lo:104: 00000100:00100000:3.0:1788391067.300551:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103417984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788391067.300578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391067.300606:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391067.300612:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103418112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788391067.300635:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391067.300705:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417856 00000100:00100000:2.0:1788391067.300711:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417856 00010000:00010000:2.0:1788391067.300740:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 19 pid: 38427 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391067.300758:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103417984 00000100:00100000:2.0:1788391067.300761:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103417984 00010000:00010000:2.0:1788391067.300774:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 20 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.300784:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103418112 00000100:00100000:2.0:1788391067.300790:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391067.300790:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103418112 00000100:00100000:2.0:1788391067.300805:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+21:3289:x1875263103417856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391067.300817:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391067.300817:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 21 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.300827:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 21 pid: 38427 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.300833:0:38422:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788391067.300838:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 21 pid: 38427 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391067.300839:0:38422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788391067.300853:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93e00/0x9aafc5f04cd35857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35850 expref: 21 pid: 38427 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.300865:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391067.300905:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+20:3289:x1875263103417856:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391067.300911:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788391067.300926:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391067.300932:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103417984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391067.300940:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391067.300944:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 19 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.300951:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 19 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.300980:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877aa000/0x9aafc5f04cd35707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd35700 expref: 19 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.300990:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391067.301002:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788391067.301013:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+18:3286:x1875263103418112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391067.301023:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788391067.301024:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:3286:x1875263103417984:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391067.301038:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391067.301064:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103417984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391067.301117:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103417856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391067.301156:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 17 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391067.301167:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 17 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391067.301257:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877ab200/0x9aafc5f04cd356ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd356b3 expref: 17 pid: 38428 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391067.301278:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391067.301316:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:3286:x1875263103418112:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391067.301323:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788391067.301545:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103418112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391067.303728:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391067.303758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391067.303914:0:40543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417216:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391067.303925:0:40543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:40543:1875263103417344:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391067.303957:0:40543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391067.306858:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035840 00000100:00100000:0.0:1788391067.306874:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035840 00010000:00010000:0.0:1788391067.306922:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 13 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391067.306977:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094035968 00000100:00100000:0.0:1788391067.306980:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094035968 00010000:00010000:0.0:1788391067.306994:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 14 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391067.307032:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788391067.307043:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3aafef2f-890d-4372-806a-7a8032c96dbb+14:2356:x1875263094035840:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391067.307058:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391067.307065:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 14 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.307079:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 14 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391067.307088:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788391067.307103:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+14:2356:x1875263094035968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391067.307113:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391067.307115:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd359d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8fb expref: 14 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.307121:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 14 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.307137:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 13 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391067.307420:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391067.307729:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2356:x1875263094035840:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 686us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391067.307738:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00010000:00010000:2.0:1788391067.308060:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92a00/0x9aafc5f04cd358b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff899 expref: 12 pid: 38430 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308074:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308082:0:40545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308110:0:40545:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308118:0:40545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308124:0:40545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308131:0:40545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308137:0:40545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391067.308142:0:40545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308150:0:40545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308169:0:40545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391067.308181:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391067.308239:0:40543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391067.308249:0:40543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391067.308256:0:40543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df7200/0x9aafc5f04cd359fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 40543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391067.308261:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+11:2356:x1875263094035968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1160us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391067.308271:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788391068.038232:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.038836:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036096 00000100:00100000:3.0:1788391068.038848:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036096 00000100:00100000:3.0:1788391068.038915:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788391068.038924:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+6:29034:x1875263094036096:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391068.038941:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.038957:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff92c expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039042:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039055:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039065:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039091:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039095:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039099:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039341:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039350:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039356:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391068.039380:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391068.039384:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391068.039418:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039428:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039435:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039441:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039456:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391068.039461:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039466:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039476:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788391068.039478:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391068.039481:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039485:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039493:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039497:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039501:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039503:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391068.039505:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039508:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039518:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d686a70600) 00010000:00010000:3.0:1788391068.039519:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391068.039521:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039524:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039548:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff92c expref: 8 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039560:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff92c expref: 7 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.039566:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70200) 00010000:00010000:3.0:1788391068.039568:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391068.039570:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd400, rc 0) 00000100:00100000:3.0:1788391068.039676:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+7:29034:x1875263094036096:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 715us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.039684:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:1.0:1788391068.040721:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391068.041802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.041949:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036352 00000100:00100000:2.0:1788391068.042011:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036352 00000100:00100000:2.0:1788391068.042078:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391068.042089:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+7:29034:x1875263094036352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391068.042124:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.042146:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff933 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042219:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042233:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042247:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042263:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042269:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042276:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042648:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd35a33 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042658:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd35a33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042666:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd35a33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391068.042675:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788391068.042880:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042888:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042895:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042901:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.042905:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042911:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042923:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70200) 00010000:00010000:2.0:1788391068.042926:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.042930:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042935:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042947:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042952:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042957:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.042996:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.042999:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043005:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043013:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d68641e600) 00010000:00010000:2.0:1788391068.043016:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.043019:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043024:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043472:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff933 expref: 10 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043489:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd35a33 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff933 expref: 9 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.043496:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:2.0:1788391068.043498:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.043501:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788391068.043576:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+9:29034:x1875263094036352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1486us (1781us total) trans 25769803777 rc 0/0 00000100:00100000:2.0:1788391068.043583:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788391068.049329:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.049609:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036480 00000100:00100000:3.0:1788391068.049620:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036480 00000100:00100000:3.0:1788391068.049739:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788391068.049749:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+9:29034:x1875263094036480:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788391068.049870:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+9:29034:x1875263094036480:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 116us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.049877:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391068.109349:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391068.109370:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103418240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391068.109438:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391068.109499:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103418240 00000100:00100000:1.0:1788391068.109505:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103418240 00000100:00100000:1.0:1788391068.109552:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788391068.109561:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103418240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391068.109594:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391068.109647:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103418240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.109655:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788391068.109689:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391068.109721:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103418240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391068.109988:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391068.125615:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.125732:0:38444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036608 00000100:00100000:2.0:1788391068.125755:0:38444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036608 00000100:00100000:2.0:1788391068.125810:0:38444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391068.125821:0:38444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:27474853-4920-4406-9272-38eff2ad2609+9:29043:x1875263094036608:12345-192.168.202.1@tcp:700:mkdir.0 00000100:00100000:2.0:1788391068.125910:0:38444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:27474853-4920-4406-9272-38eff2ad2609+9:29043:x1875263094036608:12345-192.168.202.1@tcp:700:mkdir.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.125917:0:38444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391068.127147:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.127197:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036864 00000100:00100000:2.0:1788391068.127203:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036864 00000100:00100000:2.0:1788391068.127239:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788391068.127248:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+9:29043:x1875263094036864:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:2.0:1788391068.127293:0:38437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391068.127315:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd358d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8c3 expref: 9 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.127329:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:2.0:1788391068.127333:0:38437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391068.127656:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.127675:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 5 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.127682:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.127707:0:38437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 5 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.127725:0:38437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 5 pid: 39647 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.127737:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103418368:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391068.127805:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.130013:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.130136:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094036992 00000100:00100000:3.0:1788391068.130160:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094036992 00000100:00100000:2.0:1788391068.130201:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103418368:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391068.130235:0:38437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130251:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 6 pid: 39647 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.130305:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788391068.130318:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:2356:x1875263094036992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391068.130335:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391068.130343:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 6 pid: 39647 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130358:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 6 pid: 39647 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130387:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd359f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff925 expref: 6 pid: 39647 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130409:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:3.0:1788391068.130414:0:38421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130424:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130430:0:38421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.130457:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391068.130515:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:2356:x1875263094036992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 201us (513us total) trans 0 rc 0/0 00010000:00010000:2.0:1788391068.130518:0:38437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.130528:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.130551:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00010000:00010000:2.0:1788391068.130562:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.130576:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.130585:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788391068.130622:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788391068.131871:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788391068.131886:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131893:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131906:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131911:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.131915:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131921:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131935:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d684d23300) 00010000:00010000:2.0:1788391068.131938:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.131942:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.131947:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a41 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391068.132002:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005760668a reply state 00000000fc93bba0 transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.132011:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391068.132091:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+10:29043:x1875263094036864:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 4840us (4942us total) trans 25769803778 rc 0/0 00000100:00100000:2.0:1788391068.132099:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:2.0:1788391068.133751:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133765:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133787:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133793:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.133799:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133806:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133820:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff95d68641e600) 00010000:00010000:2.0:1788391068.133823:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.133826:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.133832:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a48 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.142012:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.142104:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037120 00000100:00100000:3.0:1788391068.142121:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037120 00000100:00100000:3.0:1788391068.142212:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391068.142225:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+9:29044:x1875263094037120:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788391068.142260:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.142289:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff93a expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142379:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142395:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142410:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391068.142459:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391068.142464:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391068.142514:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142548:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff93a expref: 11 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142570:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff93a expref: 10 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.142604:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391068.142607:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391068.142611:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:3.0:1788391068.142721:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+10:29044:x1875263094037120:12345-192.168.202.1@tcp:101:rm.0 Request processed in 498us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.142729:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391068.145017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.145152:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037248 00000100:00100000:0.0:1788391068.145164:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037248 00000100:00100000:0.0:1788391068.145227:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788391068.145239:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+10:29044:x1875263094037248:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1788391068.145264:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391068.145286:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff941 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145352:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145367:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145379:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145425:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145433:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145446:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145532:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145541:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145548:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391068.145575:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391068.145580:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391068.145603:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145615:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145622:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145628:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145656:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.145660:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145669:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145681:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:0.0:1788391068.145684:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.145689:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145695:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145710:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145716:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145722:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145726:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.145730:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145742:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145760:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff95d6a0d59600) 00010000:00010000:0.0:1788391068.145763:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.145776:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145783:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35a6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145812:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff941 expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145826:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff941 expref: 11 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.145833:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391068.145836:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788391068.145838:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a000, rc 0) 00000100:00100000:0.0:1788391068.146289:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+11:29044:x1875263094037248:12345-192.168.202.1@tcp:101:rm.0 Request processed in 1049us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.146297:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391068.149091:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.149241:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037376 00000100:00100000:3.0:1788391068.149252:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037376 00000100:00100000:3.0:1788391068.149315:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788391068.149326:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+11:29044:x1875263094037376:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788391068.149348:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.149368:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35a79 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff948 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149720:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149735:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149745:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149762:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149924:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.149943:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150190:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150199:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150205:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150211:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.150216:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150235:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150249:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.150252:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.150257:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150263:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd35a80 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150277:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150282:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150288:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150294:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.150296:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150302:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150308:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d686a70500) 00010000:00010000:2.0:1788391068.150311:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.150313:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150329:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35a87 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150367:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35a79 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff948 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150378:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.150380:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.150384:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35a79 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff948 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.150393:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:2.0:1788391068.150745:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+11:29044:x1875263094037376:12345-192.168.202.1@tcp:101:rm.0 Request processed in 1418us (1657us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391068.150754:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391068.152930:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.153065:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037504 00000100:00100000:2.0:1788391068.153074:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037504 00000100:00100000:2.0:1788391068.153141:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788391068.153151:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+11:29044:x1875263094037504:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788391068.153171:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.153190:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a8e lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff94f expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153257:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153270:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153295:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153309:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153317:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153326:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153382:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153391:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153397:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153403:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.153407:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153414:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153427:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.153430:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.153833:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153849:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35a95 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153865:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153871:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153877:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153882:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.153884:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153888:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153894:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d68641e600) 00010000:00010000:2.0:1788391068.153896:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.153898:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153902:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35a9c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153929:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a8e lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff94f expref: 12 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153943:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.153944:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.153947:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35a8e lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff94f expref: 12 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.153952:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391068.154071:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+11:29044:x1875263094037504:12345-192.168.202.1@tcp:101:rm.0 Request processed in 921us (1147us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391068.154077:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788391068.189425:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.189645:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037760 00000100:00100000:0.0:1788391068.189655:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037760 00000100:00100000:0.0:1788391068.189722:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788391068.189733:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+11:29050:x1875263094037760:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391068.189753:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391068.189782:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35aa3 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff956 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189912:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189923:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189932:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189941:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189946:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.189950:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391068.190742:0:38436:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x63:0x0], count =63 00000004:00080000:0.0:1788391068.190749:0:38436:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x63:0x0]+63 in llog 00000004:00080000:0.0:1788391068.190844:0:38436:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa2:0x0], index 1: 0 00010000:00010000:0.0:1788391068.191018:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191030:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191040:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191073:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191085:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191090:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191093:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.191097:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191101:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191110:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391068.191112:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.191115:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191118:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35aaa lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391068.191128:0:38436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000195f1ddb reply state 000000005afd6371 transno 25769803779 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.191134:0:38436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391068.191159:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35aa3 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 14 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191168:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 13 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.191181:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391068.191183:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391068.191185:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ae00, rc 0) 00000100:00100000:0.0:1788391068.191289:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+14:29050:x1875263094037760:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1559us (1882us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788391068.191295:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00010000:00010000:0.0:1788391068.193808:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193826:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193834:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193839:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.193843:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193849:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193864:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391068.193867:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.193871:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.193876:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ab1 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391068.194355:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.194673:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094037888 00000100:00100000:2.0:1788391068.194684:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094037888 00000100:00100000:2.0:1788391068.194756:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788391068.194779:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+5:2356:x1875263094037888:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391068.194796:0:39121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.194816:0:39121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff95d expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391068.194843:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391068.194861:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=885s v=(0 0) 00010000:00010000:2.0:1788391068.194866:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391068.194875:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 6 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.194892:0:39121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 6 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.194917:0:39121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391068.195007:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094037888:12345-192.168.202.1@tcp:101:bash.0 Request processed in 241us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.195014:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:1.0:1788391068.195127:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391068.198017:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.198105:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038016 00000100:00100000:2.0:1788391068.198115:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038016 00000100:00100000:2.0:1788391068.198171:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391068.198181:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:29050:x1875263094038016:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391068.198199:0:39118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.198217:0:39118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff964 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.198250:0:39118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 7 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.198260:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391068.198264:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391068.198269:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.198304:0:39118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 7 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.198317:0:39118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 7 pid: 39121 timeout: 985 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.198346:0:39118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:39118:1875263103418496:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391068.198722:0:39118:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391068.202100:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.202174:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038144 00000100:00100000:0.0:1788391068.202184:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038144 00010000:00010000:0.0:1788391068.202223:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 8 pid: 39121 timeout: 985 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.202269:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788391068.202279:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+8:2356:x1875263094038144:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391068.202293:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391068.202316:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 8 pid: 39121 timeout: 985 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.202329:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 8 pid: 39121 timeout: 985 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.202363:0:38422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391068.202368:0:38422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391068.202375:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 8 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.202385:0:38422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 8 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.202421:0:38422:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 8 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.202566:0:38422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:38422:1875263103418624:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391068.202689:0:38422:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788391068.203042:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35ac6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff95d expref: 8 pid: 39121 timeout: 985 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.203058:0:39118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:39118:1875263103418496:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391068.203084:0:39118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.203096:0:39118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391068.203125:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+7:29050:x1875263094038016:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4946us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.203132:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788391068.205606:0:38422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:38422:1875263103418624:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391068.205626:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391068.205735:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094038144:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3456us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.205745:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391068.206786:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.206873:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038400 00000100:00100000:2.0:1788391068.206881:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038400 00000100:00100000:2.0:1788391068.206992:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788391068.207003:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+13:29050:x1875263094038400:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788391068.207370:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+14:29050:x1875263094038400:12345-192.168.202.1@tcp:35:bash.0 Request processed in 368us (586us total) trans 25769803780 rc 0/0 00000100:00100000:2.0:1788391068.207378:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788391068.253410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.253576:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038528 00000100:00100000:0.0:1788391068.253585:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038528 00000100:00100000:0.0:1788391068.253722:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391068.253734:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+14:29056:x1875263094038528:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391068.253759:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391068.253779:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff96b expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.253852:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.253867:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.253880:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391068.253914:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391068.253918:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391068.253939:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.253993:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff96b expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.254012:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff96b expref: 15 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.254045:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391068.254048:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391068.254052:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a800, rc 0) 00000100:00100000:0.0:1788391068.254104:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+15:29056:x1875263094038528:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 372us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.254111:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788391068.257063:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.257127:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038784 00000100:00100000:2.0:1788391068.257137:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038784 00000100:00100000:2.0:1788391068.257193:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788391068.257218:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+15:29056:x1875263094038784:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391068.257237:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.257271:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35ae2 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff972 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.257364:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.257378:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 16 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.257386:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 4/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.257420:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 16 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.257432:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 16 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.257445:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103418752:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391068.257524:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391068.260040:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.260076:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094038912 00000100:00100000:0.0:1788391068.260086:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094038912 00010000:00010000:0.0:1788391068.260127:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 17 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.260167:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788391068.260176:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+17:2357:x1875263094038912:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391068.260187:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788391068.260191:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103418752:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391068.260195:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 17 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260209:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 17 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260225:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35ab8 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff956 expref: 17 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260268:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:2.0:1788391068.260270:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260276:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260300:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260308:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.260332:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391068.260339:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.260359:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391068.260378:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00000100:00100000:0.0:1788391068.260384:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+16:2357:x1875263094038912:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 208us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.260390:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00010000:00010000:2.0:1788391068.260526:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35ae2 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff972 expref: 17 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.260542:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff972 expref: 16 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.260551:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:2.0:1788391068.260554:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391068.260556:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391068.260582:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+16:29056:x1875263094038784:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3369us (3527us total) trans 25769803781 rc 0/0 00000100:00100000:2.0:1788391068.260590:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391068.263210:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.263279:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039168 00000100:00100000:3.0:1788391068.263361:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039168 00000100:00100000:3.0:1788391068.263446:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788391068.263460:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+16:29056:x1875263094039168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391068.263658:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.263663:0:38437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391068.263697:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35ae9 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff972 expref: 16 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.263867:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:3.0:1788391068.263881:0:38437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391068.263905:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35af7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff979 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.264077:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.264091:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.264125:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391068.264141:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788391068.264687:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd35af7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff979 expref: 18 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.264703:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff979 expref: 17 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.264710:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391068.264714:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391068.264716:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:3.0:1788391068.265235:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+17:29056:x1875263094039168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1659us (1913us total) trans 25769803782 rc 0/0 00000100:00100000:3.0:1788391068.265244:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788391068.268759:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.268839:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039296 00000100:00100000:0.0:1788391068.268859:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039296 00000100:00100000:0.0:1788391068.268947:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788391068.269001:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+17:29056:x1875263094039296:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391068.269095:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391068.269123:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff980 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.269191:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 18 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.269209:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 18 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.269228:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:1.0:1788391068.269231:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391068.269234:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6800, rc 0) 00000100:00100000:1.0:1788391068.269294:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+18:29056:x1875263094039296:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 337us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.269304:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788391068.273095:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.273591:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039424 00000100:00100000:2.0:1788391068.273602:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039424 00000100:00100000:2.0:1788391068.273678:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391068.273689:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094039424:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1788391068.273735:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.273755:0:39121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 6 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.273763:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391068.273781:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391068.273786:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.273822:0:39121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 6 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.273835:0:39121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 6 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.273850:0:39121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:39121:1875263103418880:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391068.273933:0:39121:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.276454:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.276648:0:39121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:39121:1875263103418880:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391068.276698:0:39121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.277937:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039552 00000100:00100000:3.0:1788391068.277954:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039552 00002000:00100000:3.0:1788391068.278035:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff95d687861c00 x1875263094039552/t0(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:684/0 lens 504/0 e 0 to 0 dl 1788391079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391068.278047:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861c00 with x1875263094039552 ext(0->8) 00010000:00010000:3.0:1788391068.278058:0:39124:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 7 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.278077:0:39124:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 7 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391068.278110:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687861c00 00000100:00100000:3.0:1788391068.278155:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788391068.278166:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094039552:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:3.0:1788391068.279466:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+9:2356:x1875263094039552:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1289us (3014us total) trans 25769803778 rc 0/0 00000100:00100000:3.0:1788391068.279478:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:3.0:1788391068.279504:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff95d687861c00 x1875263094039552/t25769803778(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:684/0 lens 504/448 e 0 to 0 dl 1788391079 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391068.279514:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861c00 with x1875263094039552 ext(0->8) 00010000:00010000:3.0:1788391068.279524:0:39124:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.279552:0:39124:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391068.279561:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687861c00 00000100:00100000:1.0:1788391068.280455:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.280562:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039808 00000100:00100000:2.0:1788391068.280578:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039808 00000100:00100000:2.0:1788391068.280699:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391068.280710:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094039808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391068.280792:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094039808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00080000:3.0:1788391068.280801:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391068.280802:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788391068.283174:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.283217:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.283290:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039680 00000100:00100000:2.0:1788391068.283304:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039680 00000100:00100000:3.0:1788391068.283348:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040064 00000100:00100000:3.0:1788391068.283358:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040064 00000100:00100000:2.0:1788391068.283398:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788391068.283429:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:2358:x1875263094039680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391068.283442:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788391068.283455:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094040064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391068.283511:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+11:2358:x1875263094039680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.283519:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788391068.283689:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094040064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 235us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.283725:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00080000:3.0:1788391068.283747:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391068.283920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.284004:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094039936 00000100:00100000:2.0:1788391068.284012:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094039936 00000100:00100000:2.0:1788391068.284072:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788391068.284082:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094039936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391068.284122:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094039936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.284129:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788391068.285614:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788391068.285772:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391068.287021:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040192 00000100:00100000:2.0:1788391068.287100:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040192 00010000:00010000:2.0:1788391068.287146:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.287191:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788391068.287201:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+9:2357:x1875263094040192:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391068.287216:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788391068.287245:0:40545:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788391068.287248:0:40545:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788391068 00002000:00010000:2.0:1788391068.287251:0:40545:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1788391068 00002000:00010000:2.0:1788391068.287253:0:40545:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 0 -> 1788391068 00010000:00010000:2.0:1788391068.287258:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.287290:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.287312:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35acd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff964 expref: 9 pid: 39118 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.287329:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391068.287334:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391068.287339:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.287348:0:40545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.287379:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391068.287437:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094040192:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 237us (1832us total) trans 0 rc 0/0 00010000:00010000:1.0:1788391068.287441:0:39121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.287449:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:1.0:1788391068.287467:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.287517:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.287526:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.288279:0:39121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.288295:0:39121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391068.288301:0:39121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.288312:0:39121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.288332:0:39121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.288862:0:39121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35b13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391068.288997:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094039424:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 15304us (15906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.289008:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391068.291223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391068.291460:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040448 00000100:00100000:1.0:1788391068.291472:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040448 00000100:00100000:1.0:1788391068.291581:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788391068.291593:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+18:29056:x1875263094040448:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1788391068.291675:0:38438:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b11:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff979 expref: 18 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391068.292324:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803783 00000001:00080000:1.0:1788391068.292367:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803784 00000001:00080000:1.0:1788391068.294077:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803785 00010000:00010000:1.0:1788391068.294181:0:38438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.294207:0:38438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 22 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.294217:0:38438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.294268:0:38438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 22 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.294300:0:38438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 22 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391068.294320:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103419008:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391068.294503:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63480 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.297122:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.297456:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040576 00000100:00100000:2.0:1788391068.297468:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040576 00010000:00010000:2.0:1788391068.297525:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 5/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 23 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.297577:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788391068.297589:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+23:2357:x1875263094040576:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391068.297620:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391068.297627:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 5/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 23 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.297649:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 23 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.297680:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788391068.297686:0:38421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.297692:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd35b0c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff980 expref: 23 pid: 38436 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.297697:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391068.297711:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103419008:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391068.297759:0:38421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.297775:0:38438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.297782:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391068.297893:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+22:2357:x1875263094040576:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 305us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.297901:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:1.0:1788391068.298254:0:38438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.298261:0:38438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391068.298424:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803786 00000001:00080000:1.0:1788391068.298689:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803787 00000100:00100000:1.0:1788391068.298829:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103419136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788391068.298895:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391068.299200:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.299236:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419136 00000100:00100000:0.0:1788391068.299242:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419136 00000100:00100000:0.0:1788391068.299296:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391068.299305:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103419136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788391068.299387:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103419136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.299395:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391068.299408:0:38438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:1.0:1788391068.299425:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103419136:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788391068.299470:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788391068.300676:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803788 00000100:00100000:1.0:1788391068.300768:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103419264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788391068.301156:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391068.301195:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d686e63480 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.301265:0:38441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419264 00000100:00100000:0.0:1788391068.301271:0:38441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419264 00000100:00100000:0.0:1788391068.301311:0:38441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391068.301320:0:38441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103419264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788391068.301553:0:38441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38438:x1875263103419264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 233us (396us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788391068.301561:0:38441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391068.301642:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103419264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788391068.301704:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803789 00010000:00010000:1.0:1788391068.301747:0:38438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.301761:0:38438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.301769:0:38438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.301775:0:38438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391068.302091:0:38438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.302101:0:38438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.302120:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:1.0:1788391068.302124:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788391068.302128:0:38438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.302134:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd35b1a lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391068.302577:0:38438:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788391068.304255:0:38438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].2, 64 off8320 00000004:00080000:1.0:1788391068.304286:0:38438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 885411324283ns, next at 886411321682ns, rc = 0 00000001:00080000:1.0:1788391068.304300:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803790 00010000:00010000:1.0:1788391068.304363:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:1.0:1788391068.304366:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391068.304377:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35afe lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff979 expref: 26 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391068.304568:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+25:29056:x1875263094040448:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 12975us (13356us total) trans 25769803791 rc 0/0 00000100:00100000:1.0:1788391068.304580:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000020:00080000:1.0:1788391068.304586:0:38438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788391068.308269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.308392:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040704 00000100:00100000:0.0:1788391068.308405:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040704 00000100:00100000:0.0:1788391068.308462:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391068.308471:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+25:29056:x1875263094040704:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391068.308503:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391068.308532:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff987 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.308618:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 26 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.308650:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 26 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.308675:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391068.308679:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391068.308683:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79be00, rc 0) 00000100:00100000:0.0:1788391068.308754:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+26:29056:x1875263094040704:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 283us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.308762:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391068.310828:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.311277:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094040960 00000100:00100000:2.0:1788391068.311291:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094040960 00000100:00100000:2.0:1788391068.311366:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391068.311377:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+26:29056:x1875263094040960:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391068.312021:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+27:29056:x1875263094040960:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 642us (1202us total) trans 25769803792 rc 0/0 00000100:00100000:2.0:1788391068.312030:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788391068.381141:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.381434:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041216 00000100:00100000:2.0:1788391068.381449:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041216 00000100:00100000:2.0:1788391068.381524:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391068.381534:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+27:29066:x1875263094041216:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391068.381567:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.381590:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff98e expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391068.381719:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788391068.381881:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff98e expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.381898:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:2.0:1788391068.381900:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391068.381906:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff98e expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.381925:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391068.382056:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+28:29066:x1875263094041216:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 523us (931us total) trans 25769803793 rc 301/301 00000100:00100000:2.0:1788391068.382061:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391068.384668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391068.384955:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041344 00000100:00100000:0.0:1788391068.385153:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041344 00000100:00100000:0.0:1788391068.385269:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391068.385290:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+28:29066:x1875263094041344:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391068.385386:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385406:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385420:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385439:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385446:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385452:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385576:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385585:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385592:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391068.385677:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385694:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385701:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385720:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385727:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.385732:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385740:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385755:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391068.385758:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.385764:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385770:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35b36 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385786:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385793:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385805:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385811:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.385814:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385821:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385830:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391068.385832:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.385835:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385840:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35b3d lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385855:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385861:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385867:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385872:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391068.385875:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385891:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385898:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391068.385901:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391068.385904:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.385910:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35b44 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391068.386037:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+28:29066:x1875263094041344:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 748us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.386046:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391068.390298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391068.390412:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041600 00000100:00100000:1.0:1788391068.390428:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041600 00000100:00100000:1.0:1788391068.390547:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391068.390562:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+28:29066:x1875263094041600:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391068.390893:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+29:29066:x1875263094041600:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 333us (610us total) trans 25769803794 rc 0/0 00000100:00100000:1.0:1788391068.390901:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391068.405837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.406060:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041728 00000100:00100000:3.0:1788391068.406073:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041728 00000100:00100000:3.0:1788391068.406146:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788391068.406159:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6922bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+11:28433:x1875263094041728:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391068.406181:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.406205:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd35b4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff995 expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.406240:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd35b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff995 expref: 12 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.406253:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd35b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff995 expref: 12 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.406265:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:3.0:1788391068.406346:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6922bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094041728:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 189us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.406354:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788391068.408835:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391068.408912:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041856 00000100:00100000:1.0:1788391068.408924:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041856 00000100:00100000:1.0:1788391068.409126:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788391068.409137:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094041856:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788391068.409613:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a69f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094041856:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 469us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.409622:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391068.413314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.413658:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094041984 00000100:00100000:2.0:1788391068.413672:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094041984 00000100:00100000:2.0:1788391068.413745:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1788391068.413759:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094041984:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.414171:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094041984:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 415us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.414192:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1788391068.419641:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391068.420708:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042112 00000100:00100000:1.0:1788391068.420725:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042112 00000100:00100000:1.0:1788391068.420808:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1788391068.420819:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+12:28433:x1875263094042112:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391068.420842:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391068.420866:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4df6c00/0x9aafc5f04cd35b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff99c expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.420904:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df6c00/0x9aafc5f04cd35b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff99c expref: 13 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.420916:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4df6c00/0x9aafc5f04cd35b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff99c expref: 13 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.420927:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6c00, rc 0) 00000100:00100000:1.0:1788391068.421036:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28433:x1875263094042112:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 218us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.421044:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788391068.425352:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.425600:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042240 00000100:00100000:2.0:1788391068.425613:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042240 00000100:00100000:2.0:1788391068.425694:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788391068.425708:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28433:x1875263094042240:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.427239:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6876d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28433:x1875263094042240:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 1522us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391068.427253:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000040:00080000:3.0:1788391068.429811:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788391068.430046:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391068.430202:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042368 00000100:00100000:3.0:1788391068.430214:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042368 00000100:00100000:3.0:1788391068.430275:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:3.0:1788391068.430287:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28433:x1875263094042368:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.430548:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:28433:x1875263094042368:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 262us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.430558:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1788391068.639827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391068.640382:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042624 00000100:00100000:2.0:1788391068.640396:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042624 00000100:00100000:2.0:1788391068.640520:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788391068.640533:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+29:29084:x1875263094042624:12345-192.168.202.1@tcp:101:multiop.0 00010000:00010000:2.0:1788391068.640565:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391068.640569:0:39647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788391068.640609:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35adb lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff96b expref: 29 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.640731:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.640739:0:39647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391068.640758:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd35b59 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9a3 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.640949:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641048:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641059:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641077:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641085:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641092:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641172:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641181:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641189:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391068.641200:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:2.0:1788391068.641326:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641335:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641343:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641355:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.641359:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641367:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641375:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391068.641378:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.641381:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641387:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35b60 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641397:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641403:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641408:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641413:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391068.641415:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641421:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641438:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d68641e400) 00010000:00010000:2.0:1788391068.641440:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391068.641443:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641449:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35b67 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641523:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd35b59 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 31 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641537:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 30 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.641546:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391068.641548:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391068.641551:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391068.641640:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+30:29084:x1875263094042624:12345-192.168.202.1@tcp:101:multiop.0 Request processed in 1099us (1819us total) trans 25769803795 rc 0/0 00000100:00100000:2.0:1788391068.641650:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 10000000:01000000:2.0:1788391068.877263:0:38432:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788391068.877340:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d58716d800 from 10 10000000:01000000:2.0:1788391068.877347:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788391068.877420:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.877434:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.877471:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.877504:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.877689:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391068.877773:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.878654:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419392 00000100:00100000:0.0:1788391068.878670:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419392 00000100:00100000:0.0:1788391068.878740:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788391068.878751:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+16:38432:x1875263103419392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788391068.878768:0:38430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391068.878789:0:38430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd35b83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35b7c expref: -99 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.878819:0:38430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd35b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b7c expref: 17 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.878830:0:38430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd35b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b7c expref: 17 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391068.878854:0:38430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a200, rc 0) 00000100:00100000:0.0:1788391068.878927:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391068.878934:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788391068.880044:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391068.880075:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.880088:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.880194:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.880257:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391068.880311:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788391068.880522:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419520 00000100:00100000:1.0:1788391068.880530:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419520 00000100:00100000:1.0:1788391068.880586:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788391068.880598:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788391068.881031:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.881041:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788391068.881682:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.881730:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.881784:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391068.881821:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788391068.881878:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419648 00000100:00100000:0.0:1788391068.881892:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419648 00000100:00100000:3.0:1788391068.881997:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788391068.882009:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.882213:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.882221:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788391068.882354:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788391068.883543:0:40558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788391068.883887:0:38432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788391068.883908:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788391068.883918:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.883929:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391068.883940:0:38432:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788391068.883943:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bbee1000 from 10 10000000:01000000:3.0:1788391068.883945:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788391068.884330:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.884339:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.884370:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.884395:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.884675:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391068.884723:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788391068.884856:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419776 00000100:00100000:1.0:1788391068.884864:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419776 00000100:00100000:1.0:1788391068.885039:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788391068.885049:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+17:38432:x1875263103419776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391068.885062:0:38428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391068.885073:0:38428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4df7600/0x9aafc5f04cd35b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35b8a expref: -99 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.885092:0:38428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df7600/0x9aafc5f04cd35b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b8a expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.885099:0:38428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4df7600/0x9aafc5f04cd35b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b8a expref: 18 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391068.885105:0:38428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7600, rc 0) 00000100:00100000:1.0:1788391068.885143:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103419776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391068.885148:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788391068.885199:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391068.885210:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.885221:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391068.885268:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.885296:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391068.885551:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.885625:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103419904 00000100:00100000:3.0:1788391068.885637:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103419904 00000100:00100000:3.0:1788391068.885659:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788391068.885665:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103419904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.885916:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103419904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.885922:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788391068.886005:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103419904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.886031:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391068.886063:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391068.886077:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.886116:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420032 00000100:00100000:3.0:1788391068.886120:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420032 00000100:00100000:3.0:1788391068.886134:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788391068.886139:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103420032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.886272:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103420032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.886278:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788391068.886349:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788391068.887240:0:40559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788391068.887552:0:38432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788391068.887575:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788391068.887585:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887597:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391068.887619:0:38432:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788391068.887622:0:38432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d68f07f000 from 10 10000000:01000000:3.0:1788391068.887624:0:38432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788391068.887663:0:38432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887671:0:38432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887680:0:38432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.887697:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.887746:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391068.887777:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.887793:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420160 00000100:00100000:3.0:1788391068.887798:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420160 00000100:00100000:3.0:1788391068.887822:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788391068.887830:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+18:38432:x1875263103420160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391068.887841:0:38427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391068.887851:0:38427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35b9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd35b98 expref: -99 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887873:0:38427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b98 expref: 19 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887882:0:38427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd35b98 expref: 19 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.887902:0:38427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc600, rc 0) 00000100:00100000:3.0:1788391068.887935:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103420160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.887941:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788391068.887993:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391068.888007:0:38432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391068.888015:0:38432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391068.888055:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.888079:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391068.888090:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.888100:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420288 00000100:00100000:3.0:1788391068.888103:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420288 00000100:00100000:3.0:1788391068.888118:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788391068.888123:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103420288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.888315:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103420288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.888323:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788391068.888349:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.888372:0:38432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.888404:0:38432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391068.888423:0:38432:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391068.888433:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420416 00000100:00100000:3.0:1788391068.888437:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420416 00000100:00100000:3.0:1788391068.888529:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788391068.888536:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103420416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391068.888664:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:38432:x1875263103420416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391068.888671:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788391068.888703:0:38432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f33d137e-f79f-4925-8ad8-5351efff92b3:38432:1875263103420416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788391068.889580:0:40560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788391068.889702:0:38432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788391068.889714:0:38432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788391068.889721:0:38432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391068.889729:0:38432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391069.133245:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391069.454096:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788391070.157149:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788391071.181169:0:38460:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 888288205344ns, next at 889288202142ns, rc = 0 00000100:00100000:0.0:1788391071.181190:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103420672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391071.181201:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103420928:0@lo:400:kworker.0 00000100:00100000:2.0:1788391071.181213:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103420800:0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.181762:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103420544:0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.182953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391071.183042:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420928 00000100:00100000:3.0:1788391071.183049:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420928 00000100:00100000:3.0:1788391071.183100:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788391071.183110:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103420928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.183163:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103420928:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391071.183170:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788391071.183188:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391071.183218:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103420928:0@lo:400:kworker.0 00000100:00100000:2.0:1788391071.183566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391071.183583:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391071.183602:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420800 00000100:00100000:2.0:1788391071.183603:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103421312:0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.183618:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420800 00000100:00100000:2.0:1788391071.183651:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391071.183664:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391071.183674:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103420800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391071.183700:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103421312 00000100:00100000:2.0:1788391071.183705:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103421312 00000100:00100000:3.0:1788391071.183718:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103420800:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391071.183726:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788391071.183745:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391071.183745:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788391071.183751:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391071.183758:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103421312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.183781:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103420800:0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.183799:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103421312:0@lo:400:kworker.0 00000100:00100000:2.0:1788391071.183801:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103421312:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391071.183811:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788391071.184876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391071.185088:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391071.185124:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103421056:0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.185155:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391071.185188:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420544 00000100:00100000:1.0:1788391071.185195:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420544 00000100:00100000:1.0:1788391071.185538:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788391071.185548:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3289:x1875263103420544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.185594:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3289:x1875263103420544:12345-0@lo:400:kworker.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391071.185601:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788391071.185653:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103421056 00000100:00100000:1.0:1788391071.185657:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103421056 00000100:00100000:1.0:1788391071.185682:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788391071.185689:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103421056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.185720:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103421056:12345-0@lo:400:kworker.0 Request processed in 32us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391071.185727:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788391071.185758:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f33d137e-f79f-4925-8ad8-5351efff92b3:3289:1875263103420544:0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.185770:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103421056:0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.186321:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103421184:0@lo:400:kworker.0 00000100:00100000:1.0:1788391071.186354:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391071.186394:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103420672 00000100:00100000:1.0:1788391071.186398:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103420672 00000100:00100000:1.0:1788391071.186427:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788391071.186434:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103420672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391071.186458:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788391071.186497:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103420672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391071.186504:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788391071.186540:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103420672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391071.186948:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103421184 00000100:00100000:3.0:1788391071.186985:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103421184 00000100:00100000:3.0:1788391071.187021:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788391071.187029:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103421184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391071.187074:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103421184:12345-0@lo:400:kworker.0 Request processed in 46us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391071.187081:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788391071.187101:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391071.188531:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103421184:0@lo:400:kworker.0 00000001:00080000:1.0:1788391071.209633:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803779 is committed 00000001:00080000:1.0:1788391071.209650:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803778 is committed 00000001:00080000:2.0:1788391071.223525:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803779 is committed 00000001:00080000:2.0:1788391071.223542:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803794 is committed 00000004:00080000:2.0:1788391071.223548:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788391071.223574:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d69193a480 refcount 2 committed 0 result 0 batchid 21474836516 00000020:00080000:2.0:1788391071.223578:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4ef2000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d69193a840 00000020:00080000:2.0:1788391071.223581:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b4ef2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585b42000 00000001:00080000:2.0:1788391071.223622:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803795 is committed 00000004:00080000:2.0:1788391071.223648:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788391071.223704:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836516 committed batchid 17179869275 00000100:00100000:2.0:1788391071.223832:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103421440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788391071.223903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788391071.223955:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000100:00100000:3.0:1788391071.224016:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103421440 00000100:00100000:3.0:1788391071.224033:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103421440 00000100:00100000:3.0:1788391071.224092:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788391071.224102:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103421440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788391071.224126:0:39120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:162 count 1 00002000:00010000:3.0:1788391071.224157:0:39120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6a98ae9c, atime: 0x6a98ae9c, ctime: 0x6a98ae9c, blocks: 0xb 00010000:00010000:3.0:1788391071.224165:0:39120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.224181:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=888s v=(0 0) 00010000:00010000:3.0:1788391071.224200:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391071.224206:0:39120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.224222:0:39120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.224233:0:39120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.224241:0:39120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.224265:0:39120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391071.224328:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391071.224336:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.224345:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391071.224350:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.224359:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.224379:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.224399:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe5c9af/0x9aafc5f04cd35ba6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.224423:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391071.224426:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391071.224429:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391071.224786:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103421440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 684us (882us total) trans 25769803780 rc 0/0 00000100:00100000:3.0:1788391071.224794:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788391071.224858:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803779 gen 2 00000004:00080000:2.0:1788391071.224863:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803779 committed transno 25769803779 00000100:00100000:2.0:1788391071.224886:0:3288:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d69111a300 x1875263103421440/t25769803780(25769803780) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391087 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788391071.224897:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69111a300/2, rc 0, transno 25769803780 00000100:00100000:2.0:1788391071.224902:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103421440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788391071.564485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391071.564646:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042752 00000100:00100000:1.0:1788391071.564655:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042752 00000100:00100000:1.0:1788391071.564762:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788391071.564775:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:26800:x1875263094042752:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391071.564798:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391071.564818:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd35bad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9aa expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788391071.564837:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788391071.564883:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.564898:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.564911:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391071.564951:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391071.564956:0:38436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391071.565023:0:38436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.565049:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd35bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 7 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.565068:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 6 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.565079:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391071.565082:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391071.565087:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6e00, rc 0) 00000100:00100000:1.0:1788391071.565152:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:26800:x1875263094042752:12345-192.168.202.1@tcp:101:bash.0 Request processed in 379us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391071.565167:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391071.567540:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.567723:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094042880 00000100:00100000:2.0:1788391071.567733:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094042880 00000100:00100000:2.0:1788391071.567791:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788391071.567803:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+6:26800:x1875263094042880:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391071.567836:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391071.567856:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9b1 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.567918:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.567932:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.567943:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568070:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568078:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568085:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568454:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568464:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568471:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391071.568495:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391071.568516:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391071.568538:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568549:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568557:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568563:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568569:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391071.568574:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568581:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568593:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:2.0:1788391071.568596:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391071.568713:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568721:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568734:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568741:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568757:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568762:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391071.568765:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568771:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568778:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff95d68641e900) 00010000:00010000:2.0:1788391071.568780:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391071.568783:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568788:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35bc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568817:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b1 expref: 8 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568830:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b1 expref: 7 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.568836:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391071.568838:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391071.568840:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788391071.568949:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+7:26800:x1875263094042880:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1148us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391071.568991:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788391071.573411:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391071.573506:0:38445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094043008 00000100:00100000:3.0:1788391071.573515:0:38445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094043008 00000100:00100000:3.0:1788391071.573566:0:38445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788391071.573576:0:38445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:14847363-0daa-48dd-bf83-08d2101df15c+7:26800:x1875263094043008:12345-192.168.202.1@tcp:700:bash.0 00000100:00100000:3.0:1788391071.573671:0:38445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:14847363-0daa-48dd-bf83-08d2101df15c+7:26800:x1875263094043008:12345-192.168.202.1@tcp:700:bash.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391071.573679:0:38445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788391071.578140:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.578224:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094043264 00000100:00100000:2.0:1788391071.578234:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094043264 00000100:00100000:2.0:1788391071.578297:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391071.578307:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+7:26800:x1875263094043264:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391071.578328:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391071.578347:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35bd7 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9b8 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578687:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578702:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578724:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578739:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578746:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578752:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578927:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35bec lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578947:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35bec lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.578954:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35bec lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391071.579011:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:2.0:1788391071.579133:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579141:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579147:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579153:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391071.579157:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579164:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579175:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391071.579179:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391071.579183:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579188:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35bde lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579198:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579210:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579217:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579222:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391071.579225:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579231:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579238:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d68641ea00) 00010000:00010000:2.0:1788391071.579241:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391071.579244:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579249:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35be5 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579291:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35bd7 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b8 expref: 10 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579303:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35bec lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b8 expref: 9 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.579310:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391071.579312:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391071.579320:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391071.579389:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094043264:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1082us (1258us total) trans 25769803796 rc 0/0 00000100:00100000:2.0:1788391071.579398:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788391071.582083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391071.582164:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094043520 00000100:00100000:3.0:1788391071.582182:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094043520 00000100:00100000:3.0:1788391071.582369:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788391071.582382:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094043520:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1788391071.582449:0:39647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391071.582483:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35bec lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b8 expref: 9 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.582507:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391071.582522:0:39647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391071.582818:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.582837:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 10 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.582847:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.582887:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 10 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.582903:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 10 pid: 39647 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391071.582921:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103421568:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391071.583132:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788391071.585774:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391071.585903:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094043648 00000100:00100000:0.0:1788391071.585919:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094043648 00000100:00100000:3.0:1788391071.585936:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103421568:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391071.586015:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586094:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 11 pid: 39647 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391071.586144:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788391071.586155:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+11:2356:x1875263094043648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391071.586172:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391071.586179:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 11 pid: 39647 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586193:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 11 pid: 39647 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586220:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35b6e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9a3 expref: 11 pid: 39647 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586254:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391071.586258:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586267:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586275:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.586301:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391071.586365:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+10:2356:x1875263094043648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391071.586373:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:3.0:1788391071.587806:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.587817:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391071.588026:0:39647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803797 00000004:00010000:3.0:1788391071.588134:0:39647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e00386e6 reply state 00000000f92657e6 transno 25769803798 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391071.588144:0:39647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391071.588323:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094043520:12345-192.168.202.1@tcp:36:bash.0 Request processed in 5941us (6244us total) trans 25769803798 rc 0/0 00000100:00100000:3.0:1788391071.588332:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000020:00080000:3.0:1788391071.588338:0:39647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788391071.589398:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391071.591569:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391071.591805:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094043776 00000100:00100000:3.0:1788391071.591822:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094043776 00010000:00010000:1.0:1788391071.591859:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.591873:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.591882:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.591889:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391071.591894:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.591903:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391071.591913:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00010000:00010000:1.0:1788391071.591928:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00000100:00100000:3.0:1788391071.591929:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094043776:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391071.591940:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391071.591947:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391071.591953:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd35bfa lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.591997:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391071.592036:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd35c01 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9bf expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.592114:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd35c01 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9bf expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.592130:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd35c01 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9bf expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.592183:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391071.592187:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391071.592190:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1a00, rc 0) 00000100:00100000:3.0:1788391071.592277:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094043776:12345-192.168.202.1@tcp:101:bash.0 Request processed in 352us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391071.592284:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788391071.594767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.594859:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044032 00000100:00100000:2.0:1788391071.594870:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044032 00000100:00100000:2.0:1788391071.594941:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391071.594952:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094044032:12345-192.168.202.1@tcp:103:bash.0 00010000:00010000:2.0:1788391071.595008:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391071.595036:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1a00/0x9aafc5f04cd35c01 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9bf expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.595056:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391071.595061:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391071.595120:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:26800:x1875263094044032:12345-192.168.202.1@tcp:103:bash.0 Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391071.595129:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391071.597243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.597309:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044160 00000100:00100000:2.0:1788391071.597323:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044160 00000100:00100000:3.0:1788391071.597430:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788391071.597449:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+10:26800:x1875263094044160:12345-192.168.202.1@tcp:58:bash.0 00010000:00010000:3.0:1788391071.597612:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.597641:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 9 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.597651:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.597786:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 9 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391071.597801:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 9 pid: 38435 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391071.597824:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103421696:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391071.597929:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228540 going to sleep for 11 seconds 00000100:00100000:3.0:1788391071.602254:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.602332:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103421696:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391071.602363:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391071.602436:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044288 00000100:00100000:0.0:1788391071.602447:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044288 00010000:00010000:0.0:1788391071.602514:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 10 pid: 38435 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391071.602560:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391071.602571:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+10:2356:x1875263094044288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391071.602589:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391071.602596:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 10 pid: 38435 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602640:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 10 pid: 38435 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602678:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35b21 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff987 expref: 10 pid: 38435 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602696:0:40545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391071.602702:0:40545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602768:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602777:0:40545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391071.602810:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391071.602837:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.602868:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391071.603030:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+9:2356:x1875263094044288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 455us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391071.603039:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000040:00080000:2.0:1788391071.604504:0:39647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391071.604913:0:39647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 64 off8576 00000040:00080000:2.0:1788391071.605013:0:39647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].1, 136 off8328 00000100:00100000:2.0:1788391071.605223:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+10:26800:x1875263094044160:12345-192.168.202.1@tcp:58:bash.0 Request processed in 7775us (7991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391071.605235:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788391071.610485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391071.611316:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044416 00000100:00100000:2.0:1788391071.611332:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044416 00000100:00100000:2.0:1788391071.611415:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391071.611429:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+10:26800:x1875263094044416:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391071.611456:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391071.611482:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9c6 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611575:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 2/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611587:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 4/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611621:0:38437:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611637:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611689:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391071.611692:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391071.611696:0:38437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 11 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391071.611704:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ee00, rc 0) 00000100:00100000:2.0:1788391071.611785:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094044416:12345-192.168.202.1@tcp:101:bash.0 Request processed in 359us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391071.611793:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00010000:00010000:3.0:1788391072.205253:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391072.525215:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788391072.525224:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391072.525258:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:3.0:1788391072.525265:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1788391072.525385:0:38470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:38470:1875263103421824:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391072.525480:0:38470:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6922283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391072.529043:0:38470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:38470:1875263103421824:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391072.532054:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.532175:0:38446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044544 00000100:00100000:2.0:1788391072.532185:0:38446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044544 00000100:00100000:2.0:1788391072.532238:0:38446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391072.532249:0:38446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044544:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788391072.532329:0:38446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044544:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.532336:0:38446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788391072.544019:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.545656:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044672 00000100:00100000:2.0:1788391072.545670:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044672 00000100:00100000:2.0:1788391072.545745:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1788391072.545756:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044672:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391072.545790:0:38435:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391072.545927:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044672:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 173us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.545936:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788391072.556266:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.557224:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094044800 00000100:00100000:2.0:1788391072.557234:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094044800 00000100:00100000:2.0:1788391072.557301:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1788391072.557311:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044800:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.557383:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557648:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557716:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557735:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557743:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557750:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557774:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557782:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.557788:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391072.557825:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788391072.558000:0:38437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391072.558014:0:38437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558026:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558032:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558039:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558044:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.558049:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558056:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558068:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:2.0:1788391072.558071:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.558075:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558082:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35c16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558094:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558100:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558117:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558121:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.558124:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558129:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558136:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb72e0cac (ffff95d68641ea00) 00010000:00010000:2.0:1788391072.558138:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.558141:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558145:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35c1d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558158:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558163:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558169:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558173:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.558176:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558187:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558194:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.558196:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.558199:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.558204:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35c24 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.558325:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094044800:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1014us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.558334:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788391072.560859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.561697:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094045056 00000100:00100000:2.0:1788391072.561708:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094045056 00000100:00100000:2.0:1788391072.561819:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788391072.561830:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+9:29107:x1875263094045056:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.561848:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.561866:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9cd expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562483:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562509:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562521:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391072.562546:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788391072.562828:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562837:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562843:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562848:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.562852:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562858:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562871:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.562873:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391072.562878:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562883:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c32 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562925:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c2b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9cd expref: 11 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562935:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:2.0:1788391072.562937:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391072.562948:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9cd expref: 11 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.562958:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f400, rc 0) 00000100:00100000:2.0:1788391072.563054:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+10:29107:x1875263094045056:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1224us (2203us total) trans 25769803799 rc 301/301 00000100:00100000:2.0:1788391072.563061:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788391072.569129:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.569323:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094045184 00000100:00100000:1.0:1788391072.569334:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094045184 00000100:00100000:1.0:1788391072.569392:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788391072.569412:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+10:29107:x1875263094045184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788391072.569466:0:38436:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788391072.569586:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+10:29107:x1875263094045184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 176us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391072.569604:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788391072.573691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.573889:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094045440 00000100:00100000:0.0:1788391072.573900:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094045440 00000100:00100000:0.0:1788391072.573989:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391072.574001:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+10:29107:x1875263094045440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391072.574022:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391072.574052:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c40 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9d4 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391072.574625:0:38435:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x83:0x0], count =31 00000004:00080000:0.0:1788391072.574630:0:38435:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x83:0x0]+31 in llog 00000004:00080000:0.0:1788391072.574659:0:38435:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa2:0x0], index 0: 0 00010000:00010000:0.0:1788391072.574862:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35c47 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.574876:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35c47 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.574886:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35c47 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.574936:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c40 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9d4 expref: 13 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.574948:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35c47 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9d4 expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.574955:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59200) 00010000:00010000:0.0:1788391072.574957:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391072.574994:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788391072.575042:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094045440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1045us (1361us total) trans 25769803800 rc 0/0 00000100:00100000:0.0:1788391072.575047:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1788391072.578662:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.579319:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094045696 00000100:00100000:1.0:1788391072.579331:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094045696 00000100:00100000:1.0:1788391072.579385:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788391072.579637:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094045696:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391072.579698:0:38436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391072.579761:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35c47 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9d4 expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579779:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59200) 00010000:00010000:1.0:1788391072.579791:0:38436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391072.579816:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579830:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579840:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579854:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579862:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.579885:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580182:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580188:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580192:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580196:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391072.580199:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580204:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580210:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:1.0:1788391072.580211:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391072.580214:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580217:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c55 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580223:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580227:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580234:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580238:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391072.580239:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580242:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580246:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0xfed8473b (ffff95d692d30500) 00010000:00010000:1.0:1788391072.580248:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391072.580249:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.580252:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd35c5c lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xfed8473b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.580361:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+11:29107:x1875263094045696:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 967us (1708us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788391072.580366:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788391072.583933:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.584171:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094045824 00000100:00100000:0.0:1788391072.584181:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094045824 00000100:00100000:0.0:1788391072.584247:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788391072.584258:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+11:29107:x1875263094045824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391072.584291:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391072.584314:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c63 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9db expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584356:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584367:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584376:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584471:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c63 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 13 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584491:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.584500:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391072.584503:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391072.584507:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788391072.584570:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094045824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 314us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391072.584578:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1788391072.588365:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.588731:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046080 00000100:00100000:2.0:1788391072.588740:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046080 00000100:00100000:2.0:1788391072.588783:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:2.0:1788391072.588790:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094046080:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.588860:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.588877:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.588889:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391072.589207:0:38437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].2, 88 off8344 00000004:00080000:2.0:1788391072.589214:0:38437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 889696252821ns, next at 890696251391ns, rc = 0 00000004:00010000:2.0:1788391072.589913:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc5a61e8 reply state 000000001ecafb5b transno 25769803801 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.589921:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391072.590022:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+14:29107:x1875263094046080:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1231us (1667us total) trans 25769803801 rc 0/0 00000100:00100000:2.0:1788391072.590028:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788391072.592102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.592385:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046208 00000100:00100000:2.0:1788391072.592401:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046208 00000100:00100000:2.0:1788391072.592479:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1788391072.592486:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+14:29107:x1875263094046208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.592513:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.592527:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9e2 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.592575:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 15 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.592589:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 15 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.592618:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:2.0:1788391072.592621:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391072.592625:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ec00, rc 0) 00000100:00100000:2.0:1788391072.592682:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094046208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 196us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.592687:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00010000:00010000:0.0:1788391072.592709:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.592719:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.592738:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.592744:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391072.592748:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.592757:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.594717:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391072.594725:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788391072.594732:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.594741:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35c71 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.595009:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.595100:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046336 00000100:00100000:0.0:1788391072.595109:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046336 00000100:00100000:0.0:1788391072.595168:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788391072.595179:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+5:2357:x1875263094046336:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788391072.595219:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391072.595565:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094046336:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 387us (557us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1788391072.595574:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391072.597691:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.597748:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046592 00000100:00100000:2.0:1788391072.597757:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046592 00000100:00100000:2.0:1788391072.597799:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391072.597806:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+14:29107:x1875263094046592:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391072.600433:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094046592:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 2580us (2703us total) trans 25769803802 rc 0/0 00000100:00100000:2.0:1788391072.600445:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788391072.603288:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.603347:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046848 00000100:00100000:1.0:1788391072.603357:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046848 00000100:00100000:1.0:1788391072.606054:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1788391072.606077:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094046848:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391072.606202:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094046848:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 136us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391072.606224:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788391072.612294:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.612508:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094046976 00000100:00100000:0.0:1788391072.612517:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094046976 00000100:00100000:0.0:1788391072.612576:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788391072.612586:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094046976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391072.612642:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391072.612663:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c7f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9e9 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612723:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612733:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612741:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391072.612768:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391072.612780:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612798:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35c7f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e9 expref: 17 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612810:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e9 expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.612816:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391072.612818:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788391072.612820:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391072.612879:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+16:29107:x1875263094046976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 294us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391072.612886:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788391072.616345:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.616833:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047104 00000100:00100000:2.0:1788391072.616844:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047104 00000100:00100000:2.0:1788391072.616904:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788391072.616912:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+6:2359:x1875263094047104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.616927:0:39225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.616944:0:39225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9f0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391072.616992:0:39225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aea0, blocks: 0x1 00010000:00010000:2.0:1788391072.617011:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=889s v=(0 0) 00010000:00010000:2.0:1788391072.617014:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.617021:0:39225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 7 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.617034:0:39225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 7 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.617044:0:39225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788391072.617090:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+7:2359:x1875263094047104:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 180us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.617095:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391072.619576:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.619670:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047360 00000100:00100000:2.0:1788391072.619681:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047360 00000100:00100000:2.0:1788391072.619754:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1788391072.619769:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+16:29107:x1875263094047360:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788391072.619876:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+16:29107:x1875263094047360:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.619901:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788391072.622867:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.624766:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047488 00000100:00100000:2.0:1788391072.624778:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047488 00000100:00100000:2.0:1788391072.624889:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788391072.624899:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+7:29107:x1875263094047488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.624915:0:39121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.624931:0:39121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9f7 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.624957:0:39121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.624978:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.624982:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.624986:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.625017:0:39121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.625027:0:39121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.625039:0:39121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:39121:1875263103421952:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391072.625127:0:39121:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391072.627271:0:39121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:39121:1875263103421952:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391072.627306:0:39121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.627326:0:39121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391072.627382:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+8:29107:x1875263094047488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2485us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.627392:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391072.627939:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.628069:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047616 00000100:00100000:2.0:1788391072.628076:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047616 00010000:00010000:2.0:1788391072.628110:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.628195:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391072.628206:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+8:2356:x1875263094047616:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391072.628221:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391072.628256:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.628273:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.628296:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e13b8a1/0x9aafc5f04cd35c8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f0 expref: 8 pid: 39225 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.628309:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.628325:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.628334:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.628344:0:38421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.628375:0:38421:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.628389:0:38421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:38421:1875263103422080:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391072.628466:0:38421:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391072.634046:0:38421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:38421:1875263103422080:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391072.634071:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391072.634245:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094047616:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6038us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.634256:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788391072.635368:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.635754:0:39126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047744 00000100:00100000:1.0:1788391072.635762:0:39126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047744 00002000:00100000:1.0:1788391072.635799:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff95d6bc7ca300 x1875263094047744/t0(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:688/0 lens 504/0 e 0 to 0 dl 1788391083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.635809:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7ca300 with x1875263094047744 ext(0->8) 00002000:00010000:1.0:1788391072.635815:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7ca300 00000100:00100000:1.0:1788391072.635877:0:39126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391072.635886:0:39126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094047744:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391072.636278:0:39126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27474853-4920-4406-9272-38eff2ad2609+9:2356:x1875263094047744:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 392us (912us total) trans 25769803779 rc 0/0 00000100:00100000:1.0:1788391072.636286:0:39126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:1.0:1788391072.636292:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff95d6bc7ca300 x1875263094047744/t25769803779(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:688/0 lens 504/448 e 0 to 0 dl 1788391083 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.636300:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7ca300 with x1875263094047744 ext(0->8) 00002000:00010000:1.0:1788391072.636303:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7ca300 00000100:00100000:3.0:1788391072.639455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.640560:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094047872 00000100:00100000:0.0:1788391072.640573:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094047872 00000100:00100000:0.0:1788391072.640699:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1788391072.640710:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+16:29107:x1875263094047872:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788391072.667756:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803800 is committed 00000020:00080000:3.0:1788391072.667771:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836516 batchid updated 00000001:00080000:3.0:1788391072.667854:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803802 is committed 00000004:00080000:3.0:1788391072.667871:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788391072.667890:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803796 is committed 00000001:00080000:3.0:1788391072.668003:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803798 is committed 00000100:00100000:2.0:1788391072.668097:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788391072.668308:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391072.668327:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094047872:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 27616us (28876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391072.668338:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000020:00080000:0.0:1788391072.668368:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000020:00080000:0.0:1788391072.668377:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000100:00100000:1.0:1788391072.668674:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103422208 00000100:00100000:1.0:1788391072.668681:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103422208 00000100:00100000:1.0:1788391072.668717:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788391072.668727:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103422208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788391072.668860:0:39120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788391072.668864:0:39120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788391072 00002000:00010000:1.0:1788391072.668866:0:39120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391072.668868:0:39120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788391072 -> 1788391072 00002000:00010000:1.0:1788391072.668877:0:39120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391072.668917:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103422208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (608us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1788391072.668923:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000004:00080000:2.0:1788391072.669014:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68ce00/2, rc 0, transno 25769803780 00000100:00100000:2.0:1788391072.669021:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788391072.669794:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.669840:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048000 00000100:00100000:0.0:1788391072.669844:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048000 00000100:00100000:0.0:1788391072.669874:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788391072.669883:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+9:2356:x1875263094048000:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788391072.687488:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803778 is committed 00000001:00080000:2.0:1788391072.687523:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803780 is committed 00000001:00080000:2.0:1788391072.687530:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803779 is committed 00000100:00100000:3.0:1788391072.687796:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094048000:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 17909us (17998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391072.687808:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788391072.689924:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.690016:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048256 00000100:00100000:1.0:1788391072.690025:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048256 00000100:00100000:1.0:1788391072.690074:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788391072.690081:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094048256:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391072.690124:0:38436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391072.690148:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35c86 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e9 expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.690167:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:1.0:1788391072.690171:0:38436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391072.690199:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.690212:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.690222:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391072.690410:0:38436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0cd96e4 reply state 000000001efb6ac3 transno 25769803803 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.690417:0:38436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391072.690561:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+13:29107:x1875263094048256:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 480us (644us total) trans 25769803803 rc 0/0 00000100:00100000:1.0:1788391072.690575:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00010000:00010000:2.0:1788391072.691372:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691388:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691393:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691397:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.691400:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691405:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691414:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:2.0:1788391072.691415:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.691418:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.691421:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd35c9b lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.692245:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.692297:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048384 00000100:00100000:2.0:1788391072.692303:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048384 00000100:00100000:2.0:1788391072.692339:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788391072.692346:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094048384:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788391072.692529:0:39225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788391072.692532:0:39225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788391072 -> 1788391071 00002000:00010000:2.0:1788391072.692534:0:39225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1788391068 00002000:00010000:2.0:1788391072.692536:0:39225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788391072 -> 1788391071 00002000:00010000:2.0:1788391072.692543:0:39225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788391072.692584:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+7:2357:x1875263094048384:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 239us (345us total) trans 25769803781 rc 0/0 00000100:00100000:2.0:1788391072.692589:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788391072.695142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.695236:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048640 00000100:00100000:2.0:1788391072.695245:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048640 00000100:00100000:2.0:1788391072.695379:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788391072.695390:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+12:29107:x1875263094048640:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.695465:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.695481:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.695490:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.695533:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 12 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.695546:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 12 pid: 38435 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.695560:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103422336:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391072.695647:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391072.697757:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391072.697829:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048768 00000100:00100000:0.0:1788391072.697835:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048768 00010000:00010000:0.0:1788391072.697860:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 13 pid: 38435 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391072.697890:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1788391072.697896:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+13:2357:x1875263094048768:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391072.697905:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391072.697910:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 13 pid: 38435 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.697918:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 13 pid: 38435 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.697944:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391072.697947:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.697953:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.697957:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391072.697991:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391072.698019:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+13:2357:x1875263094048768:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391072.698023:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:2.0:1788391072.698443:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35c6a lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9db expref: 12 pid: 38435 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.698568:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103422336:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391072.698588:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698608:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698614:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698639:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698647:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698654:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698658:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.698661:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698666:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698673:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:2.0:1788391072.698675:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391072.698677:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.698686:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35ca2 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.698757:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+11:29107:x1875263094048640:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3369us (3623us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391072.698762:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1788391072.701102:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.701230:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094048896 00000100:00100000:2.0:1788391072.701236:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094048896 00000100:00100000:2.0:1788391072.701273:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391072.701279:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+7:2357:x1875263094048896:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.701312:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.701325:0:39121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.701331:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.701335:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391072.701338:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.701363:0:39121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.701372:0:39121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 7 pid: 39121 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.701404:0:39121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:39121:1875263103422464:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391072.701512:0:39121:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391072.702896:0:39121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:39121:1875263103422464:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391072.702916:0:39121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.703261:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.703321:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049024 00000100:00100000:1.0:1788391072.703326:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049024 00010000:00010000:1.0:1788391072.703351:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.703376:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788391072.703382:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094049024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391072.703390:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391072.703407:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.703417:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.703433:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f369b2e1/0x9aafc5f04cd35c94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9f7 expref: 8 pid: 39121 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.703451:0:38420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391072.703454:0:38420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391072.703457:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.703463:0:38420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.703501:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391072.703536:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+7:2357:x1875263094049024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 153us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391072.703544:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:3.0:1788391072.703629:0:39121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703638:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703655:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703660:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703665:0:39121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703678:0:39121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391072.703681:0:39121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703686:0:39121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703693:0:39121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.703698:0:39121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000340d67d4/0x9aafc5f04cd35ca9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.703739:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094048896:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 2459us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391072.703747:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1788391072.705568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.705915:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049280 00000100:00100000:2.0:1788391072.705924:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049280 00000100:00100000:2.0:1788391072.706090:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788391072.706100:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+11:29107:x1875263094049280:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391072.706170:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706187:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706198:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706432:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706444:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706461:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706492:0:38437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.706585:0:38437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 12 pid: 39647 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.706608:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103422592:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391072.706689:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391072.709016:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.709061:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103422592:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391072.709085:0:38437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.709148:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049408 00000100:00100000:3.0:1788391072.709155:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049408 00010000:00010000:3.0:1788391072.709188:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 13 pid: 39647 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.709219:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391072.709228:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+13:2356:x1875263094049408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391072.709239:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391072.709262:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 13 pid: 39647 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709273:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 13 pid: 39647 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709293:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35c78 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9e2 expref: 13 pid: 39647 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709308:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:3.0:1788391072.709312:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709321:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709329:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.709356:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391072.709401:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+12:2356:x1875263094049408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391072.709409:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:2.0:1788391072.709498:0:38437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.709513:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391072.709693:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803804 00000001:00080000:2.0:1788391072.709845:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803805 00000001:00080000:2.0:1788391072.709892:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803806 00000100:00100000:2.0:1788391072.710343:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103422720:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391072.710394:0:38437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391072.710450:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299840 going to sleep for 11 seconds 00000100:00100000:3.0:1788391072.711406:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103422720 00000100:00100000:3.0:1788391072.711415:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103422720 00000100:00100000:3.0:1788391072.711565:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391072.711577:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38437:x1875263103422720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788391072.711717:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:38437:x1875263103422720:12345-0@lo:1000:mdt00_002.0 Request processed in 142us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391072.711740:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391072.711786:0:38437:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:2.0:1788391072.711791:0:38437:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc68ce00, transno 25769803780 00000100:00100000:2.0:1788391072.711805:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103422720:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788391072.712280:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803807 00000100:00100000:2.0:1788391072.712345:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103422848:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391072.712382:0:38437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391072.712466:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391072.712613:0:38441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103422848 00000100:00100000:0.0:1788391072.712619:0:38441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103422848 00000100:00100000:0.0:1788391072.712688:0:38441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391072.712697:0:38441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38437:x1875263103422848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391072.712866:0:38441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38437:x1875263103422848:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (483us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1788391072.712873:0:38441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788391072.712928:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103422848:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788391072.712991:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713001:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713009:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713014:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.713019:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713026:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713042:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:2.0:1788391072.713045:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391072.713051:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713056:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35cb7 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713095:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713109:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713115:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713121:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.713124:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713128:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713134:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.713135:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391072.713141:0:38437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 7 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713152:0:38437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 7 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713161:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 7 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.713189:0:38437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 7 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.713200:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103422976:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391072.713270:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391072.716697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.716785:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103422976:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391072.716813:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716823:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0200/0x9aafc5f04cd35c08 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.716826:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049536 00000100:00100000:1.0:1788391072.716833:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049536 00010000:00010000:2.0:1788391072.716855:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716867:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716878:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716887:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.716891:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00010000:00010000:2.0:1788391072.716893:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716900:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.716900:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:26800:x1875263094049536:12345-192.168.202.1@tcp:49:bash.0 00010000:00010000:2.0:1788391072.716906:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.716909:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716915:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716944:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.716947:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.716950:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.716956:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35cbe lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717112:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717119:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717125:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717131:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.717134:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717140:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717149:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.717152:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391072.717155:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.717161:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cb0 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391072.717398:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:26800:x1875263094049536:12345-192.168.202.1@tcp:49:bash.0 Request processed in 496us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391072.717405:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000040:00080000:3.0:1788391072.717510:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788391072.717514:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391072.717535:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:3.0:1788391072.717541:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788391072.717684:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094049280:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 11586us (12123us total) trans 25769803808 rc 0/0 00000100:00100000:2.0:1788391072.717693:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000020:00080000:2.0:1788391072.717696:0:38437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788391072.719586:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.720181:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049792 00000100:00100000:3.0:1788391072.720191:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049792 00000100:00100000:3.0:1788391072.720278:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788391072.720289:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+15:29107:x1875263094049792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788391072.720930:0:38439:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788391072.721050:0:38439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803809 00010000:00010000:3.0:1788391072.721091:0:38439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721105:0:38439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721115:0:38439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721123:0:38439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721129:0:38439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721134:0:38439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.721164:0:38439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391072.721250:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+17:29107:x1875263094049792:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 962us (1669us total) trans 25769803810 rc 0/0 00000100:00100000:3.0:1788391072.721257:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000020:00080000:3.0:1788391072.721262:0:38439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391072.721323:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391072.721329:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.721336:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391072.721340:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.721347:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.721359:0:38423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff95d686a70600) 00010000:00010000:1.0:1788391072.721362:0:38423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391072.721366:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.721372:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd35cc5 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.721399:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391072.721401:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391072.721403:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391072.722628:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.722709:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094049920 00000100:00100000:2.0:1788391072.722716:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094049920 00000100:00100000:2.0:1788391072.722799:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788391072.722809:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+5:26800:x1875263094049920:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391072.722822:0:39225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.722837:0:39225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbff9fe expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391072.722860:0:39225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6a98ae9f, atime: 0x6a98ae9c, ctime: 0x6a98ae9f, blocks: 0xb 00010000:00010000:2.0:1788391072.722877:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=889s v=(0 0) 00010000:00010000:2.0:1788391072.722882:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.722890:0:39225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.722903:0:39225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.722914:0:39225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391072.723004:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:26800:x1875263094049920:12345-192.168.202.1@tcp:101:bash.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.723009:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00080000:1.0:1788391072.723091:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391072.725488:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.725724:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094050048 00000100:00100000:1.0:1788391072.725732:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094050048 00002000:00010000:1.0:1788391072.725769:0:39124:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:1.0:1788391072.725774:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc648e00 with x1875263094050048 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391072.725786:0:39124:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc648e00. 00000100:00100000:1.0:1788391072.725845:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788391072.725854:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+6:2356:x1875263094050048:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:1.0:1788391072.726161:0:39124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788391072.726165:0:39124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788391071 -> 1788391071 00002000:00010000:1.0:1788391072.726167:0:39124:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 1788391068 -> 1788391068 00002000:00010000:1.0:1788391072.726170:0:39124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788391071 -> 1788391071 00002000:00010000:1.0:1788391072.726172:0:39124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788391072.726209:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+7:2356:x1875263094050048:12345-192.168.202.1@tcp:10:bash.0 Request processed in 357us (729us total) trans 25769803783 rc 0/0 00000100:00100000:1.0:1788391072.726214:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00010000:1.0:1788391072.726217:0:39124:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:1.0:1788391072.726219:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc648e00 with x1875263094050048 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391072.726222:0:39124:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc648e00. 00000100:00100000:0.0:1788391072.727775:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.727861:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094050304 00000100:00100000:3.0:1788391072.727868:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094050304 00000100:00100000:3.0:1788391072.727916:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391072.727925:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:26800:x1875263094050304:12345-192.168.202.1@tcp:55:bash.0 00010000:00010000:3.0:1788391072.728009:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728025:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728035:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728212:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728221:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728227:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728234:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391072.728238:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728246:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728264:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391072.728267:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788391072.728271:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.728278:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35cd3 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.728345:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094050304:12345-192.168.202.1@tcp:55:bash.0 Request processed in 420us (575us total) trans 25769803811 rc 0/0 00000100:00100000:3.0:1788391072.728353:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1788391072.731170:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.731245:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094050560 00000100:00100000:2.0:1788391072.731255:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094050560 00000100:00100000:2.0:1788391072.731301:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788391072.731311:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094050560:12345-192.168.202.1@tcp:35:bash.0 00000001:00080000:2.0:1788391072.731565:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803812 00000100:00100000:2.0:1788391072.731696:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+11:26800:x1875263094050560:12345-192.168.202.1@tcp:35:bash.0 Request processed in 385us (533us total) trans 25769803813 rc 0/0 00000100:00100000:2.0:1788391072.731704:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000020:00080000:2.0:1788391072.731709:0:38438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391072.799492:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.799548:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094050816 00000100:00100000:1.0:1788391072.799558:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094050816 00000100:00100000:1.0:1788391072.799622:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788391072.799645:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+17:29117:x1875263094050816:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391072.799668:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391072.799685:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd35cda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa05 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391072.799790:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788391072.799884:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd35cda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa05 expref: 19 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.799898:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391072.799901:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391072.799906:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd35cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa05 expref: 19 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.799920:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:1.0:1788391072.800060:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+18:29117:x1875263094050816:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 417us (574us total) trans 25769803814 rc 301/301 00000100:00100000:1.0:1788391072.800067:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1788391072.803858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.803991:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094050944 00000100:00100000:3.0:1788391072.804000:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094050944 00000100:00100000:3.0:1788391072.804059:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788391072.804070:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+18:29117:x1875263094050944:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788391072.804145:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804163:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804174:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804189:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804195:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804219:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804618:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804629:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804638:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391072.804677:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804688:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804696:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804704:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804710:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391072.804714:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804721:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804732:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:3.0:1788391072.804741:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391072.804747:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804754:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35ce8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804770:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804777:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804784:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804789:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391072.804793:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804799:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804808:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d686a70c00) 00010000:00010000:3.0:1788391072.804811:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391072.804814:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804819:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35cef lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804834:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804845:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804852:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804857:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391072.804860:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804866:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804875:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391072.804877:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391072.804880:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.804886:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35cf6 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.805144:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+18:29117:x1875263094050944:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1073us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391072.805153:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1788391072.807574:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.807642:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051200 00000100:00100000:2.0:1788391072.807652:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051200 00000100:00100000:2.0:1788391072.807710:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391072.807721:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+18:29117:x1875263094051200:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391072.807936:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+19:29117:x1875263094051200:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 217us (371us total) trans 25769803815 rc 0/0 00000100:00100000:2.0:1788391072.807944:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391072.857841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.857931:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051456 00000100:00100000:2.0:1788391072.857939:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051456 00000100:00100000:2.0:1788391072.858007:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788391072.858015:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+19:29124:x1875263094051456:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788391072.858034:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.858049:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cfd lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa0c expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858104:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858127:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858136:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858145:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858149:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858153:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858350:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858355:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858359:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391072.858365:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:2.0:1788391072.858427:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858432:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858436:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858445:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.858449:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858454:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858466:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391072.858469:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.858473:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858478:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d04 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858490:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858496:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858502:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858507:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391072.858510:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858515:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858530:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d68641e200) 00010000:00010000:2.0:1788391072.858532:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391072.858535:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858540:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35d0b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858606:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35cfd lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 22 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858620:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 21 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.858625:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391072.858627:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391072.858628:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391072.858667:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+21:29124:x1875263094051456:12345-192.168.202.1@tcp:101:cat.0 Request processed in 654us (835us total) trans 25769803816 rc 0/0 00000100:00100000:2.0:1788391072.858672:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1788391072.860787:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.860850:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051584 00000100:00100000:3.0:1788391072.860860:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051584 00000100:00100000:3.0:1788391072.860908:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788391072.860918:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094051584:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1788391072.860935:0:39118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391072.861148:0:39118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd35d20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa13 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391072.861207:0:39118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:39118:1875263103423104:192.168.202.1@tcp:106: 00000100:00100000:3.0:1788391072.861294:0:39118:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b64056c0 going to sleep for 11 seconds 00002000:00010000:3.0:1788391072.862492:0:39118:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size: 0 -> 14 00002000:00010000:3.0:1788391072.862507:0:39118:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime: 1788391071 -> 1788391072 00002000:00010000:3.0:1788391072.862510:0:39118:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime: 1788391071 -> 1788391072 00000100:00100000:3.0:1788391072.862528:0:39118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:39118:1875263103423104:192.168.202.1@tcp:106: 00010000:00010000:3.0:1788391072.862552:0:39118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd35d20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa13 expref: 7 pid: 39118 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.862568:0:39118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007555a16b/0x9aafc5f04cd35d20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa13 expref: 7 pid: 39118 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391072.862576:0:39118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1800, rc 0) 00000100:00100000:3.0:1788391072.862624:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094051584:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1707us (1841us total) trans 0 rc 301/301 00000100:00100000:3.0:1788391072.862632:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391072.864217:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.864271:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051712 00000100:00100000:2.0:1788391072.864277:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051712 00000100:00100000:2.0:1788391072.864317:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1788391072.864327:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+6:29124:x1875263094051712:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788391072.864340:0:39225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391072.864353:0:39225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa1a expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.864393:0:39225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.864402:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391072.864406:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391072.864411:0:39225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 4/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.864438:0:39225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.864457:0:39225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 6 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391072.864467:0:39225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:39225:1875263103423232:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391072.864522:0:39225:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391072.866308:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391072.866384:0:39225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:39225:1875263103423232:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391072.866405:0:39225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 3/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391072.866419:0:39225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f800, rc 0) 00000100:00100000:2.0:1788391072.866466:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+7:29124:x1875263094051712:12345-192.168.202.1@tcp:101:cat.0 Request processed in 2140us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391072.866475:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788391072.866675:0:39126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051840 00000100:00100000:1.0:1788391072.866681:0:39126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051840 00002000:00100000:1.0:1788391072.866733:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff95d6bc7cad80 x1875263094051840/t0(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:688/0 lens 504/0 e 0 to 0 dl 1788391083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.866747:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cad80 with x1875263094051840 ext(0->13) 00010000:00010000:1.0:1788391072.866754:0:39126:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 7 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.866779:0:39126:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 7 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391072.866786:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d6bc7cad80 00000100:00100000:1.0:1788391072.866813:0:39126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1788391072.866822:0:39126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14847363-0daa-48dd-bf83-08d2101df15c+7:2357:x1875263094051840:12345-192.168.202.1@tcp:4:bash.0 00000100:00100000:1.0:1788391072.867228:0:39126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14847363-0daa-48dd-bf83-08d2101df15c+9:2357:x1875263094051840:12345-192.168.202.1@tcp:4:bash.0 Request processed in 407us (924us total) trans 25769803784 rc 0/0 00000100:00100000:1.0:1788391072.867236:0:39126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:1.0:1788391072.867243:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff95d6bc7cad80 x1875263094051840/t25769803784(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:688/0 lens 504/448 e 0 to 0 dl 1788391083 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.867252:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cad80 with x1875263094051840 ext(0->13) 00010000:00010000:1.0:1788391072.867258:0:39126:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.867268:0:39126:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391072.867275:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d6bc7cad80 00000100:00100000:0.0:1788391072.869052:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.869117:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094051968 00000100:00100000:1.0:1788391072.869123:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094051968 00010000:00010000:1.0:1788391072.869146:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.869216:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391072.869222:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+9:2356:x1875263094051968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391072.869232:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391072.869245:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.869253:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.869270:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd35ccc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9fe expref: 9 pid: 39225 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.869281:0:38420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391072.869284:0:38420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391072.869289:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.869295:0:38420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391072.869321:0:38420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391072.869330:0:38420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:38420:1875263103423360:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391072.869390:0:38420:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d681370180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391072.871241:0:38420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:38420:1875263103423360:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391072.871264:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391072.871311:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:2356:x1875263094051968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2088us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391072.871321:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788391072.871353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391072.871640:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094052096 00000100:00100000:1.0:1788391072.871646:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094052096 00002000:00100000:1.0:1788391072.871694:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff95d6bc7c9180 x1875263094052096/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:688/0 lens 488/0 e 0 to 0 dl 1788391083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.871705:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9180 with x1875263094052096 ext(0->4095) 00002000:00010000:1.0:1788391072.871711:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7c9180 00000100:00100000:1.0:1788391072.871739:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788391072.871749:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094052096:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:1.0:1788391072.871925:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094052096:12345-192.168.202.1@tcp:3:cat.0 Request processed in 177us (572us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788391072.871932:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:1.0:1788391072.871939:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff95d6bc7c9180 x1875263094052096/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:688/0 lens 488/4536 e 0 to 0 dl 1788391083 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391072.871946:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9180 with x1875263094052096 ext(0->4095) 00002000:00010000:1.0:1788391072.871949:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7c9180 00000100:00100000:0.0:1788391072.874690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.874908:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094052352 00000100:00100000:3.0:1788391072.874916:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094052352 00000100:00100000:2.0:1788391072.875006:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391072.875019:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+21:29124:x1875263094052352:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:2.0:1788391072.875516:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+22:29124:x1875263094052352:12345-192.168.202.1@tcp:35:cat.0 Request processed in 499us (833us total) trans 25769803817 rc 0/0 00000100:00100000:2.0:1788391072.875524:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391072.988855:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391072.988942:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094052608 00000100:00100000:3.0:1788391072.988952:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094052608 00000100:00100000:3.0:1788391072.989032:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391072.989043:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+22:29084:x1875263094052608:12345-192.168.202.1@tcp:35:multiop.0 00000100:00100000:3.0:1788391072.989284:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+23:29084:x1875263094052608:12345-192.168.202.1@tcp:35:multiop.0 Request processed in 241us (438us total) trans 25769803818 rc 0/0 00000100:00100000:3.0:1788391072.989304:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391073.050617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.050737:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094052864 00000100:00100000:2.0:1788391073.050747:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094052864 00000100:00100000:2.0:1788391073.050822:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391073.050833:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+23:29146:x1875263094052864:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788391073.050857:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391073.050877:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d2e lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa21 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.051008:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35d35 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.051021:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35d35 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.051032:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35d35 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391073.051042:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:2.0:1788391073.051154:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d2e lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa21 expref: 26 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.051170:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35d35 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa21 expref: 25 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.051191:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391073.051194:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788391073.051197:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f000, rc 0) 00000100:00100000:2.0:1788391073.051260:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+25:29146:x1875263094052864:12345-192.168.202.1@tcp:101:cat.0 Request processed in 429us (654us total) trans 25769803819 rc 0/0 00000100:00100000:2.0:1788391073.051268:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00080000:1.0:1788391073.051341:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391073.072797:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.073010:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094053120 00000100:00100000:2.0:1788391073.073023:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094053120 00000100:00100000:2.0:1788391073.073371:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1788391073.073380:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+11:29147:x1875263094053120:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788391073.073401:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391073.073418:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d43 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa28 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073510:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073524:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073535:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073549:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073555:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073575:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073809:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073815:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073820:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391073.073828:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:2.0:1788391073.073913:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073919:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073923:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073926:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391073.073929:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073934:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073942:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391073.073944:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391073.073951:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073955:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d4a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073986:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073990:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073994:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.073996:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391073.073998:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074001:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074005:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff95d68641e200) 00010000:00010000:2.0:1788391073.074007:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391073.074008:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074011:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d51 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074041:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d43 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 14 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074058:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 13 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.074063:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391073.074064:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391073.074066:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391073.074123:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+13:29147:x1875263094053120:12345-192.168.202.1@tcp:101:cat.0 Request processed in 745us (1336us total) trans 25769803820 rc 0/0 00000100:00100000:2.0:1788391073.074128:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00080000:1.0:1788391073.075070:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391073.076875:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.076935:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094053248 00000100:00100000:2.0:1788391073.076945:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094053248 00000100:00100000:2.0:1788391073.077021:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788391073.077031:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+8:2356:x1875263094053248:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1788391073.077044:0:39121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391073.077056:0:39121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa2f expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.077076:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788391073.077079:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391073.077085:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 9 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.077098:0:39121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 9 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.077123:0:39121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fe00, rc 0) 00000100:00100000:2.0:1788391073.077167:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+9:2356:x1875263094053248:12345-192.168.202.1@tcp:101:cat.0 Request processed in 137us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391073.077174:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788391073.080059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.080109:0:39125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094053376 00000100:00100000:2.0:1788391073.080119:0:39125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094053376 00002000:00100000:2.0:1788391073.080160:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff95d6bc7c9f80 x1875263094053376/t0(0) o3->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:689/0 lens 488/0 e 0 to 0 dl 1788391084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391073.080170:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9f80 with x1875263094053376 ext(0->4095) 00002000:00010000:2.0:1788391073.080174:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7c9f80 00000100:00100000:2.0:1788391073.080198:0:39125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1788391073.080208:0:39125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14847363-0daa-48dd-bf83-08d2101df15c+9:2357:x1875263094053376:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:2.0:1788391073.080426:0:39125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14847363-0daa-48dd-bf83-08d2101df15c+9:2357:x1875263094053376:12345-192.168.202.1@tcp:3:cat.0 Request processed in 219us (372us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788391073.080434:0:39125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:2.0:1788391073.080441:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff95d6bc7c9f80 x1875263094053376/t0(0) o3->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:689/0 lens 488/4536 e 0 to 0 dl 1788391084 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391073.080449:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9f80 with x1875263094053376 ext(0->4095) 00002000:00010000:2.0:1788391073.080452:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7c9f80 00000100:00100000:0.0:1788391073.083905:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391073.084082:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094053632 00000100:00100000:3.0:1788391073.084091:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094053632 00000100:00100000:3.0:1788391073.084142:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788391073.084153:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+13:29147:x1875263094053632:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:3.0:1788391073.084410:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+14:29147:x1875263094053632:12345-192.168.202.1@tcp:35:cat.0 Request processed in 258us (514us total) trans 25769803821 rc 0/0 00000100:00100000:3.0:1788391073.084416:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391073.090602:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.090777:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094053888 00000100:00100000:2.0:1788391073.090786:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094053888 00000100:00100000:2.0:1788391073.090875:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788391073.090886:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+14:26800:x1875263094053888:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391073.090925:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391073.090945:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d6d lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa36 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091057:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091069:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 24 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091075:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 15 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091080:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 5/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091105:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 15 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091114:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 15 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391073.091123:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103423488:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391073.091189:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 24 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.091195:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 24 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391073.091211:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103423616:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391073.091231:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391073.093518:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.093538:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103423488:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391073.093550:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103423616:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391073.093550:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788391073.093572:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391073.093646:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054144 00000100:00100000:3.0:1788391073.093653:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054144 00010000:00010000:3.0:1788391073.093689:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 25 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391073.093731:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054016 00000100:00100000:3.0:1788391073.093735:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054016 00010000:00010000:3.0:1788391073.093750:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 16 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.093766:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788391073.093776:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788391073.093777:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+25:2357:x1875263094054144:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788391073.093781:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14847363-0daa-48dd-bf83-08d2101df15c+16:2357:x1875263094054016:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391073.093793:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391073.093795:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391073.093799:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 16 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.093799:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 25 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.093810:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 16 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.093922:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 25 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.093942:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35d12 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa0c expref: 25 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.093956:0:40545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391073.094043:0:40545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.094053:0:40545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.094060:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391073.094111:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+24:2357:x1875263094054144:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 335us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391073.094118:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:3.0:1788391073.094874:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35d58 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa28 expref: 16 pid: 38437 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.094887:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391073.094891:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.094899:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.094906:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.094935:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391073.094977:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14847363-0daa-48dd-bf83-08d2101df15c+15:2357:x1875263094054016:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1193us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391073.094985:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:2.0:1788391073.094991:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.094998:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391073.095014:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:2.0:1788391073.095176:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35d6d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa36 expref: 16 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.095192:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa36 expref: 15 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.095200:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391073.095202:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391073.095205:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391073.095311:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+15:26800:x1875263094053888:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4426us (4729us total) trans 25769803822 rc 0/0 00000100:00100000:2.0:1788391073.095319:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1788391073.098275:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.098349:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054400 00000100:00100000:2.0:1788391073.098358:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054400 00000100:00100000:2.0:1788391073.098427:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391073.098437:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+15:26800:x1875263094054400:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1788391073.098719:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.098736:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.098748:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391073.098799:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803823 00000004:00010000:2.0:1788391073.098824:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c0c9696 reply state 000000005679e608 transno 25769803824 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391073.098833:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391073.098923:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+18:26800:x1875263094054400:12345-192.168.202.1@tcp:36:bash.0 Request processed in 487us (655us total) trans 25769803824 rc 0/0 00000100:00100000:2.0:1788391073.098930:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000020:00080000:2.0:1788391073.098934:0:38437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391073.102362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391073.102562:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054528 00000100:00100000:1.0:1788391073.102573:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054528 00000100:00100000:1.0:1788391073.102643:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1788391073.102653:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094054528:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391073.102670:0:39120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391073.102687:0:39120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa3d expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102736:0:39120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102745:0:39120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 10 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102753:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391073.102757:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391073.102763:0:39120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 5/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 10 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102797:0:39120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 10 pid: 39121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102811:0:39120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 10 pid: 39121 timeout: 990 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.102825:0:39120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:39120:1875263103423744:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391073.102930:0:39120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.102940:0:39120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 6 pid: 39225 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.102980:0:39120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:39120:1875263103423872:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391073.103009:0:39120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788391073.104248:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104261:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104268:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104274:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391073.104279:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104301:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104318:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391073.104321:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391073.104326:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391073.104331:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35d82 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391073.109880:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.109928:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054656 00000100:00100000:2.0:1788391073.109937:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054656 00010000:00010000:2.0:1788391073.110003:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 11 pid: 39121 timeout: 990 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391073.110043:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391073.110053:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+11:2356:x1875263094054656:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391073.110083:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391073.110090:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 11 pid: 39121 timeout: 990 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.110102:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 11 pid: 39121 timeout: 990 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391073.110125:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391073.110174:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+11:2356:x1875263094054656:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391073.110181:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00010000:00010000:1.0:1788391073.111083:0:39120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000784c046b/0x9aafc5f04cd35d66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa2f expref: 10 pid: 39121 timeout: 990 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.111099:0:39120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:39120:1875263103423744:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391073.111111:0:39120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:39120:1875263103423872:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391073.111141:0:39120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 9 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.111155:0:39120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391073.111196:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+9:26800:x1875263094054528:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8545us (8843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391073.111204:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391073.114009:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391073.114108:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054784 00000100:00100000:1.0:1788391073.114118:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054784 00010000:00010000:1.0:1788391073.114154:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.114195:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788391073.114205:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094054784:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391073.114218:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391073.114224:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.114251:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.114274:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e1558e/0x9aafc5f04cd35d27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa1a expref: 7 pid: 39225 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.114291:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391073.114296:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391073.114303:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 8 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.114313:0:40545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 8 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391073.114357:0:40545:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 8 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391073.114373:0:40545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:40545:1875263103424000:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391073.114465:0:40545:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391073.119324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391073.119381:0:40545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:40545:1875263103424000:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391073.119404:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391073.119411:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094054912 00000100:00100000:2.0:1788391073.119417:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094054912 00002000:00010000:2.0:1788391073.119453:0:39124:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:2.0:1788391073.119458:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55dc00 with x1875263094054912 ext(0->18446744073709551615) 00002000:00010000:2.0:1788391073.119468:0:39124:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55dc00. 00000100:00100000:1.0:1788391073.119470:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094054784:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 5266us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391073.119479:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788391073.119501:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391073.119509:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+9:2357:x1875263094054912:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:2.0:1788391073.119800:0:39124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 14 -> 0 00002000:00010000:2.0:1788391073.119804:0:39124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788391072 -> 1788391073 00002000:00010000:2.0:1788391073.119806:0:39124:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 1788391068 -> 1788391068 00002000:00010000:2.0:1788391073.119808:0:39124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788391072 -> 1788391073 00002000:00010000:2.0:1788391073.119811:0:39124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788391073.119849:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+10:2357:x1875263094054912:12345-192.168.202.1@tcp:10:bash.0 Request processed in 340us (533us total) trans 25769803785 rc 0/0 00000100:00100000:2.0:1788391073.119865:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00010000:2.0:1788391073.119869:0:39124:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:2.0:1788391073.119871:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55dc00 with x1875263094054912 ext(0->18446744073709551615) 00002000:00010000:2.0:1788391073.119876:0:39124:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55dc00. 00010000:00010000:3.0:1788391073.229109:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391073.229217:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391073.229239:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103424128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391073.229309:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391073.229990:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424128 00000100:00100000:1.0:1788391073.229999:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424128 00000100:00100000:1.0:1788391073.230374:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788391073.230385:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103424128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391073.230419:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3848273920 00000100:00100000:1.0:1788391073.230481:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103424128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391073.230488:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788391073.230661:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103424128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788391073.231091:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391073.403740:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391073.403792:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391073.403831:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391073.403946:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055040 00000100:00100000:2.0:1788391073.403955:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055040 00000100:00100000:2.0:1788391073.404044:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391073.404055:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2357:x1875263094055040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391073.404121:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2357:x1875263094055040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391073.404126:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788391073.404467:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055296 00000100:00100000:3.0:1788391073.404472:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055296 00000100:00100000:3.0:1788391073.404524:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055168 00000100:00100000:3.0:1788391073.404528:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055168 00000100:00100000:3.0:1788391073.404550:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788391073.404557:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+5:2357:x1875263094055296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391073.404608:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+5:2357:x1875263094055296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391073.404615:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788391073.404629:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788391073.404636:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+5:2357:x1875263094055168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391073.404660:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+5:2357:x1875263094055168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391073.404666:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00080000:2.0:1788391073.404912:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391074.253692:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391075.277070:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391076.301178:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391076.301259:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391076.301280:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103424640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391076.301349:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391076.301416:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424640 00000100:00100000:0.0:1788391076.301423:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424640 00000100:00100000:0.0:1788391076.301470:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391076.301480:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103424640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391076.301533:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103424640:12345-0@lo:400:kworker.0 Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391076.301541:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391076.301592:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103424640:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.303726:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103424256:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.303791:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391076.303828:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391076.303835:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103424768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391076.303863:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391076.303931:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424256 00000100:00100000:3.0:1788391076.303938:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424256 00000100:00100000:3.0:1788391076.303997:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788391076.304007:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103424256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304056:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103424256:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391076.304064:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788391076.304095:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424768 00000100:00100000:3.0:1788391076.304099:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424768 00000100:00100000:3.0:1788391076.304131:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391076.304139:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103424768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391076.304166:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391076.304200:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103424768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391076.304207:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788391076.304224:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391076.304254:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103424768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391076.304263:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103424256:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304336:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103424512:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304373:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391076.304393:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391076.304400:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103424384:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304421:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391076.304450:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424512 00000100:00100000:3.0:1788391076.304454:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424512 00000100:00100000:3.0:1788391076.304484:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424384 00000100:00100000:3.0:1788391076.304487:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424384 00000100:00100000:3.0:1788391076.304509:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391076.304516:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103424512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304551:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103424512:12345-0@lo:400:kworker.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391076.304557:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391076.304726:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788391076.304733:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103424384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304763:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103424384:12345-0@lo:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391076.304770:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788391076.304798:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103424384:0@lo:400:kworker.0 00000100:00100000:3.0:1788391076.304808:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103424512:0@lo:400:kworker.0 00000100:00080000:3.0:1788391076.304837:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391076.304841:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391076.307062:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103424896:0@lo:400:kworker.0 00000100:00100000:2.0:1788391076.307121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391076.307171:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103424896 00000100:00100000:2.0:1788391076.307177:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103424896 00000100:00100000:2.0:1788391076.307226:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788391076.307236:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103424896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391076.307282:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103424896:12345-0@lo:400:kworker.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391076.307290:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788391076.307308:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391076.307337:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103424896:0@lo:400:kworker.0 00000100:00100000:2.0:1788391076.307375:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103425024:0@lo:400:kworker.0 00000100:00100000:2.0:1788391076.307410:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391076.311514:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103425024 00000100:00100000:0.0:1788391076.311529:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103425024 00000100:00100000:0.0:1788391076.311609:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391076.311620:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103425024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391076.311711:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103425024:12345-0@lo:400:kworker.0 Request processed in 93us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391076.311720:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788391076.311743:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391076.311782:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103425024:0@lo:400:kworker.0 00000001:00080000:1.0:1788391076.343219:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803780 is committed 00000100:00100000:0.0:1788391076.648279:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391076.648955:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055424 00000100:00100000:2.0:1788391076.649048:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055424 00000100:00100000:2.0:1788391076.649354:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788391076.649366:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+24:29034:x1875263094055424:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788391076.649494:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+24:29034:x1875263094055424:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 130us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391076.649502:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00080000:0.0:1788391076.649536:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391076.654053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391076.654352:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055680 00000100:00100000:2.0:1788391076.654363:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055680 00000100:00100000:2.0:1788391076.654423:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391076.654433:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+24:29034:x1875263094055680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391076.654926:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+25:29034:x1875263094055680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 492us (881us total) trans 25769803825 rc 0/0 00000100:00100000:2.0:1788391076.654936:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391076.982755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391076.982862:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391076.983007:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055936 00000100:00100000:3.0:1788391076.983029:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055936 00000100:00100000:3.0:1788391076.983107:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391076.983118:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+10:2358:x1875263094055936:12345-192.168.202.1@tcp:16:kworker.0 00000100:00080000:0.0:1788391076.986019:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391076.986997:0:39125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094055808 00000100:00100000:2.0:1788391076.987010:0:39125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094055808 00002000:00100000:2.0:1788391076.987087:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff95d68fc5b480 x1875263094055808/t0(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:692/0 lens 504/0 e 0 to 0 dl 1788391087 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391076.987099:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b480 with x1875263094055808 ext(0->13) 00002000:00010000:2.0:1788391076.987105:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc5b480 00000100:00100000:2.0:1788391076.987138:0:39125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391076.987148:0:39125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14847363-0daa-48dd-bf83-08d2101df15c+11:2358:x1875263094055808:12345-192.168.202.1@tcp:4:bash.0 00000100:00100000:2.0:1788391076.987784:0:39125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14847363-0daa-48dd-bf83-08d2101df15c+13:2358:x1875263094055808:12345-192.168.202.1@tcp:4:bash.0 Request processed in 635us (5037us total) trans 25769803786 rc 0/0 00000100:00100000:2.0:1788391076.987801:0:39125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00100000:2.0:1788391076.987810:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff95d68fc5b480 x1875263094055808/t25769803786(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:692/0 lens 504/448 e 0 to 0 dl 1788391087 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391076.987817:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b480 with x1875263094055808 ext(0->13) 00002000:00010000:2.0:1788391076.987821:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc5b480 00000001:00080000:2.0:1788391077.034774:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803782 is committed 00000001:00080000:2.0:1788391077.034933:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803784 is committed 00000001:00080000:2.0:1788391077.035082:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803785 is committed 00000001:00080000:2.0:1788391077.035096:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000100:00100000:3.0:1788391077.035174:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+8:2358:x1875263094055936:12345-192.168.202.1@tcp:16:kworker.0 Request processed in 52049us (52302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391077.035192:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00010000:00010000:3.0:1788391077.325129:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391077.864582:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803814 is committed 00000001:00080000:0.0:1788391077.864624:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803825 is committed 00000001:00080000:0.0:1788391077.864633:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803824 is committed 00000020:00080000:0.0:1788391077.864660:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d587299840 refcount 2 committed 0 result 0 batchid 21474836517 00000020:00080000:0.0:1788391077.864681:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d692d26000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d587299900 00000020:00080000:0.0:1788391077.864685:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6bc6bc000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585128000 00000020:00080000:2.0:1788391077.864943:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836517 committed batchid 21474836516 00000020:00080000:2.0:1788391077.865174:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00010000:00010000:3.0:1788391078.349336:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391078.349608:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103425152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391078.349684:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391078.349839:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103425152 00000100:00100000:3.0:1788391078.349847:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103425152 00000100:00100000:3.0:1788391078.349912:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391078.349925:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103425152:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788391078.349925:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788391078.349950:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3851419648 avail 3848273920 00000100:00100000:3.0:1788391078.350328:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103425152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 405us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391078.350337:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788391078.350403:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803782 gen 2 00000004:00080000:0.0:1788391078.350409:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803782 00000100:00100000:0.0:1788391078.350438:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103425152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391078.519308:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519351:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519388:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519423:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519451:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519500:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391078.519527:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056576 00000100:00100000:1.0:1788391078.519535:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056576 00000100:00100000:1.0:1788391078.519611:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056192 00000100:00100000:1.0:1788391078.519615:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056192 00000100:00100000:1.0:1788391078.519637:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391078.519647:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:2358:x1875263094056576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391078.519723:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:2358:x1875263094056576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.519731:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391078.519763:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391078.519769:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+10:2358:x1875263094056192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391078.520057:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+10:2358:x1875263094056192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 286us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.520064:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391078.520086:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056320 00000100:00100000:1.0:1788391078.520090:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056320 00000100:00100000:1.0:1788391078.520111:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056832 00000100:00100000:1.0:1788391078.520113:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056832 00000100:00100000:1.0:1788391078.520123:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056448 00000100:00100000:1.0:1788391078.520125:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056448 00000100:00100000:1.0:1788391078.520135:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056704 00000100:00100000:1.0:1788391078.520137:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056704 00000100:00100000:1.0:1788391078.520148:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391078.520155:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094056320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391078.520182:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094056320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.520189:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1788391078.520205:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094056064 00000100:00100000:1.0:1788391078.520206:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391078.520211:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094056064 00000100:00100000:1.0:1788391078.520227:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094056832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391078.520248:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788391078.520257:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094056832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391078.520261:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2358:x1875263094056064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391078.520270:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788391078.520288:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1788391078.520299:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2358:x1875263094056064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.520300:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094056448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391078.520313:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788391078.520337:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094056448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.520351:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788391078.520367:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:0.0:1788391078.520371:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391078.520376:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+8:2358:x1875263094056704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:0.0:1788391078.520378:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391078.520383:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391078.520409:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+8:2358:x1875263094056704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391078.520416:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000001:02000400:1.0:1788391079.108632:0:40752:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 19:17:58 (1788391078) 00010000:00010000:3.0:1788391079.373235:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391079.385944:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.386003:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057088 00000100:00100000:0.0:1788391079.386013:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057088 00000100:00100000:0.0:1788391079.386107:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1788391079.386126:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+10:29785:x1875263094057088:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391079.386148:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.386165:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd35d90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa44 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386233:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386264:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386276:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386289:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386295:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386301:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386529:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35da5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386550:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35da5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386558:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35da5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.386566:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788391079.386686:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386693:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386700:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386721:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391079.386725:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386732:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386744:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70200) 00010000:00010000:0.0:1788391079.386747:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391079.386752:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386760:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35d97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386772:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386778:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386783:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386788:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391079.386790:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386795:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386812:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a0d59100) 00010000:00010000:0.0:1788391079.386815:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391079.386818:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.386824:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35d9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391079.387318:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ac00/0x9aafc5f04cd35d90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa44 expref: 13 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391079.387333:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35da5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa44 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391079.387341:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:1.0:1788391079.387343:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391079.387345:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79be00, rc 0) 00000100:00100000:1.0:1788391079.387408:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+12:29785:x1875263094057088:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1291us (1471us total) trans 25769803826 rc 0/0 00000100:00100000:1.0:1788391079.387417:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1788391079.396269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.396592:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057344 00000100:00100000:3.0:1788391079.396603:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057344 00000100:00100000:3.0:1788391079.396684:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788391079.396695:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+12:2359:x1875263094057344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391079.396721:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391079.396745:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd35da5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa44 expref: 12 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.396765:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:3.0:1788391079.396769:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391079.396831:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+11:2359:x1875263094057344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 137us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.396856:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788391079.398219:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.398300:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057216 00000100:00100000:2.0:1788391079.398307:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057216 00000100:00100000:2.0:1788391079.398354:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788391079.398363:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+11:29785:x1875263094057216:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788391079.398467:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+11:29785:x1875263094057216:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.398473:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1788391079.535317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.535575:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057600 00000100:00100000:3.0:1788391079.535585:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057600 00000100:00100000:3.0:1788391079.535690:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788391079.535701:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+11:29800:x1875263094057600:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:3.0:1788391079.535836:0:38437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391079.535862:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdca00/0x9aafc5f04cd35a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff93a expref: 11 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.535882:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391079.535886:0:38437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391079.536204:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.536219:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 8 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.536228:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.536261:0:38437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 8 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.536277:0:38437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 8 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.536291:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103425280:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391079.536407:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391079.540271:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.540372:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057728 00000100:00100000:0.0:1788391079.540381:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057728 00010000:00010000:0.0:1788391079.540430:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 9 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.540469:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788391079.540479:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:2356:x1875263094057728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391079.540491:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391079.540497:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 9 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.540511:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 9 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.540545:0:40545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:0.0:1788391079.540551:0:40545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.540578:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.540585:0:40545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.540605:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391079.540663:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:2356:x1875263094057728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 185us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391079.540671:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00010000:00010000:3.0:1788391079.541686:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6e00/0x9aafc5f04cd35bb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9aa expref: 8 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.542005:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103425280:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391079.542027:0:38437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.542037:0:38437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.542043:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.542067:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.542077:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.542086:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391079.543583:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1788391079.543600:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543608:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543615:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543629:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391079.543634:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543642:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543868:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391079.543872:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391079.543877:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.543883:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35db3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391079.543903:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef6f93f8 reply state 0000000044b34373 transno 25769803827 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.543912:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391079.544101:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+12:29800:x1875263094057600:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 8398us (8787us total) trans 25769803827 rc 0/0 00000100:00100000:3.0:1788391079.544112:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00010000:00010000:2.0:1788391079.546190:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546205:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546228:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546234:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.546239:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546246:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546262:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff95d686a70f00) 00010000:00010000:2.0:1788391079.546266:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.546270:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.546276:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd35dba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391079.556993:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.557632:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057856 00000100:00100000:2.0:1788391079.557644:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057856 00000100:00100000:2.0:1788391079.558081:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1788391079.558094:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:29801:x1875263094057856:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391079.558116:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.558140:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35dc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa4b expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558206:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558237:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558249:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.558285:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391079.558287:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391079.558317:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558336:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd35dc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa4b expref: 10 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558348:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa4b expref: 9 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.558354:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391079.558356:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391079.558358:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788391079.558495:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14847363-0daa-48dd-bf83-08d2101df15c+9:29801:x1875263094057856:12345-192.168.202.1@tcp:101:dd.0 Request processed in 403us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.558502:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1788391079.562118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.562202:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094057984 00000100:00100000:2.0:1788391079.562212:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094057984 00000100:00100000:2.0:1788391079.562293:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788391079.562301:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+9:29801:x1875263094057984:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391079.562318:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.562345:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35dcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa52 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562404:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562415:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562423:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562431:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562435:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562445:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562521:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562525:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562540:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.562735:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1788391079.562739:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391079.562758:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562778:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562785:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562791:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562797:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.562802:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562809:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562821:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391079.562824:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.562829:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562835:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562847:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562853:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562859:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562869:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.562872:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562878:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562886:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff95d68641e200) 00010000:00010000:2.0:1788391079.562888:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.562891:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562897:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35ddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562924:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35dcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa52 expref: 11 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562937:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa52 expref: 10 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.562944:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391079.562946:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391079.562948:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391079.563076:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14847363-0daa-48dd-bf83-08d2101df15c+10:29801:x1875263094057984:12345-192.168.202.1@tcp:101:dd.0 Request processed in 774us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.563083:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788391079.566097:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.566185:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094058240 00000100:00100000:0.0:1788391079.566195:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094058240 00000100:00100000:0.0:1788391079.566244:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1788391079.566253:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:29801:x1875263094058240:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391079.566272:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.566290:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35deb lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa59 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566416:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566429:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566446:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566459:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566475:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.566481:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391079.567168:0:38436:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa3:0x0], index 1: 0 00010000:00010000:0.0:1788391079.567294:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567301:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567307:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567330:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567335:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567339:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567342:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391079.567345:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567349:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567366:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391079.567368:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391079.567371:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567375:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35df2 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391079.567384:0:38436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041b9b425 reply state 00000000c042c67b transno 25769803828 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.567389:0:38436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391079.567411:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35deb lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 13 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567419:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 12 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.567424:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391079.567426:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391079.567427:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391079.567756:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+13:29801:x1875263094058240:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1502us (1668us total) trans 25769803828 rc 0/0 00000100:00100000:0.0:1788391079.567764:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00010000:00010000:3.0:1788391079.569829:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569844:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569851:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569871:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391079.569876:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569884:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569899:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d6a0d59100) 00010000:00010000:3.0:1788391079.569902:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391079.569905:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.569911:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd35df9 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391079.571016:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.571109:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094058368 00000100:00100000:2.0:1788391079.571125:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094058368 00000100:00100000:2.0:1788391079.571169:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1788391079.571180:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+5:29801:x1875263094058368:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391079.571197:0:39120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.571216:0:39120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa60 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391079.571241:0:39120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391079.571262:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=896s v=(0 0) 00010000:00010000:2.0:1788391079.571267:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391079.571275:0:39120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.571292:0:39120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.571303:0:39120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391079.571350:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14847363-0daa-48dd-bf83-08d2101df15c+6:29801:x1875263094058368:12345-192.168.202.1@tcp:101:dd.0 Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.571357:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1788391079.574583:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.574658:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094058624 00000100:00100000:3.0:1788391079.574834:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094058624 00000100:00100000:3.0:1788391079.574929:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788391079.574939:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+12:29801:x1875263094058624:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:3.0:1788391079.575347:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14847363-0daa-48dd-bf83-08d2101df15c+13:29801:x1875263094058624:12345-192.168.202.1@tcp:35:dd.0 Request processed in 408us (772us total) trans 25769803829 rc 0/0 00000100:00100000:3.0:1788391079.575355:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1788391079.612613:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.612852:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094058752 00000100:00100000:3.0:1788391079.612862:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094058752 00000100:00100000:3.0:1788391079.613010:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788391079.613021:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+11:29807:x1875263094058752:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391079.613045:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391079.613078:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa67 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613145:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613160:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613171:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391079.613207:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391079.613211:0:38437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391079.613230:0:38437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613255:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa67 expref: 13 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613274:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa67 expref: 12 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.613283:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788391079.613286:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391079.613290:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0c00, rc 0) 00000100:00100000:3.0:1788391079.613351:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+12:29807:x1875263094058752:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 332us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.613358:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788391079.615956:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.616131:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094058880 00000100:00100000:2.0:1788391079.616141:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094058880 00000100:00100000:2.0:1788391079.616399:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788391079.616411:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+12:29807:x1875263094058880:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391079.616427:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.616453:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa6e expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616544:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616558:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616571:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616585:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616592:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616599:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616689:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616698:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616705:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.616735:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1788391079.616738:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391079.616755:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616776:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616783:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616789:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616795:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.616799:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616806:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616820:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391079.616823:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.616827:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616833:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd35e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616845:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616851:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616857:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616867:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.616871:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616877:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616885:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff95d68641e200) 00010000:00010000:2.0:1788391079.616887:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.616889:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616895:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd35e31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616922:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd35e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa6e expref: 14 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616933:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa6e expref: 13 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.616940:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391079.616942:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391079.616944:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391079.617036:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+13:29807:x1875263094058880:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 627us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.617044:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788391079.620648:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.620733:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059008 00000100:00100000:2.0:1788391079.620753:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059008 00000100:00100000:2.0:1788391079.620812:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1788391079.620822:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+13:29807:x1875263094059008:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391079.620840:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.620859:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35e3f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa75 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.620920:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.620933:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.620943:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.620999:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621008:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621015:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621106:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621115:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621122:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.621159:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788391079.621163:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391079.621180:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621191:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621199:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621205:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621210:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621215:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.621220:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621227:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621239:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391079.621242:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.621246:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621252:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd35e46 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621275:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621282:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621288:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621293:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.621296:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621301:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621309:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:2.0:1788391079.621312:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.621314:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621319:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd35e4d lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621348:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd35e3f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 15 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621362:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 14 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.621379:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391079.621381:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391079.621384:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:2.0:1788391079.621452:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+14:29807:x1875263094059008:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 629us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.621458:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788391079.624369:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.624462:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059136 00000100:00100000:3.0:1788391079.624487:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059136 00000100:00100000:3.0:1788391079.624553:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788391079.624564:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+5:2359:x1875263094059136:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391079.624582:0:39225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391079.624601:0:39225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa7c expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.624658:0:39225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:39225:1875263103425408:192.168.202.1@tcp:106: 00000100:00100000:3.0:1788391079.624748:0:39225:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e1d80 going to sleep for 11 seconds 00002000:00010000:3.0:1788391079.627134:0:39225:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size: 0 -> 1024 00002000:00010000:3.0:1788391079.627142:0:39225:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime: 0 -> 1788391079 00002000:00010000:3.0:1788391079.627145:0:39225:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb atime: 0 -> 1788391079 00002000:00010000:3.0:1788391079.627146:0:39225:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime: 0 -> 1788391079 00000100:00100000:3.0:1788391079.627171:0:39225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:39225:1875263103425408:192.168.202.1@tcp:106: 00010000:00010000:3.0:1788391079.627210:0:39225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa7c expref: 6 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.627232:0:39225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa7c expref: 6 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.627244:0:39225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788391079.627299:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+5:2359:x1875263094059136:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2737us (2938us total) trans 0 rc 301/301 00000100:00100000:3.0:1788391079.627307:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1788391079.631254:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.631338:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059392 00000100:00100000:0.0:1788391079.631347:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059392 00000100:00100000:0.0:1788391079.631408:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1788391079.631417:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+14:29807:x1875263094059392:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.631454:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.631472:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35e62 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa83 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.631569:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35e69 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.631584:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35e69 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.631594:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35e69 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.631605:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788391079.631729:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd35e62 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa83 expref: 17 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.631745:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35e69 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa83 expref: 16 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.631753:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391079.631756:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391079.631759:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391079.631810:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+16:29807:x1875263094059392:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 394us (566us total) trans 25769803830 rc 0/0 00000100:00100000:0.0:1788391079.631816:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788391079.635353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391079.635396:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.635463:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059776 00000100:00100000:0.0:1788391079.635473:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059776 00000100:00100000:0.0:1788391079.635538:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788391079.635561:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+16:29807:x1875263094059776:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.635585:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.635602:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35e77 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa8a expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.635689:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.635713:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.635724:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.635734:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788391079.635848:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd35e77 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa8a expref: 19 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.635864:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa8a expref: 18 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.635873:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391079.635876:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391079.635879:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391079.635938:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+18:29807:x1875263094059776:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 378us (541us total) trans 25769803831 rc 0/0 00000100:00100000:0.0:1788391079.635945:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788391079.636366:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059520 00000100:00100000:3.0:1788391079.636372:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059520 00000100:00100000:3.0:1788391079.636423:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1788391079.636440:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+18:2357:x1875263094059520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391079.636452:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391079.636468:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd35e69 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa83 expref: 18 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.636480:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:3.0:1788391079.636484:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391079.636515:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+17:2357:x1875263094059520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 86us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.636522:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788391079.645142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.645323:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094059904 00000100:00100000:2.0:1788391079.645333:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094059904 00000100:00100000:2.0:1788391079.645397:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788391079.645406:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+5:29807:x1875263094059904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391079.645422:0:39120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.645568:0:39120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa91 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.645602:0:39120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 5 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.645610:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391079.645613:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391079.645619:0:39120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.645650:0:39120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 5 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.645684:0:39120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 5 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.645697:0:39120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:39120:1875263103425536:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391079.645774:0:39120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747840 going to sleep for 11 seconds 00000100:00100000:3.0:1788391079.649045:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.649194:0:39120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:39120:1875263103425536:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391079.649225:0:39120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 3/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.649243:0:39120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1400, rc 0) 00000100:00100000:2.0:1788391079.649310:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+6:29807:x1875263094059904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3905us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.649319:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391079.650020:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060032 00000100:00100000:0.0:1788391079.650029:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060032 00002000:00100000:0.0:1788391079.650082:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff95d68a7e7b80 x1875263094060032/t0(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:695/0 lens 1512/0 e 0 to 0 dl 1788391090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391079.650092:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7b80 with x1875263094060032 ext(0->1023) 00010000:00010000:0.0:1788391079.650101:0:39124:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 6 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.650117:0:39124:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 6 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391079.650125:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d68a7e7b80 00000100:00100000:0.0:1788391079.650155:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788391079.650163:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+6:2356:x1875263094060032:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391079.650643:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14847363-0daa-48dd-bf83-08d2101df15c+8:2356:x1875263094060032:12345-192.168.202.1@tcp:4:dd.0 Request processed in 477us (1604us total) trans 25769803781 rc 0/0 00000100:00100000:0.0:1788391079.650651:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:0.0:1788391079.650658:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff95d68a7e7b80 x1875263094060032/t25769803781(0) o4->14847363-0daa-48dd-bf83-08d2101df15c@192.168.202.1@tcp:695/0 lens 1512/448 e 0 to 0 dl 1788391090 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391079.650668:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7b80 with x1875263094060032 ext(0->1023) 00010000:00010000:0.0:1788391079.650674:0:39124:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.650687:0:39124:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391079.650695:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d68a7e7b80 00000100:00100000:1.0:1788391079.654380:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.656210:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060160 00000100:00100000:0.0:1788391079.656226:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060160 00010000:00010000:0.0:1788391079.656275:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.656318:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391079.656328:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14847363-0daa-48dd-bf83-08d2101df15c+8:2357:x1875263094060160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391079.656344:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391079.656368:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.656381:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.656405:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd35e0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa60 expref: 8 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.656423:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391079.656428:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391079.656435:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 5 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.656447:0:40545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 5 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.656484:0:40545:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 5 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.656519:0:40545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:40545:1875263103425664:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391079.656662:0:40545:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690900 going to sleep for 11 seconds 00000100:00100000:0.0:1788391079.664858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391079.664879:0:40545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:40545:1875263103425664:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391079.664905:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391079.664995:0:39125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060288 00000100:00100000:1.0:1788391079.665001:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14847363-0daa-48dd-bf83-08d2101df15c+7:2357:x1875263094060160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8672us (10629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.665004:0:39125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060288 00000100:00100000:1.0:1788391079.665015:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00002000:00100000:2.0:1788391079.665059:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff95d68f55d180 x1875263094060288/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:695/0 lens 488/0 e 0 to 0 dl 1788391090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391079.665070:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d180 with x1875263094060288 ext(0->4095) 00002000:00010000:2.0:1788391079.665075:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55d180 00000100:00100000:2.0:1788391079.665095:0:39125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391079.665107:0:39125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094060288:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391079.665267:0:39125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094060288:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 161us (419us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788391079.665287:0:39125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:2.0:1788391079.665294:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff95d68f55d180 x1875263094060288/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:695/0 lens 488/4536 e 0 to 0 dl 1788391090 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391079.665301:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d180 with x1875263094060288 ext(0->4095) 00002000:00010000:2.0:1788391079.665304:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55d180 00000100:00100000:0.0:1788391079.673366:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.673466:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060416 00000100:00100000:3.0:1788391079.673586:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060416 00000100:00100000:3.0:1788391079.673646:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788391079.673658:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2359:x1875263094060416:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1788391079.673701:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.673723:0:39121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.673732:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391079.673736:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391079.673740:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.673797:0:39121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 6 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.673811:0:39121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 6 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.673826:0:39121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:39121:1875263103425792:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391079.673912:0:39121:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391079.677396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.677591:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060544 00000100:00100000:2.0:1788391079.677601:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060544 00010000:00010000:2.0:1788391079.677640:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 7 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.677686:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788391079.677697:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094060544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391079.677711:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391079.677733:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 7 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.677747:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 7 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.677770:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391079.677775:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391079.677781:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.677791:0:38421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.677824:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391079.677881:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094060544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (493us total) trans 0 rc 0/0 00010000:00010000:3.0:1788391079.677886:0:39121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd35e8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa91 expref: 7 pid: 39120 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.677894:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788391079.677912:0:39121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:39121:1875263103425792:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391079.677937:0:39121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.677953:0:39121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678015:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678040:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678060:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678069:0:39121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678076:0:39121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391079.678079:0:39121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678087:0:39121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678099:0:39121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.678107:0:39121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd35e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391079.678157:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+5:2359:x1875263094060416:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 4502us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.678164:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788391079.681006:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.681352:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060800 00000100:00100000:2.0:1788391079.681362:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060800 00000100:00100000:2.0:1788391079.681421:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391079.681431:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffcdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+17:29807:x1875263094060800:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1788391079.681497:0:38438:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa8a expref: 17 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391079.681747:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803832 00000001:00080000:2.0:1788391079.681790:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803833 00000001:00080000:2.0:1788391079.682292:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803834 00010000:00010000:2.0:1788391079.682346:0:38438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682363:0:38438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 12 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682371:0:38438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 21 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682378:0:38438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 5/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682410:0:38438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 21 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682432:0:38438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 21 pid: 39647 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.682446:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103425920:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391079.682555:0:38438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 12 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.682566:0:38438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 12 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.682577:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103426048:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391079.682602:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391079.687672:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391079.687734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.687999:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094060928 00000100:00100000:0.0:1788391079.688007:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094060928 00010000:00010000:0.0:1788391079.688043:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 22 pid: 39647 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.688079:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094061056 00000100:00100000:0.0:1788391079.688082:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094061056 00010000:00010000:0.0:1788391079.688095:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 13 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.688118:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391079.688127:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+22:2357:x1875263094060928:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391079.688141:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391079.688148:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 22 pid: 39647 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688161:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 22 pid: 39647 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688182:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391079.688186:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688204:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688208:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391079.688250:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+22:2357:x1875263094060928:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 125us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391079.688255:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391079.688269:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391079.688274:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+13:2356:x1875263094061056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391079.688279:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391079.688283:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 13 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688291:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 13 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688301:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391079.688304:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688310:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688315:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.688327:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391079.688332:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35e54 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa75 expref: 21 pid: 39647 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391079.688340:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14847363-0daa-48dd-bf83-08d2101df15c+13:2356:x1875263094061056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 65us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391079.688351:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391079.688355:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103425920:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391079.688372:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd35e00 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa59 expref: 12 pid: 38436 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.688383:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103426048:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391079.688410:0:38438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.688419:0:38438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.688432:0:38438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391079.688558:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803835 00000001:00080000:2.0:1788391079.688754:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803836 00000001:00080000:2.0:1788391079.688820:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803837 00000100:00100000:2.0:1788391079.688896:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103426176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788391079.688940:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391079.688990:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68451c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788391079.688994:0:38441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103426176 00000100:00100000:0.0:1788391079.689000:0:38441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103426176 00000100:00100000:0.0:1788391079.689048:0:38441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391079.689055:0:38441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103426176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788391079.689114:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391079.689161:0:38441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103426176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391079.689168:0:38441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788391079.689195:0:38438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:2.0:1788391079.689201:0:38438:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69111a300, transno 25769803780 00000100:00100000:2.0:1788391079.689223:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103426176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788391079.691839:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803838 00000100:00100000:2.0:1788391079.691936:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103426304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788391079.692033:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391079.692067:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391079.692089:0:38441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103426304 00000100:00100000:1.0:1788391079.692095:0:38441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103426304 00000100:00100000:1.0:1788391079.692136:0:38441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391079.692146:0:38441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:38438:x1875263103426304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788391079.692325:0:38441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:38438:x1875263103426304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (293us total) trans 25769803782 rc 0/0 00000100:00100000:1.0:1788391079.692331:0:38441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391079.692399:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103426304:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1788391079.692444:0:38438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692454:0:38438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692462:0:38438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692468:0:38438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.692485:0:38438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692491:0:38438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692503:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391079.692505:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788391079.692508:0:38438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.692512:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35e9a lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391079.692755:0:38438:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788391079.692816:0:38438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].3, 64 off8384 00000004:00080000:2.0:1788391079.692823:0:38438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896799862255ns, next at 897799860665ns, rc = 0 00000001:00080000:2.0:1788391079.692828:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803839 00010000:00010000:2.0:1788391079.692852:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391079.692854:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788391079.692858:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35e7e lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa8a expref: 25 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.693123:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffcdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+24:29807:x1875263094060800:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 11692us (12169us total) trans 25769803840 rc 0/0 00000100:00100000:2.0:1788391079.693131:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000020:00080000:2.0:1788391079.693136:0:38438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788391079.695123:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.695184:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094061184 00000100:00100000:0.0:1788391079.695195:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094061184 00000100:00100000:0.0:1788391079.695246:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1788391079.695257:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+24:29807:x1875263094061184:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.695278:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.695297:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd35ea1 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa98 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.695345:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd35ea1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa98 expref: 25 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.695356:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd35ea1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa98 expref: 25 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.695368:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391079.695370:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391079.695373:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79aa00, rc 0) 00000100:00100000:0.0:1788391079.695426:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+25:29807:x1875263094061184:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 170us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391079.695455:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788391079.697229:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.697274:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094061440 00000100:00100000:3.0:1788391079.697282:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094061440 00000100:00100000:3.0:1788391079.697321:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788391079.697342:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+25:29807:x1875263094061440:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391079.697627:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+26:29807:x1875263094061440:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 285us (403us total) trans 25769803841 rc 0/0 00000100:00100000:3.0:1788391079.697635:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391079.742079:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.742215:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094061696 00000100:00100000:0.0:1788391079.742226:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094061696 00000100:00100000:0.0:1788391079.742324:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788391079.742332:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+26:29817:x1875263094061696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.742352:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.742368:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffa9f expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.742468:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:0.0:1788391079.742588:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35ea8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa9f expref: 28 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.742604:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:0.0:1788391079.742607:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391079.742612:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa9f expref: 28 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.742625:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788391079.742674:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+27:29817:x1875263094061696:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 344us (611us total) trans 25769803842 rc 301/301 00000100:00100000:0.0:1788391079.742679:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788391079.746802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.746924:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094061824 00000100:00100000:2.0:1788391079.746934:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094061824 00000100:00100000:2.0:1788391079.747013:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1788391079.747025:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+27:29817:x1875263094061824:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391079.747103:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.748621:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.748640:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.748666:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.748675:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.748682:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749090:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749100:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749106:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391079.749153:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749166:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749188:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749194:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749200:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.749204:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749212:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749225:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391079.749227:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.749231:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749238:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35eb6 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749252:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749257:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749263:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749267:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.749276:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749282:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749290:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:2.0:1788391079.749293:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.749296:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749301:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ebd lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749314:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749319:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749325:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749329:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.749332:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749338:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749345:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391079.749348:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.749357:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.749362:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ec4 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391079.750142:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+27:29817:x1875263094061824:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 3113us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.750154:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788391079.752148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.752218:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094062080 00000100:00100000:2.0:1788391079.752227:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094062080 00000100:00100000:2.0:1788391079.752268:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788391079.752275:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+27:29817:x1875263094062080:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391079.752453:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+28:29817:x1875263094062080:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 178us (312us total) trans 25769803843 rc 0/0 00000100:00100000:2.0:1788391079.752458:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788391079.803697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.803791:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094062208 00000100:00100000:2.0:1788391079.803802:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094062208 00000100:00100000:2.0:1788391079.803894:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1788391079.803902:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+28:29823:x1875263094062208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391079.803924:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.803940:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ecb lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffaa6 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804025:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804036:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804057:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804071:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804078:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804084:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804156:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804161:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804166:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.804193:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788391079.804197:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391079.804210:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804218:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804224:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804235:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804239:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804243:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.804245:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804250:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804258:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391079.804260:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.804263:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804267:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35ed2 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804275:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804278:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804282:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804285:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391079.804290:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804294:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804298:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:2.0:1788391079.804299:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391079.804301:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804304:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35ed9 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804324:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35ecb lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaa6 expref: 30 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804333:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaa6 expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.804340:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391079.804341:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391079.804343:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1200, rc 0) 00000100:00100000:2.0:1788391079.804410:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+29:29823:x1875263094062208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 508us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.804417:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788391079.806808:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.807166:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094062464 00000100:00100000:0.0:1788391079.807176:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094062464 00000100:00100000:0.0:1788391079.807248:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788391079.807256:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+29:29823:x1875263094062464:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.807289:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.807307:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35ee7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffaad expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.807413:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35eee lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.807424:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35eee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.807440:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35eee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.807448:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788391079.807627:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35ee7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaad expref: 32 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.807645:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35eee lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaad expref: 31 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.807654:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391079.807658:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391079.807661:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391079.807728:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+31:29823:x1875263094062464:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 472us (930us total) trans 25769803844 rc 0/0 00000100:00100000:0.0:1788391079.807734:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1788391079.810026:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.810072:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094062720 00000100:00100000:3.0:1788391079.810080:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094062720 00000100:00100000:3.0:1788391079.810124:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391079.810134:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+31:29823:x1875263094062720:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391079.810333:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+32:29823:x1875263094062720:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 199us (314us total) trans 25769803845 rc 0/0 00000100:00100000:3.0:1788391079.810340:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391079.811484:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.811622:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094062848 00000100:00100000:3.0:1788391079.811629:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094062848 00000100:00100000:3.0:1788391079.811685:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788391079.811693:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+32:2357:x1875263094062848:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391079.811707:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391079.811728:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd35eee lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaad expref: 32 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.811746:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391079.811750:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391079.811784:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+31:2357:x1875263094062848:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.811791:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1788391079.868258:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391079.868395:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094063104 00000100:00100000:0.0:1788391079.868406:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094063104 00000100:00100000:0.0:1788391079.868506:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1788391079.868543:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+31:29833:x1875263094063104:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391079.868570:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391079.868587:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffab4 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391079.868659:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:0.0:1788391079.868768:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35efc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffab4 expref: 33 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.868779:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:0.0:1788391079.868781:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391079.868784:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd35efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffab4 expref: 33 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391079.868793:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788391079.868871:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+32:29833:x1875263094063104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 343us (620us total) trans 25769803846 rc 301/301 00000100:00100000:0.0:1788391079.868876:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391079.871123:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.871188:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094063360 00000100:00100000:2.0:1788391079.871194:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094063360 00000100:00100000:2.0:1788391079.871233:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391079.871242:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+32:29833:x1875263094063360:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391079.871445:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+33:29833:x1875263094063360:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 203us (327us total) trans 25769803847 rc 0/0 00000100:00100000:2.0:1788391079.871453:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000040:00080000:0.0:1788391079.885246:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391079.885254:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391079.885278:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:0.0:1788391079.885282:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788391079.924242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.924377:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094063616 00000100:00100000:2.0:1788391079.924387:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094063616 00000100:00100000:2.0:1788391079.924480:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1788391079.924490:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+33:29839:x1875263094063616:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391079.924514:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391079.924548:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f0a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffabb expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.924637:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f11 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.924658:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f11 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.924667:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f11 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391079.924675:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1788391079.924801:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f0a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffabb expref: 36 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.924815:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f11 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffabb expref: 35 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.924821:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391079.924834:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391079.924837:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1a00, rc 0) 00000100:00100000:2.0:1788391079.924881:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+35:29839:x1875263094063616:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 393us (646us total) trans 25769803848 rc 0/0 00000100:00100000:2.0:1788391079.924894:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788391079.927243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391079.927322:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.927369:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064000 00000100:00100000:3.0:1788391079.927400:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064000 00000100:00100000:2.0:1788391079.927536:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094063744 00000100:00100000:2.0:1788391079.927541:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094063744 00000100:00100000:3.0:1788391079.927620:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:2.0:1788391079.927620:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788391079.927631:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+36:29839:x1875263094064000:12345-192.168.202.1@tcp:101:lfs.0 00000100:00100000:2.0:1788391079.927631:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+36:2357:x1875263094063744:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391079.927645:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391079.927650:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391079.927663:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f1f lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffac2 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.927665:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f11 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffabb expref: 36 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.927679:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391079.927683:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391079.927735:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+36:2357:x1875263094063744:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 107us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.927742:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00010000:00010000:3.0:1788391079.927750:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.927762:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.927771:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391079.927781:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1788391079.927884:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f1f lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac2 expref: 37 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.927897:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac2 expref: 36 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.927905:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391079.927908:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391079.927910:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0a00, rc 0) 00000100:00100000:3.0:1788391079.927947:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+36:29839:x1875263094064000:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 318us (622us total) trans 25769803849 rc 0/0 00000100:00100000:3.0:1788391079.927953:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788391079.931152:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.931216:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064256 00000100:00100000:3.0:1788391079.931223:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064256 00000100:00100000:3.0:1788391079.931294:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788391079.931301:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+36:29839:x1875263094064256:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788391079.931313:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788391079.931340:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd35ee0 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaa6 expref: 36 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.931353:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd35ea1 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa98 expref: 35 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.931360:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391079.931364:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391079.931413:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+34:29839:x1875263094064256:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.931420:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788391079.933205:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391079.933272:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064384 00000100:00100000:2.0:1788391079.933279:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064384 00000100:00100000:2.0:1788391079.933388:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788391079.933399:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+34:29839:x1875263094064384:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:2.0:1788391079.933496:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.933510:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391079.933548:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391079.933822:0:38436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].2, 136 off8464 00000100:00100000:2.0:1788391079.933893:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+34:29839:x1875263094064384:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 497us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391079.933898:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1788391079.935559:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391079.935612:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064512 00000100:00100000:3.0:1788391079.935618:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064512 00000100:00100000:3.0:1788391079.935655:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391079.935661:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+34:29839:x1875263094064512:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391079.935674:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391079.935687:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffac9 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935740:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 2/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935751:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 4/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 35 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935781:0:38437:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935792:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 35 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935801:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391079.935803:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391079.935805:0:38437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 35 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391079.935810:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788391079.935847:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+35:29839:x1875263094064512:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 187us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391079.935851:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00010000:00010000:3.0:1788391080.397123:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391080.909510:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391080.909530:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391080.909568:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:0.0:1788391080.909573:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1788391080.909716:0:38470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:38470:1875263103426432:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391080.909834:0:38470:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391080.912916:0:38470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:38470:1875263103426432:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391080.918883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391080.919066:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064640 00000100:00100000:2.0:1788391080.919077:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064640 00000100:00100000:2.0:1788391080.919154:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1788391080.919165:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+35:29840:x1875263094064640:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391080.919210:0:38435:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391080.919330:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+35:29840:x1875263094064640:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 166us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391080.919338:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00080000:0.0:1788391080.919604:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391080.923978:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.926512:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094064768 00000100:00100000:3.0:1788391080.926536:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094064768 00000100:00100000:2.0:1788391080.926742:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788391080.926753:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+35:29840:x1875263094064768:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788391080.926837:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926853:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926866:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926881:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926903:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926911:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926935:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926945:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.926952:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391080.927012:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788391080.927017:0:38437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391080.927029:0:38437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927040:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927047:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927053:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927059:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.927064:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927079:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927093:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:2.0:1788391080.927096:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391080.927101:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927107:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927121:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927127:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927132:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927137:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.927139:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927144:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927150:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x31298142 (ffff95d68641e500) 00010000:00010000:2.0:1788391080.927153:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391080.927155:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927183:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927199:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927205:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927210:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927215:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.927218:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927224:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927231:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391080.927233:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391080.927235:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.927241:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f50 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391080.927320:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+35:29840:x1875263094064768:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 568us (3548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391080.927328:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391080.934197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.934279:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065024 00000100:00100000:3.0:1788391080.934288:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065024 00000100:00100000:3.0:1788391080.934494:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1788391080.934505:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+35:29840:x1875263094065024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391080.934535:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391080.934554:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffad0 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934664:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/1,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934679:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934691:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391080.934701:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1788391080.934812:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934820:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934827:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934833:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391080.934837:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934844:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934857:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391080.934861:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391080.934866:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934882:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35f5e lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934926:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f57 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffad0 expref: 37 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934937:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:3.0:1788391080.934939:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391080.934943:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffad0 expref: 37 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.934953:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788391080.935035:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+36:29840:x1875263094065024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 532us (848us total) trans 25769803850 rc 301/301 00000100:00100000:3.0:1788391080.935042:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788391080.941539:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.942579:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065152 00000100:00100000:3.0:1788391080.942591:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065152 00000100:00100000:3.0:1788391080.942694:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1788391080.942705:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+36:29840:x1875263094065152:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391080.942743:0:39647:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391080.942888:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+36:29840:x1875263094065152:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 184us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391080.942896:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:2.0:1788391080.949053:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391080.949153:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065408 00000100:00100000:0.0:1788391080.949163:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065408 00000100:00100000:0.0:1788391080.949266:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788391080.949278:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+36:29840:x1875263094065408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391080.949299:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391080.949303:0:38437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391080.949329:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd35e38 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa6e expref: 36 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.949348:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391080.949352:0:38437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391080.949365:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35f6c lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffad7 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391080.949778:0:38437:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa3:0x0], index 0: 0 00010000:00010000:0.0:1788391080.950059:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35f73 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.950073:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35f73 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.950084:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35f73 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.950152:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd35f6c lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffad7 expref: 38 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.950168:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35f73 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffad7 expref: 37 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.950176:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391080.950179:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391080.950182:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a800, rc 0) 00000100:00100000:0.0:1788391080.950236:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+37:29840:x1875263094065408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 960us (1192us total) trans 25769803851 rc 0/0 00000100:00100000:0.0:1788391080.950244:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788391080.955663:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391080.955744:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065536 00000100:00100000:2.0:1788391080.955754:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065536 00000100:00100000:2.0:1788391080.955822:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788391080.955833:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+37:29840:x1875263094065536:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391080.955859:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391080.955880:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffade expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.955945:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.955983:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.955995:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956009:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956016:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956023:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956105:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956111:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956127:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391080.956150:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1788391080.956152:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391080.956164:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956172:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956177:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956181:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956185:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.956187:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956192:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956200:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391080.956202:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391080.956205:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956208:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd35f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956225:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956229:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956232:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956235:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.956237:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956240:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956244:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff95d68641e500) 00010000:00010000:2.0:1788391080.956245:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391080.956246:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956249:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956270:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffade expref: 39 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956291:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffade expref: 38 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.956308:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391080.956310:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391080.956313:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0000, rc 0) 00000100:00100000:2.0:1788391080.956369:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+38:29840:x1875263094065536:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 538us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391080.956376:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391080.966550:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.966688:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065792 00000100:00100000:3.0:1788391080.966698:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065792 00000100:00100000:3.0:1788391080.966772:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391080.966805:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+38:29840:x1875263094065792:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391080.966857:0:38436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391080.966881:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd35f73 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffad7 expref: 38 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.966899:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:3.0:1788391080.966909:0:38436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391080.966930:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.966944:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.966953:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967016:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967024:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967031:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967092:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967098:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967113:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967118:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391080.967122:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967129:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967136:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391080.967139:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391080.967142:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967147:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd35f9d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967156:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967161:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967166:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967169:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391080.967172:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967184:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967190:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x95692653 (ffff95d686a70c00) 00010000:00010000:3.0:1788391080.967192:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391080.967195:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.967200:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd35fa4 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x95692653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391080.967269:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+37:29840:x1875263094065792:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 467us (730us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788391080.967277:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788391080.971138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391080.971225:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094065920 00000100:00100000:2.0:1788391080.971236:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094065920 00000100:00100000:2.0:1788391080.971300:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:2.0:1788391080.971312:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+37:29840:x1875263094065920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391080.971335:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391080.971358:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35fab lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffae5 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971398:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971412:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971425:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971534:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35fab lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 39 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971547:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 38 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.971559:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391080.971561:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391080.971563:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1a00, rc 0) 00000100:00100000:2.0:1788391080.971613:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+38:29840:x1875263094065920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 304us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391080.971620:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788391080.974935:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.975046:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094066176 00000100:00100000:3.0:1788391080.975056:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094066176 00000100:00100000:3.0:1788391080.975104:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788391080.975114:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+38:29840:x1875263094066176:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391080.975198:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.975215:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.975226:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391080.975658:0:38436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].3, 88 off8432 00000004:00080000:3.0:1788391080.975669:0:38436:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898082707371ns, next at 899082704581ns, rc = 0 00000004:00010000:3.0:1788391080.975768:0:38436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002026ce7e reply state 00000000a46babca transno 25769803852 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391080.975777:0:38436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391080.975881:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+40:29840:x1875263094066176:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 767us (963us total) trans 25769803852 rc 0/0 00000100:00100000:3.0:1788391080.975889:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00010000:00010000:2.0:1788391080.979663:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391080.979670:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788391080.979676:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.979684:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.979690:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391080.979695:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.979702:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.979720:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391080.979723:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391080.979728:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.979734:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35fb9 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391080.979810:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094066304 00000100:00100000:3.0:1788391080.979819:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094066304 00000100:00100000:3.0:1788391080.979871:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788391080.979881:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+39:29840:x1875263094066304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391080.979904:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391080.979920:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffaec expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.980010:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 40 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.980024:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 40 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391080.980043:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788391080.980046:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391080.980049:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1400, rc 0) 00000100:00100000:3.0:1788391080.980107:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+40:29840:x1875263094066304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 227us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391080.980115:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391080.983175:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.983263:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094066432 00000100:00100000:3.0:1788391080.983287:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094066432 00000100:00100000:3.0:1788391080.983363:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788391080.983382:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+5:2356:x1875263094066432:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788391080.983383:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391080.983709:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094066432:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 335us (543us total) trans 25769803787 rc 0/0 00000100:00100000:3.0:1788391080.983718:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1788391080.986700:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.986775:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094066688 00000100:00100000:3.0:1788391080.986784:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094066688 00000100:00100000:3.0:1788391080.986841:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1788391080.986852:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+40:29840:x1875263094066688:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391080.987115:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+41:29840:x1875263094066688:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 264us (422us total) trans 25769803853 rc 0/0 00000100:00100000:3.0:1788391080.987124:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391080.990035:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.990160:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094066944 00000100:00100000:3.0:1788391080.990170:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094066944 00000100:00100000:3.0:1788391080.990229:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788391080.990240:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+41:29840:x1875263094066944:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391080.990349:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+41:29840:x1875263094066944:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391080.990356:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788391080.993184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391080.993279:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067072 00000100:00100000:2.0:1788391080.993288:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067072 00000100:00100000:2.0:1788391080.993345:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788391080.993356:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+41:29840:x1875263094067072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391080.993385:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391080.993405:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35fc7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffaf3 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993493:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993504:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993512:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391080.993559:0:38435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391080.993580:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993612:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd35fc7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaf3 expref: 43 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993629:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaf3 expref: 42 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391080.993637:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391080.993650:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788391080.993654:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:2.0:1788391080.993834:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+42:29840:x1875263094067072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 478us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391080.993842:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788391080.995720:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391080.995765:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067200 00000100:00100000:0.0:1788391080.995775:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067200 00000100:00100000:0.0:1788391080.995852:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788391080.995860:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094067200:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391080.995876:0:39225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391080.995892:0:39225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffafa expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391080.995915:0:39225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aea9, blocks: 0x1 00010000:00010000:0.0:1788391080.995929:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=898s v=(0 0) 00010000:00010000:0.0:1788391080.995932:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391080.995943:0:39225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 7 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.995986:0:39225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 7 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391080.996001:0:39225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ac00, rc 0) 00000100:00100000:1.0:1788391080.996093:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+7:2357:x1875263094067200:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 232us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391080.996100:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788391080.998186:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391080.998234:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067456 00000100:00100000:3.0:1788391080.998241:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067456 00000100:00100000:3.0:1788391080.998315:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788391080.998326:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+42:29840:x1875263094067456:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391080.998418:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+42:29840:x1875263094067456:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391080.998441:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788391081.000241:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.000361:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067584 00000100:00100000:3.0:1788391081.000468:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067584 00000100:00100000:3.0:1788391081.000561:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788391081.000572:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+7:29840:x1875263094067584:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391081.000588:0:39118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391081.000606:0:39118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb01 expref: -99 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.000636:0:39118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.000645:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391081.000650:0:39118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391081.000655:0:39118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.000688:0:39118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.000701:0:39118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.000713:0:39118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:39118:1875263103426560:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391081.000784:0:39118:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391081.002761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.002856:0:39118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:39118:1875263103426560:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391081.002884:0:39118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.002899:0:39118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1000, rc 0) 00000100:00100000:3.0:1788391081.002940:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+8:29840:x1875263094067584:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2371us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.002946:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788391081.003139:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067712 00000100:00100000:0.0:1788391081.003144:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067712 00010000:00010000:0.0:1788391081.003167:0:40545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.003189:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391081.003195:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+8:2356:x1875263094067712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391081.003203:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391081.003219:0:40545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.003227:0:40545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.003242:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cefbb6b7/0x9aafc5f04cd35fd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffafa expref: 8 pid: 39225 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.003251:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391081.003254:0:40545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391081.003268:0:40545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.003275:0:40545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.003304:0:40545:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.003316:0:40545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:40545:1875263103426688:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391081.003363:0:40545:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690000 going to sleep for 11 seconds 00000100:00100000:0.0:1788391081.006170:0:40545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:40545:1875263103426688:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391081.006192:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391081.006527:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094067712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3322us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391081.006543:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1788391081.006585:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.008600:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067840 00000100:00100000:0.0:1788391081.008615:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067840 00002000:00100000:0.0:1788391081.008667:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff95d685278000 x1875263094067840/t0(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 1512/0 e 0 to 0 dl 1788391092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391081.008676:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278000 with x1875263094067840 ext(0->1023) 00002000:00010000:0.0:1788391081.008680:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278000 00000100:00100000:0.0:1788391081.008709:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1788391081.008719:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+7:2358:x1875263094067840:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391081.009141:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+9:2358:x1875263094067840:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 423us (2557us total) trans 25769803788 rc 0/0 00000100:00100000:0.0:1788391081.009150:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00002000:00100000:0.0:1788391081.009155:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff95d685278000 x1875263094067840/t25769803788(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 1512/448 e 0 to 0 dl 1788391092 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391081.009160:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278000 with x1875263094067840 ext(0->1023) 00002000:00010000:0.0:1788391081.009162:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278000 00000100:00100000:1.0:1788391081.010922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.010999:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094067968 00000100:00100000:3.0:1788391081.011008:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094067968 00000100:00100000:0.0:1788391081.011101:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788391081.011111:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+42:29840:x1875263094067968:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788391081.029527:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+42:29840:x1875263094067968:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 18398us (18591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391081.029540:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000001:00080000:2.0:1788391081.029642:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803851 is committed 00000001:00080000:2.0:1788391081.029870:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803828 is committed 00000004:00080000:2.0:1788391081.029897:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788391081.029922:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d68451c6c0 refcount 2 committed 0 result 0 batchid 21474836518 00000020:00080000:2.0:1788391081.029927:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a06b7500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68451c780 00000020:00080000:2.0:1788391081.029931:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a06b7e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d585129800 00000020:00080000:2.0:1788391081.029978:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836517 batchid updated 00000001:00080000:2.0:1788391081.029986:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803853 is committed 00000004:00080000:2.0:1788391081.029991:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788391081.030012:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803829 is committed 00000020:00080000:0.0:1788391081.030320:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836518 committed batchid 21474836517 00000020:00080000:0.0:1788391081.030533:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836517 00000100:00100000:2.0:1788391081.030734:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391081.030752:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103426816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788391081.030874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391081.030931:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103426816 00000100:00100000:3.0:1788391081.030940:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103426816 00000100:00100000:3.0:1788391081.031145:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788391081.031155:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103426816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788391081.031179:0:39121:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:163 count 1 00002000:00010000:3.0:1788391081.031212:0:39121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a98aea7, atime: 0x0, ctime: 0x6a98aea7, blocks: 0x1 00010000:00010000:3.0:1788391081.031221:0:39121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.031237:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=898s v=(0 0) 00010000:00010000:3.0:1788391081.031241:0:39121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391081.031245:0:39121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.031257:0:39121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.031279:0:39121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.031284:0:39121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.031297:0:39121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788391081.031682:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391081.031783:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103426944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391081.031893:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.031923:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068096 00000100:00100000:2.0:1788391081.031930:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068096 00000100:00100000:2.0:1788391081.031991:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391081.032000:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+9:2357:x1875263094068096:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788391081.032064:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391081.032105:0:39225:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788391081.032114:0:39225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788391081.032145:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103426816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 991us (1272us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788391081.032153:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788391081.032154:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68a7e5880/2, rc 0, transno 25769803783 00000100:00100000:1.0:1788391081.032161:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103426816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788391081.032169:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103426944 00000100:00100000:3.0:1788391081.032173:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103426944 00000100:00100000:3.0:1788391081.032204:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788391081.032207:0:39118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788391081.032212:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103426944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788391081.032371:0:39121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788391081.032375:0:39121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb mtime from disk: 0 -> 1788391081 00002000:00010000:3.0:1788391081.032378:0:39121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391081.032380:0:39121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb ctime from disk: 1788391081 -> 1788391081 00002000:00010000:3.0:1788391081.032382:0:39121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391081.032616:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103426944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 404us (551us total) trans 25769803789 rc 0/0 00000100:00100000:3.0:1788391081.032623:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1788391081.033801:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391081.033813:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.033838:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391081.033843:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.033854:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.033876:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.033883:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd35fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 39121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.033906:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.033909:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.033911:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788391081.033920:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788391081.034371:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d685279500/2, rc 0, transno 25769803789 00000100:00100000:3.0:1788391081.034380:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103426944:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788391081.064024:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803788 is committed 00000001:00080000:3.0:1788391081.064049:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803786 is committed 00000100:00100000:2.0:1788391081.064250:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094068096:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 32246us (32354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.064262:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391081.073747:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.073839:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068352 00000100:00100000:0.0:1788391081.073848:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068352 00000100:00100000:0.0:1788391081.073907:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788391081.073917:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+16:29840:x1875263094068352:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391081.074008:0:38437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391081.074034:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd35fce lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaf3 expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.074054:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788391081.074058:0:38437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391081.074105:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.074120:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.074129:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391081.074316:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000220270ff reply state 000000009faba733 transno 25769803854 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.074331:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391081.074417:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+17:29840:x1875263094068352:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 501us (678us total) trans 25769803854 rc 0/0 00000100:00100000:0.0:1788391081.074561:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788391081.081104:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.081196:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068480 00000100:00100000:1.0:1788391081.081209:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068480 00000100:00100000:1.0:1788391081.081270:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1788391081.081280:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+6:2358:x1875263094068480:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788391081.081477:0:39118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:1.0:1788391081.081481:0:39118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb mtime from disk: 1788391081 -> 1788391079 00002000:00010000:1.0:1788391081.081484:0:39118:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb atime from disk: 0 -> 1788391079 00002000:00010000:1.0:1788391081.081486:0:39118:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb ctime from disk: 1788391081 -> 1788391079 00002000:00010000:1.0:1788391081.081488:0:39118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788391081.081581:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+7:2358:x1875263094068480:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 302us (485us total) trans 25769803790 rc 0/0 00000100:00100000:1.0:1788391081.081587:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00010000:00010000:3.0:1788391081.082228:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082240:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082265:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082271:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391081.082275:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082283:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082300:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788391081.082303:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391081.082307:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.082313:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd35fea lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.084238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.084318:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068736 00000100:00100000:3.0:1788391081.084327:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068736 00000100:00100000:3.0:1788391081.084382:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:3.0:1788391081.084392:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+16:29840:x1875263094068736:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788391081.084469:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.084485:0:38435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.084495:0:38435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.084552:0:38435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.084566:0:38435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 16 pid: 38435 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.084581:0:38435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:38435:1875263103427072:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391081.084663:0:38435:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391081.087629:0:38435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:38435:1875263103427072:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391081.087661:0:38435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.087783:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.087851:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068864 00000100:00100000:1.0:1788391081.087857:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068864 00010000:00010000:1.0:1788391081.087895:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 17 pid: 38435 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.087927:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1788391081.087936:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+17:2357:x1875263094068864:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391081.087949:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391081.087984:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 17 pid: 38435 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088020:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 17 pid: 38435 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088041:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd35fb2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffae5 expref: 17 pid: 38435 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088056:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788391081.088060:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088067:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088074:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.088103:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391081.088155:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+16:2357:x1875263094068864:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 220us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.088162:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00010000:00010000:2.0:1788391081.088418:0:38435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088426:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088453:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088461:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088467:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088473:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.088478:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088484:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088493:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391081.088496:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391081.088500:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.088527:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0e00/0x9aafc5f04cd35ff1 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.088572:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+15:29840:x1875263094068736:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 4182us (4342us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391081.088581:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788391081.094654:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.094775:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094068992 00000100:00100000:1.0:1788391081.094785:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094068992 00000100:00100000:1.0:1788391081.094876:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788391081.094887:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+7:2359:x1875263094068992:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788391081.094929:0:40764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.094997:0:40764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.095015:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391081.095020:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391081.095026:0:40764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.095061:0:40764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.095076:0:40764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 7 pid: 39118 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.095092:0:40764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:40764:1875263103427200:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391081.095165:0:40764:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391081.098074:0:40764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:40764:1875263103427200:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391081.098102:0:40764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.099281:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.099365:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094069120 00000100:00100000:3.0:1788391081.099374:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094069120 00010000:00010000:3.0:1788391081.099413:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.099455:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1788391081.099466:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094069120:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391081.099480:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391081.099503:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.099528:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.099567:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cec6ccc/0x9aafc5f04cd35fdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb01 expref: 8 pid: 39118 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.099583:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391081.099587:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391081.099592:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.099602:0:38421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.099750:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391081.099774:0:40764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099787:0:40764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099824:0:40764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099833:0:40764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099841:0:40764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.099848:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+7:2357:x1875263094069120:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 381us (571us total) trans 0 rc 0/0 00010000:00010000:1.0:1788391081.099849:0:40764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391081.099855:0:40764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.099862:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00010000:00010000:1.0:1788391081.099863:0:40764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099874:0:40764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.099879:0:40764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd35ff8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.099932:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+6:2359:x1875263094068992:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5042us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.099944:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788391081.106039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.106122:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094069376 00000100:00100000:2.0:1788391081.106132:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094069376 00000100:00100000:2.0:1788391081.106195:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788391081.106205:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+15:29840:x1875263094069376:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391081.106283:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106301:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106312:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106533:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106544:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 16 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106552:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106583:0:38437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 16 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.106611:0:38437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 16 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.106625:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103427328:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391081.106709:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391081.110893:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.111044:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103427328:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391081.111072:0:38437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.114602:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094069504 00000100:00100000:1.0:1788391081.114617:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094069504 00010000:00010000:1.0:1788391081.114664:0:38422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 17 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.114737:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788391081.114748:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+17:2356:x1875263094069504:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391081.114763:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391081.114771:0:38422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 17 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114785:0:38422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 17 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114808:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1400/0x9aafc5f04cd35fc0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffaec expref: 17 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114824:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788391081.114829:0:38422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114838:0:38422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114845:0:38422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.114894:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391081.114976:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+16:2356:x1875263094069504:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 215us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.114984:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00010000:00010000:0.0:1788391081.115041:0:38437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.115049:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391081.115225:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803855 00000001:00080000:0.0:1788391081.115375:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803856 00000100:00100000:0.0:1788391081.115471:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103427456:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391081.115531:0:38437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391081.115564:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69194d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788391081.115590:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103427456 00000100:00100000:2.0:1788391081.115594:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103427456 00000100:00100000:2.0:1788391081.115634:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788391081.115643:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38437:x1875263103427456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391081.115721:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38437:x1875263103427456:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.115727:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391081.117616:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103427456:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788391081.118126:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803857 00000100:00100000:0.0:1788391081.118209:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103427584:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391081.118269:0:38437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391081.118308:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391081.118473:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103427584 00000100:00100000:2.0:1788391081.118480:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103427584 00000100:00100000:2.0:1788391081.118539:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788391081.118549:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:38437:x1875263103427584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391081.118758:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:38437:x1875263103427584:12345-0@lo:1000:mdt00_002.0 Request processed in 210us (489us total) trans 25769803791 rc 0/0 00000100:00100000:2.0:1788391081.118765:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788391081.118850:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:38437:1875263103427584:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788391081.118898:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803858 00000001:00080000:0.0:1788391081.119043:0:38437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803859 00010000:00010000:0.0:1788391081.119073:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119084:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119092:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119098:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.119102:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119110:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119126:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788391081.119129:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391081.119134:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119157:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36006 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119199:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119205:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119210:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119215:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.119217:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119222:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119229:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391081.119231:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391081.119238:0:38437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 20 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119248:0:38437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 20 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119255:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 20 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.119289:0:38437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 20 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.119299:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103427712:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391081.119369:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391081.122993:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103427712:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391081.123023:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123034:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd35f34 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123066:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123080:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123090:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123100:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123107:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123112:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123141:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.123145:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123152:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123163:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391081.123166:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391081.123169:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123175:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3600d lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123186:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123191:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123196:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123201:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.123203:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123208:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 4/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123226:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391081.123228:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391081.123231:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 2/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.123237:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd35fff lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391081.123640:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788391081.123646:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391081.123675:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1788391081.123681:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788391081.124101:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.124292:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094069632 00000100:00100000:3.0:1788391081.124299:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094069632 00000100:00100000:3.0:1788391081.124347:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788391081.124358:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+21:29839:x1875263094069632:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:3.0:1788391081.124621:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+21:29839:x1875263094069632:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 263us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.124629:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788391081.129636:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+20:29840:x1875263094069376:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 23419us (23594us total) trans 25769803860 rc 0/0 00000100:00100000:0.0:1788391081.129652:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000020:00080000:0.0:1788391081.129660:0:38437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1788391081.131058:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.131136:0:39120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094069760 00000100:00100000:1.0:1788391081.131146:0:39120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094069760 00000100:00100000:1.0:1788391081.131193:0:39120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788391081.131202:0:39120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+6:29839:x1875263094069760:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391081.131220:0:39120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391081.131239:0:39120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb08 expref: -99 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391081.131267:0:39120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a98aea7, atime: 0x6a98aea7, ctime: 0x6a98aea7, blocks: 0xb 00010000:00010000:1.0:1788391081.131286:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=898s v=(0 0) 00010000:00010000:1.0:1788391081.131291:0:39120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391081.131300:0:39120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 7 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.131316:0:39120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 7 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.131328:0:39120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7e00, rc 0) 00000100:00100000:1.0:1788391081.131393:0:39120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27474853-4920-4406-9272-38eff2ad2609+7:29839:x1875263094069760:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 192us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.131411:0:39120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788391081.136412:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.136467:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.136572:0:39126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070144 00000100:00100000:1.0:1788391081.136582:0:39126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070144 00002000:00100000:1.0:1788391081.136634:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff95d68a7e6680 x1875263094070144/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 488/0 e 0 to 0 dl 1788391092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391081.136644:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6680 with x1875263094070144 ext(0->4095) 00002000:00010000:1.0:1788391081.136651:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6680 00000100:00100000:1.0:1788391081.136687:0:39126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788391081.136697:0:39126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094070144:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391081.136890:0:39126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094070144:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 193us (421us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788391081.136898:0:39126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00002000:00100000:1.0:1788391081.136904:0:39126:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff95d68a7e6680 x1875263094070144/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 488/4536 e 0 to 0 dl 1788391092 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391081.136912:0:39126:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6680 with x1875263094070144 ext(0->4095) 00002000:00010000:1.0:1788391081.136915:0:39126:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6680 00000100:00100000:0.0:1788391081.136993:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070016 00000100:00100000:0.0:1788391081.136998:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070016 00000100:00100000:0.0:1788391081.137033:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788391081.137041:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+20:29840:x1875263094070016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788391081.137647:0:38438:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788391081.137761:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803861 00010000:00010000:0.0:1788391081.137808:0:38438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137824:0:38438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137835:0:38438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137843:0:38438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137856:0:38438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137861:0:38438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.137876:0:38438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788391081.137949:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+22:29840:x1875263094070016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 907us (1545us total) trans 25769803862 rc 0/0 00000100:00100000:0.0:1788391081.137957:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000020:00080000:0.0:1788391081.137984:0:38438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788391081.138630:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391081.138638:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.138645:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79be00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391081.138649:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.138656:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.138670:0:38423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff95d6a0d59100) 00010000:00010000:3.0:1788391081.138672:0:38423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391081.138677:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.138682:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd3601b lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.138699:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.138701:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.138702:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391081.149756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.149834:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070272 00000100:00100000:2.0:1788391081.149859:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070272 00000100:00100000:2.0:1788391081.149917:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1788391081.149928:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+7:2358:x1875263094070272:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1788391081.150006:0:39225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.150029:0:39225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 7 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.150037:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391081.150041:0:39225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391081.150046:0:39225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.150082:0:39225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 7 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.150095:0:39225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 7 pid: 39120 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.150109:0:39225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:39225:1875263103427840:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391081.150179:0:39225:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391081.154769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.154867:0:39225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:39225:1875263103427840:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391081.154895:0:39225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.154994:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070400 00000100:00100000:3.0:1788391081.155002:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070400 00010000:00010000:3.0:1788391081.155039:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 8 pid: 39120 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.155080:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788391081.155090:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+8:2356:x1875263094070400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391081.155107:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391081.155139:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 8 pid: 39120 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.155154:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 8 pid: 39120 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.155179:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e01d751d/0x9aafc5f04cd36014 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb08 expref: 8 pid: 39120 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.155195:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391081.155200:0:38421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391081.155206:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.155216:0:38421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.155243:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391081.155394:0:39225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155404:0:39225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155435:0:39225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155445:0:39225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155454:0:39225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155462:0:39225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391081.155467:0:39225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155475:0:39225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155485:0:39225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.155503:0:39225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 39225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.155578:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+7:2356:x1875263094070400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 488us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.155586:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391081.159197:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27474853-4920-4406-9272-38eff2ad2609+6:2358:x1875263094070272:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 9257us (9436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.159211:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391081.166318:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.166414:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070656 00000100:00100000:2.0:1788391081.166434:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070656 00000100:00100000:2.0:1788391081.166640:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788391081.166652:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+22:29839:x1875263094070656:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1788391081.166716:0:38438:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac2 expref: 22 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391081.166946:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803863 00000001:00080000:2.0:1788391081.167295:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803864 00010000:00010000:2.0:1788391081.167347:0:38438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.167362:0:38438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 25 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.167370:0:38438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 4/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.167406:0:38438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 25 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.167449:0:38438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 25 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.167465:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103427968:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391081.167565:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391081.171586:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:38438:1875263103427968:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391081.171616:0:38438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.172826:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.172892:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070784 00000100:00100000:3.0:1788391081.172898:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070784 00010000:00010000:3.0:1788391081.172934:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 26 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.173009:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788391081.173019:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+26:2356:x1875263094070784:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391081.173048:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391081.173056:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 26 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173069:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 26 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173089:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd35f3b lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac9 expref: 26 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173108:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391081.173113:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173122:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173129:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.173161:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391081.173208:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+25:2356:x1875263094070784:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (387us total) trans 0 rc 0/0 00010000:00010000:2.0:1788391081.173214:0:38438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.173215:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00010000:00010000:2.0:1788391081.173221:0:38438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391081.173340:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803865 00000001:00080000:2.0:1788391081.173570:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803866 00000001:00080000:2.0:1788391081.173623:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803867 00000100:00100000:2.0:1788391081.173706:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103428096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788391081.173751:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391081.174164:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bca923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391081.178607:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428096 00000100:00100000:3.0:1788391081.178622:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428096 00000100:00100000:3.0:1788391081.178676:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788391081.178685:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:38438:x1875263103428096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788391081.178800:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:38438:x1875263103428096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.178819:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391081.178979:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103428096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788391081.179452:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803868 00000100:00100000:2.0:1788391081.179544:0:38438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103428224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788391081.179585:0:38438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391081.179616:0:38438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391081.180026:0:38440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428224 00000100:00100000:3.0:1788391081.180031:0:38440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428224 00000100:00100000:3.0:1788391081.180059:0:38440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391081.180067:0:38440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:38438:x1875263103428224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788391081.180226:0:38440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:38438:x1875263103428224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (640us total) trans 25769803792 rc 0/0 00000100:00100000:3.0:1788391081.180233:0:38440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391081.180494:0:38438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:38438:1875263103428224:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1788391081.180538:0:38438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180550:0:38438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180559:0:38438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180565:0:38438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.180569:0:38438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180577:0:38438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180592:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391081.180595:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788391081.180599:0:38438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.180605:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36029 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391081.180852:0:38438:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788391081.180950:0:38438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].4, 64 off8496 00000001:00080000:2.0:1788391081.180984:0:38438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803869 00010000:00010000:2.0:1788391081.181029:0:38438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391081.181032:0:38438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788391081.181039:0:38438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0a00/0x9aafc5f04cd35f26 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffac2 expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.181160:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+28:29839:x1875263094070656:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 14510us (14850us total) trans 25769803870 rc 0/0 00000100:00100000:2.0:1788391081.181837:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000020:00080000:2.0:1788391081.181843:0:38438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1788391081.186036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.186144:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094070912 00000100:00100000:2.0:1788391081.186154:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094070912 00000100:00100000:2.0:1788391081.186248:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:2.0:1788391081.186260:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+28:29839:x1875263094070912:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.186284:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.186306:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36030 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb0f expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.186366:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36030 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb0f expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.186382:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36030 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb0f expref: 29 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.186401:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.186404:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391081.186408:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:2.0:1788391081.186478:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+29:29839:x1875263094070912:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 210us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.186485:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1788391081.193958:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.194153:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094071168 00000100:00100000:3.0:1788391081.194173:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094071168 00000100:00100000:3.0:1788391081.194236:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788391081.194246:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+29:29839:x1875263094071168:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391081.194548:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+30:29839:x1875263094071168:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 302us (598us total) trans 25769803871 rc 0/0 00000100:00100000:3.0:1788391081.194556:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788391081.260236:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.260319:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094071424 00000100:00100000:3.0:1788391081.260329:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094071424 00000100:00100000:3.0:1788391081.260387:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1788391081.260397:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+30:29850:x1875263094071424:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391081.260421:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391081.260446:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd36037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb16 expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391081.260546:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1788391081.260658:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd36037 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb16 expref: 32 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.260688:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788391081.260691:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391081.260696:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0600/0x9aafc5f04cd36037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb16 expref: 32 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.260712:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:3.0:1788391081.260783:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+31:29850:x1875263094071424:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 372us (543us total) trans 25769803872 rc 301/301 00000100:00100000:3.0:1788391081.260790:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391081.264607:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.264742:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094071552 00000100:00100000:3.0:1788391081.264754:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094071552 00000100:00100000:3.0:1788391081.264864:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788391081.264878:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+31:29850:x1875263094071552:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788391081.265007:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265023:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265035:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265052:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265059:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265086:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265391:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265400:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265407:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391081.265597:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265610:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265617:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265636:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265642:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391081.265646:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265653:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265666:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391081.265675:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391081.265679:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265686:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1000/0x9aafc5f04cd36045 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265699:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265704:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265709:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265713:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391081.265715:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265720:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265726:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d686a70c00) 00010000:00010000:3.0:1788391081.265728:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391081.265730:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265735:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd3604c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265747:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265757:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265762:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265767:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391081.265769:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265774:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265780:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788391081.265782:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391081.265784:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.265790:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd36053 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.265912:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+31:29850:x1875263094071552:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1036us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.265922:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1788391081.269332:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.269488:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094071808 00000100:00100000:3.0:1788391081.269498:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094071808 00000100:00100000:3.0:1788391081.269572:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788391081.269584:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+31:29850:x1875263094071808:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391081.269842:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+32:29850:x1875263094071808:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 259us (518us total) trans 25769803873 rc 0/0 00000100:00100000:3.0:1788391081.269860:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391081.350063:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.350254:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094071936 00000100:00100000:3.0:1788391081.350266:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094071936 00000100:00100000:3.0:1788391081.350333:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788391081.350350:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+32:29856:x1875263094071936:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391081.350376:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391081.350398:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3605a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb1d expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350487:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350500:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350524:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391081.350569:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:3.0:1788391081.350573:0:38436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391081.350591:0:38436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350617:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd3605a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb1d expref: 34 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350634:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb1d expref: 33 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.350661:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391081.350664:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391081.350667:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1c00, rc 0) 00000100:00100000:3.0:1788391081.350734:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+33:29856:x1875263094071936:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 392us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.350742:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1788391081.354096:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.354411:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094072064 00000100:00100000:2.0:1788391081.354421:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094072064 00000100:00100000:2.0:1788391081.354499:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788391081.354510:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+33:29856:x1875263094072064:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.354543:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.354564:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36068 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb24 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354632:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354647:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354657:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354670:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354676:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.354682:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355000:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355010:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355017:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.355061:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788391081.355065:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391081.355084:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355096:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355104:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355111:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355195:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355201:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.355205:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355212:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355226:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391081.355229:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.355233:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355239:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd3606f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355261:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355267:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355273:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355284:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.355287:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355293:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355301:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e200) 00010000:00010000:2.0:1788391081.355304:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.355306:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355312:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36076 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355344:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36068 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 35 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355357:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 34 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.355375:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.355377:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391081.355379:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:2.0:1788391081.355451:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+34:29856:x1875263094072064:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 942us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.355459:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1788391081.358645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.358739:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094072320 00000100:00100000:0.0:1788391081.358748:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094072320 00000100:00100000:0.0:1788391081.358856:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1788391081.358868:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+34:29856:x1875263094072320:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391081.358889:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391081.358919:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd36084 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb2b expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.359056:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.359086:0:38437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 35 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.359094:0:38437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 4/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.359145:0:38437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 35 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.359159:0:38437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 35 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.359173:0:38437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103428352:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391081.359264:0:38437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391081.362708:0:38437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:38437:1875263103428352:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391081.362739:0:38437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.363203:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.363281:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094072448 00000100:00100000:3.0:1788391081.363291:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094072448 00010000:00010000:3.0:1788391081.363331:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 36 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.363371:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788391081.363381:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+36:2356:x1875263094072448:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391081.363394:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391081.363401:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 36 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363414:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 36 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363436:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3607d lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb24 expref: 36 pid: 39647 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363451:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788391081.363456:0:38421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363478:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363485:0:38421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.363509:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391081.363573:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+35:2356:x1875263094072448:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.363580:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00010000:00010000:2.0:1788391081.363909:0:38437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.363916:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.363932:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1788391081.364080:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b000/0x9aafc5f04cd36084 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 36 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.364090:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 35 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.364096:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.364098:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391081.364100:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:2.0:1788391081.364165:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+35:29856:x1875263094072320:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 5300us (5531us total) trans 25769803874 rc 0/0 00000100:00100000:2.0:1788391081.364178:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00010000:00010000:3.0:1788391081.421116:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391081.421171:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103428608:0@lo:400:kworker.0 00000100:00100000:3.0:1788391081.421188:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103428736:0@lo:400:kworker.0 00000100:00100000:0.0:1788391081.421245:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391081.421289:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103428480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391081.421293:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103428864:0@lo:400:kworker.0 00000100:00100000:3.0:1788391081.421662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391081.421721:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428608 00000100:00100000:3.0:1788391081.421729:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428608 00000100:00100000:3.0:1788391081.421775:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788391081.421785:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103428608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391081.421832:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103428608:12345-0@lo:400:kworker.0 Request processed in 48us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.421838:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788391081.421876:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428736 00000100:00100000:3.0:1788391081.421881:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428736 00000100:00100000:3.0:1788391081.421904:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788391081.421910:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103428736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391081.422398:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103428608:0@lo:400:kworker.0 00000100:00100000:3.0:1788391081.422654:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103428736:12345-0@lo:400:kworker.0 Request processed in 742us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.422661:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788391081.422702:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103428736:0@lo:400:kworker.0 00000100:00100000:2.0:1788391081.423287:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391081.423287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391081.423313:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103428992:0@lo:400:kworker.0 00000100:00100000:1.0:1788391081.423330:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428864 00000100:00100000:1.0:1788391081.423335:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428864 00000100:00100000:2.0:1788391081.423336:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391081.423381:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788391081.423390:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103428864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391081.423443:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428480 00000100:00100000:2.0:1788391081.423446:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428480 00000100:00100000:2.0:1788391081.423474:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788391081.423481:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103428480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391081.423506:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788391081.423672:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103428480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.423680:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788391081.423715:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103428480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391081.423734:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103428992 00000100:00100000:2.0:1788391081.423737:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103428992 00000100:00100000:2.0:1788391081.423759:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788391081.423765:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103428992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391081.423796:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103428992:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.423802:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788391081.423823:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103428992:0@lo:400:kworker.0 00000100:00080000:2.0:1788391081.423849:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391081.424605:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103428864:12345-0@lo:400:kworker.0 Request processed in 1213us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.424613:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788391081.427956:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103428864:0@lo:400:kworker.0 00000001:00080000:1.0:1788391081.449075:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803781 is committed 00000001:00080000:1.0:1788391081.449095:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803782 is committed 00000001:00080000:1.0:1788391081.449101:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803783 is committed 00000100:00100000:1.0:1788391081.449166:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.449356:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094072704 00000100:00100000:2.0:1788391081.449377:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094072704 00000100:00100000:2.0:1788391081.449532:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788391081.449543:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+35:29866:x1875263094072704:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.449567:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.449587:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb32 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.449674:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:2.0:1788391081.449781:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36099 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb32 expref: 37 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.449795:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391081.449798:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391081.449803:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb32 expref: 37 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.449815:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:2.0:1788391081.449879:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+36:29866:x1875263094072704:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 337us (717us total) trans 25769803875 rc 301/301 00000100:00100000:2.0:1788391081.449885:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788391081.452845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.452901:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094072832 00000100:00100000:2.0:1788391081.452910:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094072832 00000100:00100000:2.0:1788391081.452953:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:2.0:1788391081.452981:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+36:29866:x1875263094072832:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391081.453042:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453054:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453073:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453083:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453087:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453091:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453307:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453313:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453318:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391081.453352:0:38435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453363:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453379:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453385:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453402:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.453406:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453413:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453424:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391081.453427:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.453432:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453439:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360a7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453450:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453455:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453461:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453466:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.453468:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453475:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453492:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:2.0:1788391081.453495:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.453498:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453503:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360ae lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453525:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453532:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453537:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453542:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.453545:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453551:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453558:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.453560:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.453563:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.453568:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360b5 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.453657:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+36:29866:x1875263094072832:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 695us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.453664:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:1.0:1788391081.455897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.456033:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094073088 00000100:00100000:3.0:1788391081.456043:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094073088 00000100:00100000:3.0:1788391081.456095:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788391081.456105:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+36:29866:x1875263094073088:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391081.456954:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+37:29866:x1875263094073088:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 846us (1061us total) trans 25769803876 rc 0/0 00000100:00100000:3.0:1788391081.456996:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788391081.476478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.476588:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094073216 00000100:00100000:2.0:1788391081.476600:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094073216 00000100:00100000:2.0:1788391081.476667:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1788391081.476679:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+37:29867:x1875263094073216:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788391081.476705:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.476727:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360bc lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb39 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476791:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476806:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476817:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476831:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476838:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.476844:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.477128:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.477136:0:39647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 2/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 38 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.477141:0:39647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 4/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.477169:0:39647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 38 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.477181:0:39647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 38 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.477194:0:39647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103429120:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391081.477270:0:39647:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6833890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391081.480194:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.480269:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094073472 00000100:00100000:3.0:1788391081.480277:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094073472 00000100:00100000:3.0:1788391081.480330:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1788391081.480340:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+39:29148:x1875263094073472:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788391081.480662:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+40:29148:x1875263094073472:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 322us (476us total) trans 25769803877 rc 0/0 00000100:00100000:3.0:1788391081.480670:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788391081.482341:0:39647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:39647:1875263103429120:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391081.482468:0:39647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.486690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.486757:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094073600 00000100:00100000:3.0:1788391081.486766:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094073600 00010000:00010000:3.0:1788391081.486799:0:38420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 40 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.486854:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788391081.486862:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+40:2356:x1875263094073600:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391081.486874:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391081.486891:0:38420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 40 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.486901:0:38420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 40 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.486918:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3608b lrc: 0/0,0 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb2b expref: 40 pid: 38437 timeout: 998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.486929:0:38420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:3.0:1788391081.486933:0:38420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.486940:0:38420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.486945:0:38420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 4/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.487074:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391081.487118:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27474853-4920-4406-9272-38eff2ad2609+39:2356:x1875263094073600:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 257us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391081.487122:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00010000:00010000:2.0:1788391081.487209:0:39647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487214:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.487251:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788391081.487259:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391081.487278:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487288:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487295:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487299:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487303:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487306:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.487309:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487314:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487320:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391081.487321:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.487324:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487328:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd360c3 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487334:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487799:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487806:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487812:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.487815:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487823:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487832:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:2.0:1788391081.487835:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.487838:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487844:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360ca lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487881:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360bc lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb39 expref: 39 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487896:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb39 expref: 38 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.487903:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.487905:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391081.487913:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:2.0:1788391081.487950:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+38:29867:x1875263094073216:12345-192.168.202.1@tcp:101:rm.0 Request processed in 11273us (11483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.487957:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:0.0:1788391081.490886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.491927:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094073856 00000100:00100000:2.0:1788391081.491939:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094073856 00000100:00100000:2.0:1788391081.492007:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1788391081.492017:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+38:29867:x1875263094073856:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788391081.492074:0:38435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788391081.492096:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd360d1 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb39 expref: 38 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492113:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36030 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb0f expref: 37 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492122:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641eb00) 00010000:00010000:2.0:1788391081.492133:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd36061 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb1d expref: 36 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492138:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391081.492140:0:38435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391081.492158:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492168:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492178:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492211:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492219:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492226:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492881:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492889:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.492894:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493636:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493647:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493656:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493663:0:38435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493670:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493684:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493722:0:38435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391081.493744:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493759:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493766:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493771:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.493775:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493783:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493795:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:2.0:1788391081.493799:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391081.493803:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493809:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd360e6 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493810:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391081.493820:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493830:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391081.493832:0:38435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493835:0:38423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493845:0:38435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493867:0:38435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493871:0:38423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493876:0:38435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.493883:0:38435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493888:0:38423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:2.0:1788391081.493892:0:38435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493894:0:38423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391081.493900:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 1/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493906:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391081.493908:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd360ed lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493912:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.493917:0:38435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.493925:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd360d8 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391081.493929:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.493933:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391081.493935:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788391081.493938:0:38435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8f076b0 reply state 00000000e694db83 transno 25769803878 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391081.493948:0:38435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391081.494074:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+37:29867:x1875263094073856:12345-192.168.202.1@tcp:36:rm.0 Request processed in 2055us (3192us total) trans 25769803878 rc 0/0 00000100:00100000:2.0:1788391081.494083:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00010000:00010000:2.0:1788391081.496353:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496369:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496394:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496399:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.496404:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496411:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496426:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e200) 00010000:00010000:2.0:1788391081.496428:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.496433:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.496438:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd360df lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.502148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.502224:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094074112 00000100:00100000:2.0:1788391081.502232:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094074112 00000100:00100000:2.0:1788391081.502275:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:2.0:1788391081.502281:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+36:29617:x1875263094074112:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391081.502302:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.502317:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360f4 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb40 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502426:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502458:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502468:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502483:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502489:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.502495:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391081.503478:0:38437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa4:0x0], index 1: 0 00010000:00010000:0.0:1788391081.503655:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd36109 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503667:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd36109 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503683:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd36109 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503715:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503722:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503729:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503735:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.503739:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503747:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503758:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391081.503760:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391081.503764:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503771:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd360fb lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391081.503783:0:38437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d24f5703 reply state 000000004ba55839 transno 25769803879 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.503791:0:38437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391081.503823:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd360f4 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb40 expref: 39 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503837:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd36109 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb40 expref: 38 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.503844:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:0.0:1788391081.503846:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391081.503848:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79be00, rc 0) 00000100:00100000:0.0:1788391081.503918:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+39:29617:x1875263094074112:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1635us (1776us total) trans 25769803879 rc 0/0 00000100:00100000:0.0:1788391081.503926:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00010000:00010000:0.0:1788391081.510632:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510649:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510657:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510663:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391081.510668:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510676:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510692:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e500) 00010000:00010000:0.0:1788391081.510695:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391081.510712:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.510718:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0c00/0x9aafc5f04cd36102 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391081.510769:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.510846:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094074240 00000100:00100000:0.0:1788391081.510855:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094074240 00000100:00100000:0.0:1788391081.510918:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788391081.510927:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+5:29617:x1875263094074240:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391081.510942:0:40764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391081.510972:0:40764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022237995/0x9aafc5f04cd36117 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb47 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391081.510996:0:40764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391081.511015:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=898s v=(0 0) 00010000:00010000:0.0:1788391081.511019:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391081.511027:0:40764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022237995/0x9aafc5f04cd36117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb47 expref: 6 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.511041:0:40764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022237995/0x9aafc5f04cd36117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb47 expref: 6 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.511052:0:40764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ba00, rc 0) 00000100:00100000:0.0:1788391081.511110:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+6:29617:x1875263094074240:12345-192.168.202.1@tcp:101:bash.0 Request processed in 184us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391081.511116:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00080000:2.0:1788391081.512125:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391081.516464:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.516644:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094074496 00000100:00100000:2.0:1788391081.516654:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094074496 00000100:00100000:2.0:1788391081.516716:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391081.516727:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+38:29617:x1875263094074496:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788391081.517113:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+39:29617:x1875263094074496:12345-192.168.202.1@tcp:35:bash.0 Request processed in 386us (658us total) trans 25769803880 rc 0/0 00000100:00100000:2.0:1788391081.517121:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391081.569375:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.569522:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094074624 00000100:00100000:1.0:1788391081.569530:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094074624 00000100:00100000:1.0:1788391081.569593:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:1.0:1788391081.569605:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+39:29873:x1875263094074624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391081.569629:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391081.569648:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3611e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb4e expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569714:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569725:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569733:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391081.569811:0:38436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:1.0:1788391081.569826:0:38436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391081.569841:0:38436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569861:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3611e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb4e expref: 41 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569873:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb4e expref: 40 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.569878:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391081.569880:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391081.569883:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7c00, rc 0) 00000100:00100000:1.0:1788391081.570019:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+40:29873:x1875263094074624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 416us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.570026:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788391081.574407:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.574771:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094074880 00000100:00100000:2.0:1788391081.574781:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094074880 00000100:00100000:2.0:1788391081.574890:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788391081.574901:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+40:29873:x1875263094074880:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.574922:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.574955:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3612c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb55 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.575099:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd36133 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.575112:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd36133 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.575123:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd36133 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.575134:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1788391081.575255:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3612c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb55 expref: 43 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.575272:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd36133 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb55 expref: 42 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.575280:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:2.0:1788391081.575283:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788391081.575287:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1200, rc 0) 00000100:00100000:2.0:1788391081.575348:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+42:29873:x1875263094074880:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 449us (950us total) trans 25769803881 rc 0/0 00000100:00100000:2.0:1788391081.575355:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:3.0:1788391081.579298:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.579403:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094075136 00000100:00100000:1.0:1788391081.579417:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094075136 00000100:00100000:1.0:1788391081.579473:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1788391081.579484:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+42:29873:x1875263094075136:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391081.579509:0:38436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391081.579523:0:38436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788391081.579549:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1200/0x9aafc5f04cd36133 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb55 expref: 42 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579574:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79be00/0x9aafc5f04cd36109 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb40 expref: 41 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579602:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d6a0d59300) 00010000:00010000:1.0:1788391081.579612:0:38436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391081.579631:0:38436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36141 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb5c expref: -99 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579671:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579684:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579694:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579706:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579712:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579724:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579729:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391081.579732:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579739:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579764:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391081.579767:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391081.579771:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579778:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36148 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579801:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 3/0,1 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579809:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.579815:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.580150:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb5c expref: 43 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.580160:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391081.580163:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391081.580174:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36141 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb5c expref: 43 pid: 38436 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.580189:0:38436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb5c expref: 42 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.580247:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391081.580255:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391081.580263:0:38436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7400, rc 0) 00000100:00100000:1.0:1788391081.580443:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+42:29873:x1875263094075136:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 960us (1154us total) trans 25769803882 rc 0/0 00000100:00100000:1.0:1788391081.580451:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1788391081.583712:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.583812:0:39124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094075264 00000100:00100000:0.0:1788391081.583831:0:39124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094075264 00002000:00100000:0.0:1788391081.583879:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa4:0x0] (0->10) req@ffff95d68a7e7800 x1875263094075264/t0(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 504/0 e 0 to 0 dl 1788391092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391081.583889:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7800 with x1875263094075264 ext(0->10) 00002000:00010000:0.0:1788391081.583900:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7800 00000100:00100000:0.0:1788391081.583930:0:39124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788391081.583940:0:39124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+6:2356:x1875263094075264:12345-192.168.202.1@tcp:4:bash.0 00000100:00100000:0.0:1788391081.584606:0:39124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27474853-4920-4406-9272-38eff2ad2609+8:2356:x1875263094075264:12345-192.168.202.1@tcp:4:bash.0 Request processed in 666us (899us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1788391081.584613:0:39124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00002000:00100000:0.0:1788391081.584618:0:39124:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa4:0x0] (0->10) req@ffff95d68a7e7800 x1875263094075264/t25769803784(0) o4->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 504/448 e 0 to 0 dl 1788391092 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391081.584624:0:39124:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7800 with x1875263094075264 ext(0->10) 00002000:00010000:0.0:1788391081.584626:0:39124:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7800 00000100:00100000:3.0:1788391081.590754:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.590845:0:39125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094075392 00000100:00100000:2.0:1788391081.590863:0:39125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094075392 00002000:00100000:2.0:1788391081.590908:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa4:0x0] (0->4095) req@ffff95d68a7e6300 x1875263094075392/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 488/0 e 0 to 0 dl 1788391092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391081.590919:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6300 with x1875263094075392 ext(0->4095) 00002000:00010000:2.0:1788391081.590938:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e6300 00000100:00100000:2.0:1788391081.591095:0:39125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391081.591105:0:39125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094075392:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391081.591287:0:39125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094075392:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 183us (542us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788391081.591294:0:39125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00002000:00100000:2.0:1788391081.591300:0:39125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa4:0x0] (0->4095) req@ffff95d68a7e6300 x1875263094075392/t0(0) o3->27474853-4920-4406-9272-38eff2ad2609@192.168.202.1@tcp:697/0 lens 488/4536 e 0 to 0 dl 1788391092 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391081.591307:0:39125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6300 with x1875263094075392 ext(0->4095) 00002000:00010000:2.0:1788391081.591310:0:39125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e6300 00000100:00100000:3.0:1788391081.595391:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.595813:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094075648 00000100:00100000:2.0:1788391081.595823:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094075648 00000100:00100000:2.0:1788391081.596207:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391081.597090:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+42:29873:x1875263094075648:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391081.597374:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+43:29873:x1875263094075648:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 1147us (1982us total) trans 25769803883 rc 0/0 00000100:00100000:3.0:1788391081.599593:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391081.661561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391081.661667:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094075904 00000100:00100000:0.0:1788391081.661678:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094075904 00000100:00100000:0.0:1788391081.661741:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788391081.661753:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+43:29883:x1875263094075904:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391081.661781:0:38437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391081.661802:0:38437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb63 expref: -99 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.661899:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd3615d lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.661914:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd3615d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.661940:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd3615d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391081.661953:0:38437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:0.0:1788391081.662101:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb63 expref: 46 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.662122:0:38437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd3615d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb63 expref: 45 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391081.662130:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391081.662133:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391081.662137:0:38437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a800, rc 0) 00000100:00100000:0.0:1788391081.662201:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+45:29883:x1875263094075904:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 451us (649us total) trans 25769803884 rc 0/0 00000100:00100000:0.0:1788391081.662208:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788391081.667783:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.667859:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094076032 00000100:00100000:1.0:1788391081.667868:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094076032 00000100:00100000:1.0:1788391081.667922:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788391081.667932:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+45:29883:x1875263094076032:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391081.668042:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668060:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668073:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668088:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668096:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668102:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668194:0:38436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668202:0:38436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668222:0:38436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391081.668260:0:38436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668270:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668274:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668279:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668282:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391081.668285:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668289:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668297:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391081.668299:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391081.668301:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668305:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3616b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668313:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668321:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668324:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668327:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391081.668329:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668332:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668336:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d692d30700) 00010000:00010000:1.0:1788391081.668337:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391081.668339:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668342:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36172 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668350:0:38436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668354:0:38436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668357:0:38436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668360:0:38436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391081.668375:0:38436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668379:0:38436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668384:0:38436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391081.668385:0:38436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391081.668386:0:38436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.668390:0:38436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36179 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 38436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391081.668451:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+45:29883:x1875263094076032:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 521us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.668456:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788391081.728578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.728662:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094076160 00000100:00100000:2.0:1788391081.728672:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094076160 00000100:00100000:2.0:1788391081.728738:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391081.728750:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+45:29889:x1875263094076160:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.728770:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.728790:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36180 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb6a expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728880:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728895:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728906:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728928:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728936:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.728942:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729059:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729066:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729072:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.729106:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00000004:00200000:2.0:1788391081.729111:0:39647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391081.729128:0:39647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729139:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729146:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729152:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729167:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729173:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.729177:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729185:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729197:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391081.729200:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.729205:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729210:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36187 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729223:0:39647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729228:0:39647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729233:0:39647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729237:0:39647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391081.729239:0:39647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729253:0:39647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729261:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e200) 00010000:00010000:2.0:1788391081.729264:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391081.729267:0:39647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729272:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3618e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729302:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36180 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 47 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729331:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 46 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.729338:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:2.0:1788391081.729340:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391081.729343:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:2.0:1788391081.729410:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+46:29889:x1875263094076160:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 662us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.729417:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1788391081.733945:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.734019:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094076416 00000100:00100000:2.0:1788391081.734030:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094076416 00000100:00100000:2.0:1788391081.734092:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1788391081.734102:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+46:29889:x1875263094076416:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.734138:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.734158:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3619c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb71 expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.734259:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361a3 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.734274:0:38435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.734286:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.734298:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1788391081.734423:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3619c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb71 expref: 49 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.734443:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361a3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb71 expref: 48 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.734452:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:2.0:1788391081.734455:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391081.734458:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1000, rc 0) 00000100:00100000:2.0:1788391081.734525:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+48:29889:x1875263094076416:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 424us (590us total) trans 25769803885 rc 0/0 00000100:00100000:2.0:1788391081.734533:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788391081.742752:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391081.742848:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.742954:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094076800 00000100:00100000:0.0:1788391081.742954:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094076672 00000100:00100000:2.0:1788391081.742985:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094076800 00000100:00100000:0.0:1788391081.743042:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094076672 00000100:00100000:2.0:1788391081.743048:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391081.743072:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+49:2356:x1875263094076800:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391081.743086:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391081.743111:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361a3 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb71 expref: 49 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391081.743114:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391081.743125:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+48:29889:x1875263094076672:12345-192.168.202.1@tcp:35:lfs.0 00010000:00010000:2.0:1788391081.743133:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:2.0:1788391081.743139:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391081.743192:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+48:2356:x1875263094076800:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 123us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391081.743199:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1788391081.743373:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+48:29889:x1875263094076672:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 249us (628us total) trans 25769803886 rc 0/0 00000100:00100000:0.0:1788391081.743380:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788391081.881544:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.881607:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077056 00000100:00100000:2.0:1788391081.881618:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077056 00000100:00100000:2.0:1788391081.881739:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:2.0:1788391081.881751:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+48:29905:x1875263094077056:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391081.881788:0:39647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391081.881808:0:39647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361b1 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb78 expref: -99 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.881912:0:39647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd361b8 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.881926:0:39647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd361b8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.881938:0:39647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd361b8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391081.881949:0:39647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1788391081.882109:0:39647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd361b1 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb78 expref: 51 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.882126:0:39647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd361b8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb78 expref: 50 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391081.882135:0:39647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:2.0:1788391081.882138:0:39647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391081.882141:0:39647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:2.0:1788391081.882200:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27474853-4920-4406-9272-38eff2ad2609+50:29905:x1875263094077056:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 453us (667us total) trans 25769803887 rc 0/0 00000100:00100000:2.0:1788391081.882207:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:2.0:1788391081.888861:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391081.888907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391081.889001:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077184 00000100:00100000:1.0:1788391081.889011:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077184 00000100:00100000:1.0:1788391081.889084:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391081.889095:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+50:2357:x1875263094077184:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391081.889111:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391081.889135:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd361b8 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb78 expref: 50 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391081.889153:0:38422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391081.889158:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391081.889210:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27474853-4920-4406-9272-38eff2ad2609+49:2357:x1875263094077184:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391081.889234:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788391081.889545:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077440 00000100:00100000:3.0:1788391081.889550:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077440 00000100:00100000:3.0:1788391081.889584:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1788391081.889592:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+49:29905:x1875263094077440:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391081.889802:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+50:29905:x1875263094077440:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 210us (893us total) trans 25769803888 rc 0/0 00000100:00100000:3.0:1788391081.889809:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788391082.008124:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391082.008174:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077696 00000100:00100000:2.0:1788391082.008183:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077696 00000100:00100000:2.0:1788391082.008275:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1788391082.008283:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+50:29921:x1875263094077696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391082.008303:0:38435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391082.008329:0:38435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361c6 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb7f expref: -99 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.008419:0:38435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.008431:0:38435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 51 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.008458:0:38435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 4/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.008492:0:38435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 51 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.008501:0:38435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 51 pid: 39647 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391082.008525:0:38435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:38435:1875263103429248:192.168.202.1@tcp:104: 00000100:00080000:3.0:1788391082.008595:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391082.008683:0:38435:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683389840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391082.011591:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391082.011642:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077824 00000100:00100000:3.0:1788391082.011651:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077824 00010000:00010000:3.0:1788391082.011689:0:38421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 52 pid: 39647 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391082.011745:0:38435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:38435:1875263103429248:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391082.011780:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788391082.011790:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+52:2356:x1875263094077824:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391082.011805:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391082.011811:0:38421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 52 pid: 39647 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011823:0:38421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 52 pid: 39647 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391082.011832:0:38435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011844:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36195 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb6a expref: 52 pid: 39647 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011865:0:38421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:3.0:1788391082.011870:0:38421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011879:0:38421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011884:0:38421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391082.011902:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391082.011925:0:38435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391082.011931:0:38435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 38435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391082.011946:0:38435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00000100:00100000:3.0:1788391082.012023:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27474853-4920-4406-9272-38eff2ad2609+51:2356:x1875263094077824:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 233us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391082.012031:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00010000:00010000:0.0:1788391082.012160:0:38435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361c6 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb7f expref: 52 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391082.012174:0:38435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb7f expref: 51 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391082.012182:0:38435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:0.0:1788391082.012184:0:38435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391082.012187:0:38435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:0.0:1788391082.012210:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27474853-4920-4406-9272-38eff2ad2609+51:29921:x1875263094077696:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3928us (4095us total) trans 25769803889 rc 0/0 00000100:00100000:0.0:1788391082.012217:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1788391082.068051:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391082.068210:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094077952 00000100:00100000:2.0:1788391082.068221:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094077952 00000100:00100000:2.0:1788391082.068288:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1788391082.068298:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+51:29931:x1875263094077952:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391082.068391:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068408:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068696:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068716:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068742:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068748:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068833:0:38437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068842:0:38437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068849:0:38437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391082.068883:0:38437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068893:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068899:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068905:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068910:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391082.068914:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068922:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068940:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391082.068943:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391082.068948:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.068954:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0600/0x9aafc5f04cd361db lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070689:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070704:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070712:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070718:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391082.070722:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070729:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070743:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff95d68641e200) 00010000:00010000:2.0:1788391082.070746:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391082.070750:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070756:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd361e2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070786:0:38437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070792:0:38437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070798:0:38437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070803:0:38437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391082.070806:0:38437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070812:0:38437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070820:0:38437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:2.0:1788391082.070822:0:38437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391082.070825:0:38437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391082.070831:0:38437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd361e9 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 38437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391082.070935:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+51:29931:x1875263094077952:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 2633us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391082.070946:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00010000:00010000:3.0:1788391082.446386:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391083.469187:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788391083.469732:0:38458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 900576769991ns, next at 901576766775ns, rc = 0 00000100:00100000:1.0:1788391083.469759:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103429376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391083.469866:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391083.470159:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103429376 00000100:00100000:2.0:1788391083.470171:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103429376 00000100:00080000:3.0:1788391083.470228:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391083.470265:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788391083.470299:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3286:x1875263103429376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391083.470363:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391083.470430:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3286:x1875263103429376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391083.470438:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788391083.470690:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103429376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391083.643674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391083.643723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391083.643740:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078080 00000100:00100000:0.0:1788391083.643754:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078080 00000100:00100000:3.0:1788391083.643758:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391083.643791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391083.643812:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391083.643830:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788391083.643836:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391083.643846:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2357:x1875263094078080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391083.643861:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391083.643882:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078592 00000100:00100000:3.0:1788391083.643886:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078592 00000100:00100000:3.0:1788391083.643926:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078208 00000100:00100000:3.0:1788391083.643929:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078208 00000100:00100000:0.0:1788391083.643943:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2357:x1875263094078080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391083.643987:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788391083.644016:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788391083.644027:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:2357:x1875263094078592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391083.644066:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:2357:x1875263094078592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391083.644071:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788391083.644082:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788391083.644086:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+51:2357:x1875263094078208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391083.644101:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+51:2357:x1875263094078208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 16us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391083.644105:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788391083.644119:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078336 00000100:00100000:3.0:1788391083.644121:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078336 00000100:00100000:3.0:1788391083.644141:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078848 00000100:00100000:3.0:1788391083.644143:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078848 00000100:00100000:3.0:1788391083.644150:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078464 00000100:00100000:3.0:1788391083.644151:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078464 00000100:00100000:3.0:1788391083.644158:0:39121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078720 00000100:00100000:3.0:1788391083.644159:0:39121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078720 00000100:00100000:3.0:1788391083.644171:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391083.644177:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094078336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391083.644204:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27474853-4920-4406-9272-38eff2ad2609+6:2357:x1875263094078336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391083.644210:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00080000:0.0:1788391083.646306:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391083.646318:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391083.646322:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391083.647190:0:39121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391083.647208:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788391083.647220:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391083.647235:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094078464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391083.647238:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+6:2357:x1875263094078720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391083.647336:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+6:2357:x1875263094078720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 106us (3474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391083.647361:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+8:2357:x1875263094078464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 139us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391083.647401:0:39121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+5:2357:x1875263094078848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391083.647472:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391083.647516:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788391083.647702:0:39121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14847363-0daa-48dd-bf83-08d2101df15c+5:2357:x1875263094078848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 308us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391083.647723:0:39121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:3.0:1788391084.493131:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391085.197188:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391085.197255:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094078976 00000100:00100000:1.0:1788391085.197263:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094078976 00000100:00080000:0.0:1788391085.197390:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391085.197428:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:1.0:1788391085.197437:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+51:29785:x1875263094078976:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788391085.197571:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+51:29785:x1875263094078976:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391085.197580:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1788391085.199527:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391085.199593:0:38439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079232 00000100:00100000:1.0:1788391085.199698:0:38439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079232 00000100:00100000:1.0:1788391085.199758:0:38439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788391085.199769:0:38439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68ffce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+51:29785:x1875263094079232:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391085.200071:0:38439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68ffce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27474853-4920-4406-9272-38eff2ad2609+52:29785:x1875263094079232:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 305us (551us total) trans 25769803890 rc 0/0 00000100:00100000:1.0:1788391085.200096:0:38439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00010000:00010000:3.0:1788391085.517832:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788391086.050050:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1788391086.050074:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803889 is committed 00000020:00080000:2.0:1788391086.050108:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d69193ae40 refcount 2 committed 0 result 0 batchid 21474836519 00000020:00080000:2.0:1788391086.050113:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68fc36200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a9df00 00000020:00080000:2.0:1788391086.050116:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68fc36f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58512ac00 00000020:00080000:2.0:1788391086.050140:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836518 batchid updated 00000020:00080000:2.0:1788391086.050153:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836519 committed batchid 21474836518 00000020:00080000:2.0:1788391086.050402:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836518 00000001:00080000:2.0:1788391086.050682:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803890 is committed 00000020:00080000:2.0:1788391086.050717:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d683065180 refcount 2 committed 0 result 0 batchid 21474836520 00000020:00080000:2.0:1788391086.050720:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6bbf900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d683065540 00000020:00080000:2.0:1788391086.050723:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6bbf500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b6b78000 00000020:00080000:3.0:1788391086.050758:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836520 committed batchid 21474836518 00000020:00080000:3.0:1788391086.050789:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836518 00000100:00100000:3.0:1788391086.053193:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103429504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788391086.053268:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391086.053337:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103429504 00000100:00100000:0.0:1788391086.053345:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103429504 00000100:00100000:0.0:1788391086.053413:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788391086.053424:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103429504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788391086.053450:0:40764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:163 count 1 00002000:00010000:0.0:1788391086.053494:0:40764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a98aea7, atime: 0x6a98aea7, ctime: 0x6a98aea7, blocks: 0xb 00010000:00010000:0.0:1788391086.053512:0:40764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391086.053528:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=903s v=(0 0) 00010000:00010000:0.0:1788391086.053532:0:40764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391086.053538:0:40764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391086.053554:0:40764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391086.053580:0:40764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391086.053589:0:40764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391086.053607:0:40764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391086.053630:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391086.053638:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391086.053648:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391086.053653:0:38424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391086.053662:0:38424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391086.053679:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391086.053686:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd361f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391086.053713:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391086.053716:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391086.053717:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788391086.054743:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586482300/2, rc 0, transno 25769803793 00000100:00100000:3.0:1788391086.054750:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103429504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788391086.054986:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3287:x1875263103429504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1074us (1227us total) trans 25769803793 rc 0/0 00000100:00100000:0.0:1788391086.054995:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788391086.055027:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788391086.251730:0:40952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 19:18:05 (1788391085) 00000100:00100000:1.0:1788391086.541156:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103429632:0@lo:400:kworker.0 00000100:00100000:1.0:1788391086.541239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391086.541294:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103429632 00000100:00100000:2.0:1788391086.541303:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103429632 00000100:00100000:2.0:1788391086.541360:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788391086.541371:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3288:x1875263103429632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391086.545239:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103429888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391086.545893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391086.545942:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103429760:0@lo:400:kworker.0 00000100:00100000:1.0:1788391086.546413:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391086.546454:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103429888 00000100:00100000:1.0:1788391086.546461:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103429888 00000100:00100000:1.0:1788391086.546591:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391086.546601:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103429888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391086.546634:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788391086.546678:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103429888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391086.546686:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391086.546708:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103429760 00000100:00100000:1.0:1788391086.546711:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103429760 00000100:00100000:1.0:1788391086.547370:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788391086.547380:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103429760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391086.547423:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103429760:12345-0@lo:400:kworker.0 Request processed in 46us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391086.547430:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788391086.547447:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391086.547825:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 2 00000004:00080000:1.0:1788391086.547832:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803783 00000004:00080000:1.0:1788391086.547851:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68a7e5880, transno 25769803783 00000100:00100000:1.0:1788391086.547875:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103429888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391086.548280:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103429760:0@lo:400:kworker.0 00000100:00100000:2.0:1788391086.551349:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3288:x1875263103429632:12345-0@lo:400:kworker.0 Request processed in 9973us (10102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391086.551364:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788391086.551998:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103429632:0@lo:400:kworker.0 00010000:00010000:3.0:1788391086.552783:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391086.552847:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103430016:0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.552905:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391086.552952:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430016 00000100:00100000:3.0:1788391086.552977:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430016 00000100:00100000:3.0:1788391086.553065:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788391086.553075:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103430016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553117:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103430016:12345-0@lo:400:kworker.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391086.553123:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788391086.553214:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103430016:0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553252:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103430144:0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391086.553296:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391086.553300:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103430272:0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391086.553334:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430144 00000100:00100000:3.0:1788391086.553336:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430144 00000100:00100000:2.0:1788391086.553356:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430272 00000100:00100000:2.0:1788391086.553362:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430272 00000100:00100000:3.0:1788391086.553378:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788391086.553389:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103430144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391086.553402:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788391086.553412:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103430272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553445:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103430144:12345-0@lo:400:kworker.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391086.553454:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788391086.553463:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103430272:12345-0@lo:400:kworker.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391086.553483:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788391086.553485:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391086.553514:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103430272:0@lo:400:kworker.0 00000100:00100000:3.0:1788391086.553527:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103430144:0@lo:400:kworker.0 00000001:00080000:1.0:1788391086.576465:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803784 is committed 00000001:00080000:3.0:1788391086.597715:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803793 is committed 00000001:00080000:3.0:1788391086.597733:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803790 is committed 00000001:02000400:2.0:1788391087.397891:0:41003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_3b Need 3 or more clients, have 1 00010000:00010000:3.0:1788391087.565112:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391088.502736:0:41052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 4: Auto cache test for mmap =========== 19:18:07 (1788391087) 00000100:00100000:1.0:1788391088.592867:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103430400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391088.592930:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391088.593025:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430400 00000100:00100000:1.0:1788391088.593032:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430400 00000100:00100000:1.0:1788391088.593087:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788391088.593096:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103430400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391088.593130:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391088.593170:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103430400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391088.593177:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788391088.593209:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391088.593232:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803793 gen 2 00000004:00080000:1.0:1788391088.593237:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d685279500, transno 25769803789 00000004:00080000:1.0:1788391088.593247:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803791 committed transno 25769803793 00000004:00080000:1.0:1788391088.593264:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803792 committed transno 25769803793 00000004:00080000:1.0:1788391088.593272:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586482300, transno 25769803793 00000100:00100000:1.0:1788391088.593282:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103430400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788391088.603743:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391088.760710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760753:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760821:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760843:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391088.760940:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079616 00000100:00100000:0.0:1788391088.760950:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079616 00000100:00100000:0.0:1788391088.761043:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094080128 00000100:00100000:0.0:1788391088.761047:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094080128 00000100:00100000:0.0:1788391088.761061:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079744 00000100:00100000:0.0:1788391088.761063:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079744 00000100:00100000:0.0:1788391088.761073:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094080000 00000100:00100000:0.0:1788391088.761075:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094080000 00000100:00100000:0.0:1788391088.761104:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788391088.761113:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094079616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391088.761145:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079872 00000100:00100000:2.0:1788391088.761150:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079872 00000100:00100000:2.0:1788391088.761179:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079488 00000100:00100000:2.0:1788391088.761183:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079488 00000100:00100000:0.0:1788391088.761184:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+5:2358:x1875263094079616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391088.761191:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391088.761200:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391088.761206:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:2358:x1875263094079872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391088.761207:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391088.761212:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094080128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391088.761236:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+5:2358:x1875263094080128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391088.761242:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391088.761252:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788391088.761258:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+6:2358:x1875263094079744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391088.761278:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+6:2358:x1875263094079744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391088.761284:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788391088.761294:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391088.761300:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+6:2358:x1875263094080000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391088.761320:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14847363-0daa-48dd-bf83-08d2101df15c+6:2358:x1875263094080000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391088.761326:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00080000:0.0:1788391088.761347:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391088.761412:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391088.761414:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391088.761425:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14847363-0daa-48dd-bf83-08d2101df15c+10:2358:x1875263094079872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 219us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391088.761431:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391088.761445:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1788391088.761464:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+15:2358:x1875263094079488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391088.761540:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27474853-4920-4406-9272-38eff2ad2609+15:2358:x1875263094079488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391088.761735:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094079360 00000100:00100000:3.0:1788391088.761740:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094079360 00000100:00100000:3.0:1788391088.761772:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788391088.761778:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2358:x1875263094079360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391088.761804:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2358:x1875263094079360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391088.761811:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1788391088.768202:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000040:00080000:0.0:1788391089.293185:0:38470:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391089.293206:0:38470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391089.293263:0:38470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:0.0:1788391089.293270:0:38470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788391089.619538:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391090.637212:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788391091.195466:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836519 batchid updated 00000020:00080000:1.0:1788391091.195478:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836520 batchid updated 00000020:00080000:1.0:1788391091.195497:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000020:00080000:1.0:1788391091.195510:0:38473:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000100:00100000:3.0:1788391091.259811:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391091.259996:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094080384 00000100:00100000:0.0:1788391091.260008:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094080384 00000100:00100000:0.0:1788391091.260117:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788391091.260132:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+15:30855:x1875263094080384:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:0.0:1788391091.260541:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+16:30855:x1875263094080384:12345-192.168.202.1@tcp:35:umount.0 Request processed in 414us (739us total) trans 25769803891 rc 0/0 00000100:00100000:0.0:1788391091.260549:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00080000:1.0:1788391091.260914:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391091.262875:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391091.263058:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094080640 00000100:00100000:0.0:1788391091.263068:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094080640 00000100:00100000:0.0:1788391091.263127:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788391091.263137:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+16:30855:x1875263094080640:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:0.0:1788391091.263362:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+17:30855:x1875263094080640:12345-192.168.202.1@tcp:35:umount.0 Request processed in 224us (493us total) trans 25769803892 rc 0/0 00000100:00100000:0.0:1788391091.263370:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788391091.267362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391091.267836:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094080896 00000100:00100000:0.0:1788391091.267847:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094080896 00000100:00100000:0.0:1788391091.267907:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788391091.267919:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+17:30855:x1875263094080896:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:0.0:1788391091.268282:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27474853-4920-4406-9272-38eff2ad2609+18:30855:x1875263094080896:12345-192.168.202.1@tcp:35:umount.0 Request processed in 364us (931us total) trans 25769803893 rc 0/0 00000100:00100000:0.0:1788391091.268291:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788391091.275178:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391091.275349:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094081536 00000100:00100000:0.0:1788391091.275362:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094081536 00000100:00100000:0.0:1788391091.275468:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788391091.275479:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+6:2355:x1875263094081536:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:0.0:1788391091.275508:0:40764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd358c7 00000020:00010000:0.0:1788391091.275525:0:40764:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d584a17800: total 0 00000100:00080000:0.0:1788391091.275530:0:40764:0:(import.c:65:import_set_state_nolock()) ffff95d584a14000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788391091.275565:0:40764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00000100:00100000:0.0:1788391091.275820:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27474853-4920-4406-9272-38eff2ad2609+4:2355:x1875263094081536:12345-192.168.202.1@tcp:9:umount.0 Request processed in 342us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.275828:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000020:00010000:3.0:1788391091.276038:0:38424:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d584a17800: total 0 00010000:00010000:3.0:1788391091.276042:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391091.276071:0:38424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d584a17800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788391091.276099:0:38424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:3.0:1788391091.276103:0:38424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb mtime from disk: 0 -> 1788391081 00002000:00010000:3.0:1788391091.276105:0:38424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb ctime from disk: 0 -> 1788391081 00002000:00010000:3.0:1788391091.276114:0:38424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788391091.276140:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022237995/0x9aafc5f04cd36117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb47 expref: 3 pid: 40764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391091.276161:0:38424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d584a17800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788391091.276172:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391091.276174:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391091.276176:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788391091.276359:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391091.278637:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391091.278682:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391091.279558:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391091.280657:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094081152 00000100:00100000:2.0:1788391091.280668:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094081152 00000100:00100000:2.0:1788391091.280769:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094081024 00000100:00100000:2.0:1788391091.280797:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094081024 00000100:00100000:3.0:1788391091.280881:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094081280 00000100:00100000:3.0:1788391091.280887:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094081280 00000100:00100000:0.0:1788391091.280932:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391091.280956:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+15:2357:x1875263094081152:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391091.280992:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391091.281013:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd358ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff892 expref: 15 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391091.281034:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391091.281090:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+14:2357:x1875263094081152:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 147us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.281097:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391091.281116:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788391091.281123:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+13:2357:x1875263094081024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391091.281130:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391091.281139:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1600/0x9aafc5f04cd358a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff868 expref: 13 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391091.281148:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391091.281174:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+12:2357:x1875263094081024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 52us (2491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.281180:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788391091.281226:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788391091.281233:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+11:2357:x1875263094081280:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391091.281241:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391091.281250:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df6c00/0x9aafc5f04cd35b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff99c expref: 11 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391091.281258:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391091.281288:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3aafef2f-890d-4372-806a-7a8032c96dbb+10:2357:x1875263094081280:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 43us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.281295:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1788391091.284706:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391091.284739:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094081664 00000100:00100000:3.0:1788391091.284749:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094081664 00000100:00100000:3.0:1788391091.284894:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1788391091.284907:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+5:2355:x1875263094081664:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:3.0:1788391091.285043:0:39118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd358c0 00000100:00080000:3.0:1788391091.285062:0:39118:0:(import.c:65:import_set_state_nolock()) ffff95d584a16800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788391091.285110:0:39118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803793 00000100:00080000:2.0:1788391091.285467:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391091.285485:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391091.286237:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27474853-4920-4406-9272-38eff2ad2609+2:2355:x1875263094081664:12345-192.168.202.1@tcp:9:umount.0 Request processed in 1324us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391091.286253:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788391091.297664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391091.297781:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094082688 00000100:00100000:3.0:1788391091.297848:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094082688 00000100:00100000:3.0:1788391091.297979:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788391091.297991:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+18:2355:x1875263094082688:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1788391091.298028:0:38437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd358b9 00000020:00010000:3.0:1788391091.298045:0:38437:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d584a14800: total 0 00000100:00080000:3.0:1788391091.298050:0:38437:0:(import.c:65:import_set_state_nolock()) ffff95d584a11000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788391091.298097:0:38437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803893 00000020:00010000:1.0:1788391091.298621:0:38424:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d584a14800: total 0 00010000:00010000:1.0:1788391091.298675:0:38424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d584a14800, canceled 0 locks, left on hash table 10. 00010000:00010000:1.0:1788391091.298709:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:1.0:1788391091.298713:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788391091.298721:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a000/0x9aafc5f04cd35a72 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff941 expref: 17 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298740:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391091.298744:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788391091.298747:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd361cd lrc: 0/0,0 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb7f expref: 16 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298758:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391091.298760:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788391091.298763:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd35d35 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa21 expref: 15 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298773:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d68641ef00) 00010000:00010000:1.0:1788391091.298775:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391091.298778:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd35a33 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff933 expref: 14 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298819:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391091.298821:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788391091.298825:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0000/0x9aafc5f04cd35f96 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffade expref: 13 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298835:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff95d692d30b00) 00010000:00010000:1.0:1788391091.298837:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391091.298840:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7400/0x9aafc5f04cd3614f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb5c expref: 12 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298854:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391091.298857:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391091.298860:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7c00/0x9aafc5f04cd36125 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb4e expref: 11 pid: 38436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298872:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d686a70200) 00010000:00010000:1.0:1788391091.298874:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391091.298878:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd400/0x9aafc5f04cd35a17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff92c expref: 10 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298894:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:1.0:1788391091.298896:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391091.298899:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0c00/0x9aafc5f04cd35e1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa67 expref: 9 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298915:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391091.298917:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788391091.298928:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a800/0x9aafc5f04cd3615d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb63 expref: 8 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391091.298940:0:38424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d584a14800, canceled 10 locks, left on hash table 0. 00010000:00010000:1.0:1788391091.298954:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391091.298955:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391091.298957:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391091.299345:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27474853-4920-4406-9272-38eff2ad2609+6:2355:x1875263094082688:12345-192.168.202.1@tcp:39:umount.0 Request processed in 1355us (1690us total) trans 25769803894 rc 0/0 00000100:00100000:3.0:1788391091.299355:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00010000:00010000:2.0:1788391091.664336:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391091.664609:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103430656:0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.664680:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391091.664697:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103430912:0@lo:400:kworker.0 00000100:00100000:1.0:1788391091.664730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391091.664731:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103431168:0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.664752:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391091.664757:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788391091.664763:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103430528:0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.664766:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391091.664770:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103430784:0@lo:400:kworker.0 00000100:00100000:2.0:1788391091.664844:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430912 00000100:00100000:2.0:1788391091.664853:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430912 00000100:00100000:2.0:1788391091.664913:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431168 00000100:00100000:2.0:1788391091.664917:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431168 00000100:00100000:2.0:1788391091.664948:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788391091.664957:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103430912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391091.665480:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391091.665505:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391091.665514:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103431168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.666878:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391091.667078:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430656 00000100:00100000:0.0:1788391091.667085:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430656 00000100:00100000:0.0:1788391091.667132:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430784 00000100:00100000:0.0:1788391091.667134:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430784 00000100:00100000:0.0:1788391091.667149:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391091.667156:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103430656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.667206:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103430656:12345-0@lo:400:kworker.0 Request processed in 50us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.667225:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391091.667241:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788391091.667245:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103430784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.667267:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103430784:12345-0@lo:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.667271:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788391091.667283:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391091.667286:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391091.667308:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.667315:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103430656:0@lo:400:kworker.0 00000100:00100000:0.0:1788391091.667396:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391091.667405:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103431296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391091.667446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391091.667685:0:39123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431296 00000100:00100000:0.0:1788391091.667691:0:39123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431296 00000100:00100000:0.0:1788391091.667716:0:39123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391091.667723:0:39123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103431296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391091.667747:0:39123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788391091.667777:0:39123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103431296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391091.667781:0:39123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391091.667815:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103431296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391091.672593:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391091.672736:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103431168:12345-0@lo:400:kworker.0 Request processed in 7220us (7979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391091.672749:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391091.672823:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103431168:0@lo:400:kworker.0 00000100:00100000:3.0:1788391091.673044:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103430912:12345-0@lo:400:kworker.0 Request processed in 8087us (8312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391091.673052:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788391091.673091:0:38427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103430528 00000100:00100000:3.0:1788391091.673098:0:38427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103430528 00000100:00100000:3.0:1788391091.673134:0:38427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788391091.673142:0:38427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103430528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391091.673199:0:38427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103430528:12345-0@lo:400:kworker.0 Request processed in 57us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391091.673205:0:38427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788391091.678029:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103430528:0@lo:400:kworker.0 00000100:00100000:1.0:1788391091.678043:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103431040:0@lo:400:kworker.0 00000100:00100000:1.0:1788391091.678098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391091.678125:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103430912:0@lo:400:kworker.0 00000100:00100000:1.0:1788391091.682286:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431040 00000100:00100000:1.0:1788391091.682299:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431040 00000100:00100000:1.0:1788391091.682358:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391091.682368:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103431040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391091.682470:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103431040:12345-0@lo:400:kworker.0 Request processed in 104us (4370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391091.682478:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391091.682525:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103431040:0@lo:400:kworker.0 00000100:00080000:1.0:1788391091.682557:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788391091.705054:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000020:00000080:3.0:1788391091.705065:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d584a10800/27474853-4920-4406-9272-38eff2ad2609 00000020:00000080:3.0:1788391091.705101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584a10800/27474853-4920-4406-9272-38eff2ad2609 for lustre-OST0000 00000020:00000080:3.0:1788391091.705156:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d584a16800 for lustre-OST0000 00000001:00100000:1.0:1788391091.713776:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000020:00000080:1.0:1788391091.713797:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d584a17800/27474853-4920-4406-9272-38eff2ad2609 00000020:00000080:3.0:1788391091.713880:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584a17800/27474853-4920-4406-9272-38eff2ad2609 for lustre-OST0001 00000020:00000080:3.0:1788391091.714042:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d584a14000 for lustre-OST0001 00000100:00100000:0.0:1788391092.368733:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391092.368842:0:38438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094082944 00000100:00100000:1.0:1788391092.368852:0:38438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094082944 00000100:00100000:1.0:1788391092.369788:0:38438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391092.369812:0:38438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+10:30868:x1875263094082944:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:1.0:1788391092.370097:0:38438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14847363-0daa-48dd-bf83-08d2101df15c+11:30868:x1875263094082944:12345-192.168.202.1@tcp:35:umount.0 Request processed in 288us (1373us total) trans 25769803895 rc 0/0 00000100:00100000:1.0:1788391092.370105:0:38438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00080000:0.0:1788391092.370156:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391092.377641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391092.377690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391092.377723:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391092.377823:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391092.377918:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094083072 00000100:00100000:0.0:1788391092.377945:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094083072 00000100:00100000:1.0:1788391092.377948:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094083200 00000100:00100000:1.0:1788391092.377955:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094083200 00000100:00100000:0.0:1788391092.378043:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094083328 00000100:00100000:0.0:1788391092.378047:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094083328 00000100:00100000:2.0:1788391092.378129:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391092.378482:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3aafef2f-890d-4372-806a-7a8032c96dbb+12:2359:x1875263094083072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788391092.378491:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:2.0:1788391092.378499:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788391092.378508:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+12:2359:x1875263094083200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391092.378519:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391092.378523:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1e400/0x9aafc5f04cd359c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8ca expref: 12 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391092.378534:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df7800/0x9aafc5f04cd359ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff8f4 expref: 12 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.378545:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391092.378547:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391092.378609:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+10:2359:x1875263094083200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 108us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391092.378610:0:39118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094083456 00000100:00100000:1.0:1788391092.378616:0:39118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094083456 00000100:00100000:0.0:1788391092.378624:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788391092.378649:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3aafef2f-890d-4372-806a-7a8032c96dbb+9:2359:x1875263094083072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 508us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391092.378653:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391092.378665:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+9:2357:x1875263094083328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788391092.378668:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788391092.378675:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00010000:00010000:0.0:1788391092.378681:0:40545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788391092.378684:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14847363-0daa-48dd-bf83-08d2101df15c+5:2355:x1875263094083456:12345-192.168.202.1@tcp:9:umount.0 00010000:00010000:0.0:1788391092.378695:0:40545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd600/0x9aafc5f04cd35b4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff995 expref: 8 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391092.378705:0:40545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1788391092.378715:0:39118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd359e6 00000100:00080000:1.0:1788391092.378725:0:39118:0:(import.c:65:import_set_state_nolock()) ffff95d585fc0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788391092.378728:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3aafef2f-890d-4372-806a-7a8032c96dbb+7:2357:x1875263094083328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 67us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391092.378737:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:0.0:1788391092.378755:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1788391092.378760:0:39118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00010000:00010000:2.0:1788391092.378820:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391092.379009:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14847363-0daa-48dd-bf83-08d2101df15c+2:2355:x1875263094083456:12345-192.168.202.1@tcp:9:umount.0 Request processed in 329us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391092.379018:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788391092.384877:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391092.385215:0:39225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094083712 00000100:00100000:0.0:1788391092.385224:0:39225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094083712 00000100:00100000:0.0:1788391092.385304:0:39225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788391092.385323:0:39225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+6:2355:x1875263094083712:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:0.0:1788391092.385379:0:39225:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd359df 00000020:00010000:0.0:1788391092.385396:0:39225:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d6a6b02800: total 0 00000100:00080000:0.0:1788391092.385400:0:39225:0:(import.c:65:import_set_state_nolock()) ffff95d58716f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788391092.385451:0:39225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803793 00000100:00100000:0.0:1788391092.385728:0:39225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14847363-0daa-48dd-bf83-08d2101df15c+4:2355:x1875263094083712:12345-192.168.202.1@tcp:9:umount.0 Request processed in 414us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391092.385737:0:39225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00080000:2.0:1788391092.385832:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1788391092.386349:0:38423:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d6a6b02800: total 0 00010000:00010000:3.0:1788391092.386355:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391092.386388:0:38423:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d6a6b02800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788391092.386430:0:38423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 0 -> 14 00010000:00010000:3.0:1788391092.386458:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cec2f4e0/0x9aafc5f04cd35d89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa3d expref: 3 pid: 39120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391092.386480:0:38423:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d6a6b02800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788391092.386490:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391092.386492:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391092.386493:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391092.393781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391092.393895:0:38437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094084352 00000100:00100000:3.0:1788391092.393905:0:38437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094084352 00000100:00100000:3.0:1788391092.394151:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:3.0:1788391092.394230:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+11:2355:x1875263094084352:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1788391092.394271:0:38437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd359d8 00000020:00010000:3.0:1788391092.394425:0:38437:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d5866e2800: total 0 00000100:00080000:3.0:1788391092.394430:0:38437:0:(import.c:65:import_set_state_nolock()) ffff95d6a6b03000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788391092.394485:0:38437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803895 00000100:00100000:3.0:1788391092.394707:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14847363-0daa-48dd-bf83-08d2101df15c+10:2355:x1875263094084352:12345-192.168.202.1@tcp:39:umount.0 Request processed in 545us (935us total) trans 25769803896 rc 0/0 00000100:00100000:3.0:1788391092.394715:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000020:00010000:2.0:1788391092.402767:0:38424:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d5866e2800: total 0 00010000:00010000:2.0:1788391092.402834:0:38424:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d5866e2800, canceled 0 locks, left on hash table 5. 00010000:00010000:2.0:1788391092.402888:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391092.402892:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391092.402903:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd35bd0 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9b1 expref: 9 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.402929:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391092.402931:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391092.402935:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd35de4 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa52 expref: 8 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.402949:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:2.0:1788391092.402951:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391092.402955:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd35dc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa4b expref: 7 pid: 38435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.403844:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391092.403847:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391092.403854:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd35c0f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff9c6 expref: 6 pid: 38437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.403867:0:38424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391092.403869:0:38424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391092.403873:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd35d74 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffa36 expref: 5 pid: 39647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391092.403886:0:38424:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d5866e2800, canceled 5 locks, left on hash table 0. 00010000:00010000:2.0:1788391092.403903:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391092.403905:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391092.403908:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391092.414345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391092.414438:0:38428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094084608 00000100:00100000:1.0:1788391092.414449:0:38428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094084608 00000100:00100000:1.0:1788391092.414516:0:38428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788391092.414528:0:38428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+7:2355:x1875263094084608:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:1.0:1788391092.414575:0:38428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35896 00000020:00010000:1.0:1788391092.414583:0:38428:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d584a13000: total 0 00000100:00080000:1.0:1788391092.414588:0:38428:0:(import.c:65:import_set_state_nolock()) ffff95d584a17000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788391092.414771:0:38428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3aafef2f-890d-4372-806a-7a8032c96dbb+3:2355:x1875263094084608:12345-192.168.202.1@tcp:251:umount.0 Request processed in 245us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391092.414778:0:38428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000020:00010000:2.0:1788391092.414940:0:38423:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d584a13000: total 0 00010000:00010000:2.0:1788391092.414945:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391092.415157:0:38423:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d584a13000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788391092.415503:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3589d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbff861 expref: 2 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391092.415522:0:38423:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d584a13000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788391092.415539:0:38423:0:(genops.c:885:class_export_put()) final put ffff95d584a13000/3aafef2f-890d-4372-806a-7a8032c96dbb 00010000:00010000:0.0:1788391092.415554:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391092.415556:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391092.415558:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788391092.415584:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584a13000/3aafef2f-890d-4372-806a-7a8032c96dbb for MGS 00000020:00000080:3.0:1788391092.415620:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d584a17000 for MGS 00010000:00010000:1.0:1788391092.685317:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788391093.668479:0:41250:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788391093.677790:0:41250:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788391093.677840:0:41250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391093.677856:0:41250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391093.677863:0:41250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391093.677871:0:41250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391093.678057:0:41250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788391093.678064:0:41250:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788391093.678092:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391093.678097:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788391093.678103:0:41250:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788391093.678127:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d6a6912000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788391093.678237:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391093.678245:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678253:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a0f62400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391093.678257:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678266:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391093.678273:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391093.678278:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391093.678281:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788391093.678283:0:38423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788391093.678309:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678315:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788391093.678367:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103431552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391093.678444:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391093.678517:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678525:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6a0f62400/0x9aafc5f04cd35674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3567b expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678547:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.678548:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.678550:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391093.678562:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103431424:0@lo:39:umount.0 00000100:00100000:1.0:1788391093.678593:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391093.678635:0:38421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431552 00000100:00100000:1.0:1788391093.678641:0:38421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431552 00000100:00100000:1.0:1788391093.678686:0:38421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788391093.678696:0:38421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3286:x1875263103431552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391093.678708:0:38421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391093.678722:0:38421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a0f63a00/0x9aafc5f04cd3567b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35674 expref: 19 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.678735:0:38421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391093.678845:0:38421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f33d137e-f79f-4925-8ad8-5351efff92b3+18:3286:x1875263103431552:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391093.678854:0:38421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788391093.678879:0:39647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431424 00000100:00100000:1.0:1788391093.678883:0:39647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431424 00000100:00100000:1.0:1788391093.678908:0:39647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788391093.678914:0:39647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103431424:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788391093.678936:0:39647:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd356ac 00000100:00080000:1.0:1788391093.678943:0:39647:0:(import.c:65:import_set_state_nolock()) ffff95d6bbee6000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788391093.679009:0:39647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1875263103431424:12345-0@lo:39:umount.0 Request processed in 95us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391093.679015:0:39647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000020:00000080:1.0:1788391093.679028:0:39647:0:(genops.c:885:class_export_put()) final put ffff95d6bbee3800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788391093.679053:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788391093.679061:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788391093.679099:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6bbee6000 for lustre-MDT0000 00000100:00080000:1.0:1788391093.679130:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a6912000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788391093.679140:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103431424:0@lo:39:umount.0 00000100:00080000:1.0:1788391093.679326:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788391093.679330:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788391093.679334:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788391093.680247:0:41250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680260:0:41250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680267:0:41250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680274:0:41250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680289:0:41250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391093.680299:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391093.680304:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680311:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391093.680314:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680333:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391093.680410:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391093.680416:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391093.680418:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788391093.680444:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680449:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391093.680470:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680477:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd355da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355e1 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680488:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680490:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680492:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680503:0:41250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680511:0:41250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680516:0:41250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680531:0:41250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680542:0:41250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391093.680549:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391093.680553:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680560:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391093.680563:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680570:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391093.680576:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391093.680581:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391093.680583:0:38424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788391093.680586:0:38424:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788391093.680600:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680605:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391093.680618:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680625:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdde00/0x9aafc5f04cd35888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd3588f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680643:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680645:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680647:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680659:0:41250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680666:0:41250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680673:0:41250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680679:0:41250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680691:0:41250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391093.680697:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391093.680701:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680708:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391093.680711:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680718:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391093.680724:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391093.680738:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788391093.680740:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788391093.680742:0:38423:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788391093.680759:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391093.680765:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103431680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391093.680768:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391093.680778:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680785:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdd200/0x9aafc5f04cd35b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b9f expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680795:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680797:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680799:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.680811:0:41250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680818:0:41250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391093.680827:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391093.680828:0:41250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680837:0:41250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680851:0:41250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788391093.680856:0:41250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788391093.680865:0:41250:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1788391093.680875:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103431808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391093.680888:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391093.680894:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680900:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc1d52c20) 00000100:00100000:3.0:1788391093.680906:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788391093.680907:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391093.680916:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391093.680924:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391093.680925:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:1.0:1788391093.680933:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:3.0:1788391093.680935:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103431936:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788391093.680936:0:38424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788391093.680940:0:38424:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788391093.680957:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391093.681069:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391093.681107:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431680 00000100:00100000:3.0:1788391093.681114:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431680 00000100:00100000:3.0:1788391093.681154:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431808 00000100:00100000:3.0:1788391093.681158:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431808 00000100:00100000:3.0:1788391093.681171:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103431936 00000100:00100000:3.0:1788391093.681173:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103431936 00000100:00100000:3.0:1788391093.681188:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788391093.681195:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+20:3287:x1875263103431680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391093.681207:0:38420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788391093.681698:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788391093.681710:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69fc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+20:3288:x1875263103431808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391093.681724:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391093.681738:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93400/0x9aafc5f04cd3588f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35888 expref: 20 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391093.681755:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391093.681796:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69fc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+19:3288:x1875263103431808:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391093.681803:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788391093.681822:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788391093.681829:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+18:3288:x1875263103431936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391093.681836:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391093.681845:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdc600/0x9aafc5f04cd35b9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35b98 expref: 18 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391093.681854:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391093.681884:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+17:3288:x1875263103431936:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391093.681889:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788391093.682091:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103431936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788391093.682100:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103431808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391093.682163:0:38420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a92c00/0x9aafc5f04cd355e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd355da expref: 16 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391093.682174:0:38420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391093.682216:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f33d137e-f79f-4925-8ad8-5351efff92b3+15:3287:x1875263103431680:12345-0@lo:103:ldlm_bl.0 Request processed in 1021us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391093.682223:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788391093.682312:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103431680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391093.684742:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f33d137e-f79f-4925-8ad8-5351efff92b3:3286:1875263103431552:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788391093.685279:0:41250:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788391093.685296:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788391093.685301:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391093.685306:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788391093.685313:0:41250:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d6bbee0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788391093.685318:0:41250:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff95d58716f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788391093.685325:0:41250:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d5866e2800 14847363-0daa-48dd-bf83-08d2101df15c 192.168.202.1@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 25769803829 stale:0 00000020:00080000:2.0:1788391093.685330:0:41250:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff95d584a14800 27474853-4920-4406-9272-38eff2ad2609 192.168.202.1@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 25769803890 stale:0 00000020:00080000:2.0:1788391093.685335:0:41250:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff95d68a6619b8) has exports, disconnecting them 00000020:00080000:2.0:1788391093.685339:0:41250:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d6bbee0800), last request at 1788391091 00000020:00000080:2.0:1788391093.685346:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3587a 00000100:00080000:2.0:1788391093.685363:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d584a11800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788391093.685427:0:41250:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6bbee0800): rc 0 00000020:00000080:2.0:1788391093.685430:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6bbee0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788391093.685443:0:41250:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95d58716f800), last request at 1788391091 00000020:00000080:2.0:1788391093.685446:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3572a 00000100:00080000:2.0:1788391093.685451:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d58716c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788391093.685456:0:41250:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d58716f800): rc 0 00000020:00000080:2.0:1788391093.685458:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d58716f800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788391093.685465:0:41250:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba8581c8fae0 00000100:00080000:2.0:1788391093.685484:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788391093.685488:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803793 gen 3 00000004:00080000:2.0:1788391093.685507:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788391093.685513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788391093.685566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58716f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788391093.685580:0:41250:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:0.0:1788391093.685592:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d584a11800 for lustre-MDT0000 00000020:00000080:0.0:1788391093.685597:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d58716c000 for lustre-MDT0000 00000100:00080000:2.0:1788391093.685603:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fad000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788391093.685630:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788391093.685632:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 3 00000004:00080000:2.0:1788391093.685642:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788391093.685673:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391093.685694:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788391093.685706:0:41250:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788391093.685717:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788391093.685744:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d68a6619b8) has no exports 00000100:00100000:0.0:1788391093.685756:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103432192:0@lo:9:umount.0 00000100:00100000:0.0:1788391093.685821:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391093.685864:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103432320:0@lo:9:umount.0 00000100:00100000:0.0:1788391093.685891:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391093.685943:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432192 00000100:00100000:0.0:1788391093.685950:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432192 00000100:00100000:0.0:1788391093.686024:0:40764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432320 00000100:00100000:0.0:1788391093.686028:0:40764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432320 00000100:00100000:0.0:1788391093.686052:0:40764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788391093.686063:0:40764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103432192:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788391093.686085:0:40764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35738 00000100:00080000:0.0:1788391093.686092:0:40764:0:(import.c:65:import_set_state_nolock()) ffff95d58716b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788391093.686126:0:40764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803793 00000100:00100000:0.0:1788391093.686316:0:40764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103432192:12345-0@lo:9:umount.0 Request processed in 254us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391093.686324:0:40764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788391093.686386:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.686528:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdcc00/0x9aafc5f04cd355cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd355d3 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391093.686655:0:39118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788391093.686663:0:39118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875263103432320:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788391093.686677:0:39118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd358dc 00000100:00080000:1.0:1788391093.686691:0:39118:0:(import.c:65:import_set_state_nolock()) ffff95d5866e0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788391093.686715:0:39118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00000100:00100000:1.0:1788391093.686841:0:39118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3285:x1875263103432320:12345-0@lo:9:umount.0 Request processed in 178us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391093.686849:0:39118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788391093.686878:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875263103432448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391093.686890:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391093.686896:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103432064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391093.686923:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391093.686950:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.686955:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.686956:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391093.686957:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788391093.686989:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391093.686992:0:38431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391093.687016:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a0fad000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788391093.687025:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788391093.687027:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788391093.687029:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103432192:0@lo:9:umount.0 00000100:00080000:1.0:1788391093.687040:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788391093.687047:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788391093.687048:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788391093.687050:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103432320:0@lo:9:umount.0 00000100:00100000:2.0:1788391093.687087:0:38422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432064 00000100:00100000:2.0:1788391093.687099:0:38422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432064 00000100:00100000:2.0:1788391093.687149:0:38422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788391093.687214:0:38422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+15:3287:x1875263103432064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391093.687226:0:38422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391093.687243:0:38422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93800/0x9aafc5f04cd355d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd355cc expref: 15 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391093.687259:0:38422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391093.687306:0:38422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:3287:x1875263103432064:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391093.687313:0:38422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391093.689024:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103432064:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788391093.699597:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff95d68a6619b8) has no exports 00000020:00000080:3.0:1788391093.739678:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35627 00000020:00000080:3.0:1788391093.739695:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6865e4800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788391093.739774:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:0.0:1788391093.739982:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788391093.740130:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6865e4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788391093.740357:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391093.740369:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788391093.740374:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff95d6bc758000) has no exports 00000020:00000080:2.0:1788391093.740767:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35620 00000020:00000080:2.0:1788391093.740773:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d585012000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788391093.740821:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391093.740828:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788391093.740830:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d585010000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788391093.740833:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585010000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788391093.740841:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788391093.741066:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585012000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788391094.797223:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391095.821432:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788391096.293642:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803893 is committed 00000001:00080000:3.0:1788391096.293675:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803895 is committed 00000001:00100000:3.0:1788391096.293681:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000001:00080000:3.0:1788391096.293688:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803896 is committed 00000020:00000080:3.0:1788391096.293691:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d5866e2800/14847363-0daa-48dd-bf83-08d2101df15c 00000001:00100000:3.0:1788391096.293705:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 27474853-4920-4406-9272-38eff2ad2609 00000001:00080000:3.0:1788391096.293709:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803894 is committed 00000020:00000080:3.0:1788391096.293711:0:5829:0:(genops.c:885:class_export_put()) final put ffff95d584a14800/27474853-4920-4406-9272-38eff2ad2609 00000020:00000080:3.0:1788391096.293723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5866e2800/14847363-0daa-48dd-bf83-08d2101df15c for lustre-MDT0000 00000020:00000080:3.0:1788391096.293778:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d584a14800/27474853-4920-4406-9272-38eff2ad2609 for lustre-MDT0000 00000020:00000080:3.0:1788391096.293803:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a6b03000 for lustre-MDT0000 00000020:00000080:3.0:1788391096.293808:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d584a11000 for lustre-MDT0000 00000100:00100000:2.0:1788391096.781331:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103432576:0@lo:400:kworker.0 00000100:00100000:2.0:1788391096.781421:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391096.781424:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103432704:0@lo:400:kworker.0 00000100:00100000:1.0:1788391096.781469:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391096.781490:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103432832:0@lo:400:kworker.0 00000100:00100000:1.0:1788391096.781517:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432704 00000100:00100000:2.0:1788391096.781520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391096.781540:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432704 00000100:00100000:2.0:1788391096.781578:0:38430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432576 00000100:00100000:1.0:1788391096.781582:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432832 00000100:00100000:2.0:1788391096.781583:0:38430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432576 00000100:00100000:1.0:1788391096.781587:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432832 00000100:00100000:2.0:1788391096.781624:0:38430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788391096.781633:0:38430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:3288:x1875263103432576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391096.781650:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788391096.781656:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3289:x1875263103432704:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788391096.781664:0:38436:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788391096.781684:0:38430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f33d137e-f79f-4925-8ad8-5351efff92b3+14:3288:x1875263103432576:12345-0@lo:400:kworker.0 Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391096.781690:0:38430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788391096.781705:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3289:x1875263103432704:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788391096.781711:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788391096.781724:0:38437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788391096.781728:0:38437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875263103432832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788391096.781732:0:38437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1788391096.781753:0:3289:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788391096.781758:0:38437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875263103432832:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788391096.781759:0:3289:0:(import.c:65:import_set_state_nolock()) ffff95d587169800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788391096.781766:0:3289:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788391096.781771:0:38437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788391096.781795:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788391096.781798:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788391096.781801:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788391096.781804:0:3286:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788391096.781806:0:3286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 872 00000100:00080000:2.0:1788391096.781810:0:3286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5866e7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391096.781826:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bc68ea00 x1875263103432960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391096.781840:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103432832:0@lo:400:kworker.0 00000100:00100000:2.0:1788391096.781860:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103432576:0@lo:400:kworker.0 00000100:00100000:2.0:1788391096.781875:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103432960:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788391096.781898:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391096.781918:0:38436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103432960 00000100:00100000:2.0:1788391096.781921:0:38436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103432960 00000100:00100000:2.0:1788391096.781936:0:38436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788391096.781939:0:38436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103432960:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788391096.781992:0:38436:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788391096.802738:0:3289:0:(import.c:65:import_set_state_nolock()) ffff95d587169800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788391096.802750:0:3289:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 863 00000100:00080000:1.0:1788391096.802761:0:3289:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d587169800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391096.802809:0:3289:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf3b80 x1875263103433088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391096.802842:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103432704:0@lo:400:kworker.0 00000100:00100000:1.0:1788391096.802888:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103433088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788391096.802954:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391096.804742:0:38435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433088 00000100:00100000:0.0:1788391096.804755:0:38435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433088 00000100:00100000:0.0:1788391096.804789:0:38435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788391096.804796:0:38435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103433088:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788391096.804815:0:38435:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788391096.805166:0:38435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103433088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 368us (2211us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788391096.805172:0:38435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788391096.805477:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d587169800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788391096.805483:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788391096.805487:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103433088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788391096.813290:0:38436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1875263103432960:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31337us (31378us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788391096.813305:0:38436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788391096.813362:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788391096.813367:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788391096.813372:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103432960:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:3.0:1788391096.825602:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788391096.825611:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d58716e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788391096.825630:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000020:00000080:3.0:1788391096.825632:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6a6b02800/14847363-0daa-48dd-bf83-08d2101df15c 00000020:00000080:3.0:1788391096.825649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58716e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788391096.825692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b02800/14847363-0daa-48dd-bf83-08d2101df15c for lustre-OST0000 00000020:00000080:3.0:1788391096.825712:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d58716b000 for lustre-OST0000 00000020:00000080:3.0:1788391096.825716:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d58716f000 for lustre-OST0000 00000001:00100000:1.0:1788391096.839515:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788391096.839527:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d5866e7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788391096.839554:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14847363-0daa-48dd-bf83-08d2101df15c 00000020:00000080:1.0:1788391096.839557:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d585fc3000/14847363-0daa-48dd-bf83-08d2101df15c 00000020:00000080:3.0:1788391096.839638:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5866e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788391096.839703:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585fc3000/14847363-0daa-48dd-bf83-08d2101df15c for lustre-OST0001 00000020:00000080:3.0:1788391096.839737:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5866e0000 for lustre-OST0001 00000020:00000080:3.0:1788391096.839742:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d585fc0000 for lustre-OST0001 00010000:00010000:1.0:1788391096.845172:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391097.874664:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391098.893259:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788391099.789714:0:41250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d692cab4e0 - data ffff95d6b5e68000/ffff95d587788c00 00000020:01000000:2.0:1788391099.789890:0:41250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d683564360 - data ffff95d68b2d1510/ffff95d6b69cf000 00000001:00000004:2.0:1788391099.799504:0:41250:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803896 00000100:00080000:2.0:1788391099.894145:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788391099.894154:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803793 gen 4 00000004:00080000:2.0:1788391099.894175:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788391099.894178:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788391099.896456:0:38457:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788391099.896465:0:38457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 4 count 1 00000040:00080000:0.0:1788391099.896482:0:38457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:1.0:1788391099.897847:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788391099.897853:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 4 00000004:00080000:1.0:1788391099.897995:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788391099.897999:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788391099.899436:0:38459:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788391099.899442:0:38459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 3 count 1 00000040:00080000:2.0:1788391099.899454:0:38459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:2.0:1788391099.933551:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd355ef 00000020:00000080:2.0:1788391099.933563:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d585122800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788391099.934281:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35604 00000020:00000080:2.0:1788391099.934288:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d686d5a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788391099.934293:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788391099.934299:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.934317:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788391099.934322:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff95d68a663370) has no exports 00000004:01000000:2.0:1788391099.934479:0:41250:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788391099.934488:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35651 00000020:00000080:2.0:1788391099.934493:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d684547800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788391099.934497:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788391099.934501:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.934506:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788391099.934509:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff95d6bc27cd28) has no exports 00000020:00000080:2.0:1788391099.934514:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3564a 00000020:00000080:2.0:1788391099.934517:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6865e1000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788391099.934859:0:41250:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788391099.934864:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788391099.934868:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 5 00000004:00080000:2.0:1788391099.934874:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788391099.934876:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788391099.934904:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.934910:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788391099.934915:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3563c 00000020:00000080:2.0:1788391099.934919:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6bcb47000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788391099.934923:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788391099.934926:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.934928:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788391099.934930:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff95d5873e8000) has no exports 00000020:00000080:2.0:1788391099.934933:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35635 00000020:00000080:2.0:1788391099.934936:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6a0fac800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788391099.935261:0:41250:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788391099.935264:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788391099.935266:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803793 gen 5 00000004:00080000:2.0:1788391099.935270:0:41250:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788391099.935271:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788391099.935292:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.935303:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788391099.935325:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.935328:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788391099.935363:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3560b 00000020:00000080:2.0:1788391099.935368:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d686d5f800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788391099.935372:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788391099.935374:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.935377:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788391099.935379:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff95d68a664d28) has no exports 00000020:00000080:2.0:1788391099.935395:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.935398:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788391099.935400:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35612 00000020:00000080:2.0:1788391099.935403:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d686d5e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788391099.935409:0:41250:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d68f07f000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788391099.935412:0:41250:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d68f07f000 3 00000020:01000004:2.0:1788391099.935415:0:41250:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d68f07f000 from lustre-MDT0000 00000020:00000080:2.0:1788391099.935431:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.935433:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788391099.935436:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d585120800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788391099.935439:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585120800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788391099.935447:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788391099.935500:0:41250:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788391099.935503:0:41250:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788391099.935505:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788391099.935508:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.935510:0:41250:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788391099.935515:0:41250:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff95d68f07a000 f33d137e-f79f-4925-8ad8-5351efff92b3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788391099.935520:0:41250:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff95d5873eb370) has exports, disconnecting them 00000020:00080000:2.0:1788391099.935524:0:41250:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95d68f07a000), last request at 1788391037 00000020:00000080:2.0:1788391099.935537:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd355b7 00000020:00010000:2.0:1788391099.935540:0:41250:0:(genops.c:1921:obd_stale_export_put()) Put export ffff95d68f07a000: total 8 00000100:00080000:2.0:1788391099.935544:0:41250:0:(import.c:65:import_set_state_nolock()) ffff95d68f07c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788391099.935571:0:41250:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d68f07a000): rc 0 00000020:00080000:2.0:1788391099.935575:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff95d5873eb370) has no exports 00000100:00100000:2.0:1788391099.935621:0:38430:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff95d692261a00:38430] 2 exiting: rc = 0 00000020:00010000:1.0:1788391099.935660:0:38423:0:(genops.c:1907:obd_stale_export_get()) Get export ffff95d68f07a000: total 8 00000100:00100000:2.0:1788391099.935690:0:38427:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff95d6bc8ede00:38427] 0 exiting: rc = 1 00010000:00010000:1.0:1788391099.935707:0:38423:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95d68f07a000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788391099.935736:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdda00/0x9aafc5f04cd3583b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35834 expref: 9 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935758:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6a6a93600/0x9aafc5f04cd356dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd356d6 expref: 8 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935774:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd35b83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35b7c expref: 7 pid: 38430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935783:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877ab000/0x9aafc5f04cd356eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd356e4 expref: 6 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935792:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cdd800/0x9aafc5f04cd35865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3585e expref: 5 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935802:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df7600/0x9aafc5f04cd35b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd35b8a expref: 4 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935815:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877ab600/0x9aafc5f04cd35715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd3570e expref: 3 pid: 38427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391099.935824:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d5877abc00/0x9aafc5f04cd355c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9aafc5f04cd355be expref: 2 pid: 38428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788391099.935831:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585122800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788391099.935834:0:38423:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95d68f07a000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788391099.935848:0:38423:0:(genops.c:885:class_export_put()) final put ffff95d68f07a000/f33d137e-f79f-4925-8ad8-5351efff92b3 00000020:00000080:0.0:1788391099.935851:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d686d5a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788391099.935858:0:38:0:(genops.c:885:class_export_put()) final put ffff95d585120000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788391099.935862:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585120000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00010000:00010000:1.0:1788391099.935868:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391099.935871:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391099.935874:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788391099.935878:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:1.0:1788391099.935914:0:38428:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff95d683499800:38428] 1 exiting: rc = 0 00000020:00000080:0.0:1788391099.936017:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d684547800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788391099.936025:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6865e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788391099.936030:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6865e0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788391099.936034:0:38:0:(genops.c:885:class_export_put()) final put ffff95d6bcb44000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788391099.936036:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb44000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788391099.936039:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788391099.936066:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bcb47000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788391099.936072:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a0fac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788391099.936078:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a0fad000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788391099.936082:0:38:0:(genops.c:885:class_export_put()) final put ffff95d6865e0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788391099.936084:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6865e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788391099.936087:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:1.0:1788391099.936123:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936135:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936145:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391099.936151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d686d5f800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:1.0:1788391099.936155:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391099.936157:0:38:0:(genops.c:885:class_export_put()) final put ffff95d585123000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788391099.936161:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585123000/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:1.0:1788391099.936165:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788391099.936167:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:1.0:1788391099.936172:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936176:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936180:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936188:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936194:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936208:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936215:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936220:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936226:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936235:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936239:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936247:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936257:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936264:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936272:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936280:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936289:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936299:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936309:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936317:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391099.936319:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d686d5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788391099.936325:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391099.936328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f07a000/f33d137e-f79f-4925-8ad8-5351efff92b3 for MGS 00000100:00100000:1.0:1788391099.936334:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936340:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936344:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936360:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936368:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788391099.936374:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d68f07c800 for MGS 00000100:00100000:1.0:1788391099.936380:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936386:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936391:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936394:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936398:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936402:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936406:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936410:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936413:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936418:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936424:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936428:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936433:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936436:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936440:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936444:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936447:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936451:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936455:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936459:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936463:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936467:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936471:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936476:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936479:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936484:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936488:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936491:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936496:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936499:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936508:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936512:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.936516:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788391099.936862:0:41250:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788391099.936864:0:41250:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788391099.937683:0:41250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d692cab8a0 - data ffff95d6b5e68948/ffff95d58778b400 00000020:01000000:1.0:1788391099.937805:0:41250:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d588024000 - data ffff95d584fd1948/ffff95d69ef1ec00 00000020:00000080:1.0:1788391099.938691:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3559b 00000020:00000080:1.0:1788391099.938697:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d682e3b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788391099.938897:0:41250:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d68f07f000 from MGS, refs=2 00000020:00000080:0.0:1788391099.938899:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e3b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788391099.938902:0:41250:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d68f07f000 2 00000020:01000004:1.0:1788391099.938907:0:41250:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d68f07f000 from MGS 00000020:00000080:1.0:1788391099.938928:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391099.938934:0:41250:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788391099.938937:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d682e3a000/MGS 00000020:00000080:1.0:1788391099.938940:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e3a000/MGS for MGS 00000020:01000000:1.0:1788391099.939116:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788391099.939165:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788391099.939169:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788391099.939175:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788391099.939185:0:41250:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95d6a6910000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788391099.939191:0:41250:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff95d68a660000) has exports, disconnecting them 00000020:00080000:1.0:1788391099.939196:0:41250:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95d6a6910000), last request at 1788391037 00000020:00000080:1.0:1788391099.939453:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35689 00000020:00080000:1.0:1788391099.939467:0:41250:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d6a6910000): rc 0 00000020:00000080:1.0:1788391099.939471:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6a6910000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788391099.939679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6910000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788391099.941066:0:41250:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788391099.941071:0:41250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391099.941076:0:41250:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788391099.941082:0:41250:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788391099.941149:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a6912000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788391099.941319:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788391099.941335:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788391099.941339:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d6a6915800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788391099.941341:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6915800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788391099.941356:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788391099.941423:0:41250:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d68f07f000 1 00000020:00000080:0.0:1788391099.941431:0:41250:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3558d 00000020:00000080:0.0:1788391099.941439:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d682e3f800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788391099.941664:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788391099.941670:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391099.941675:0:41250:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788391099.941678:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff95d6bc7599b8) has no exports 00000020:00000080:2.0:1788391099.942413:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e3f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788391099.959743:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788391099.959756:0:41250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788391099.959760:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d68f07c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788391099.959764:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d68f07c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788391099.959774:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788391099.959918:0:41250:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d68f07b000 00000020:01000000:2.0:1788391099.959941:0:41250:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788391099.959945:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391099.959949:0:41250:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788391099.959954:0:41250:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff95d5873e99b8) has no exports 00000100:00100000:1.0:1788391099.961565:0:39647:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff95d587cc1e00:39647] 3 exiting: rc = 0 00000100:00100000:2.0:1788391099.961567:0:38436:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff95d585265000:38436] 1 exiting: rc = 0 00000100:00100000:0.0:1788391099.961660:0:38435:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff95d585264e00:38435] 0 exiting: rc = 1 00000100:00100000:0.0:1788391099.961812:0:38437:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff95d6b3362000:38437] 2 exiting: rc = 0 00000100:00100000:2.0:1788391099.961853:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961861:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961868:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961873:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961878:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961881:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961884:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961887:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961891:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961893:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961897:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961901:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961905:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961910:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961914:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961928:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961932:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961938:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961942:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961980:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961989:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.961997:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962004:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962008:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962013:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962017:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962022:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962030:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962037:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962042:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962047:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962056:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962063:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962068:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962073:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962078:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962085:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962097:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962106:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962114:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962117:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962121:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962126:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962139:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962160:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962165:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962169:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962174:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962179:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962183:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962194:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962201:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962208:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962215:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962222:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962229:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962238:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962244:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962249:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962255:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962259:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962264:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962269:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.962275:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.965427:0:38438:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95d6b3362e00:38438] 0 exiting: rc = 1 00000100:00100000:0.0:1788391099.965550:0:38439:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95d585264c00:38439] 1 exiting: rc = 0 00000100:00100000:2.0:1788391099.965613:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965623:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965631:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965640:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965647:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965653:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965659:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965665:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965672:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965680:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965687:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965696:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965704:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965710:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965717:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965724:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965732:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965739:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965748:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965756:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965762:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965781:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965788:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965797:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965805:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965811:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965817:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965823:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965829:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965835:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965842:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965849:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965857:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965863:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965868:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965873:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965879:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965887:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788391099.965887:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391099.965895:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965901:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965907:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965912:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965918:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965923:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965928:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965933:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965938:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965956:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965990:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.965996:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966001:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966007:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966013:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966018:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966023:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966028:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966042:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966048:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966053:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966059:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966065:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966070:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966076:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966081:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391099.966527:0:38441:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff95d68f74bc00:38441] 1 exiting: rc = 0 00000100:00100000:3.0:1788391099.966645:0:38440:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff95d585265200:38440] 0 exiting: rc = 1 00000100:00100000:2.0:1788391099.966764:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966781:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966788:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966794:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966799:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966805:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966810:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966816:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966821:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966827:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966832:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966837:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966842:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966861:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966868:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966874:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966880:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966886:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966890:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966896:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966903:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966908:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966914:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966920:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966926:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966944:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966952:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.966992:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967001:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967007:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967014:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967021:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967027:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967033:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967042:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967050:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967063:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967085:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967094:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967100:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967106:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967112:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967119:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967124:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967131:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967137:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967142:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967148:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967155:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967175:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967182:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967190:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967302:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967311:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967317:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967324:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967330:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967337:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967343:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967555:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967562:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967583:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967595:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391099.967602:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.975331:0:38443:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95d692261400:38443] 1 exiting: rc = 0 00000100:00100000:0.0:1788391099.975749:0:38442:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95d692261200:38442] 0 exiting: rc = 1 00000100:00100000:3.0:1788391099.975792:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975801:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975806:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975809:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975833:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975840:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975847:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975853:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975859:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975866:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975874:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975879:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975887:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975893:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975898:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975903:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975907:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975913:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975918:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975922:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975927:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975932:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975937:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975941:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975946:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975949:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975952:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975956:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.975995:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976001:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976006:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976011:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976016:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976021:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976026:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976031:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976036:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976040:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976045:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976056:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976061:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976066:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976071:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976076:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976081:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976085:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976090:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976094:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976099:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976103:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976108:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976112:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976117:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976122:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976127:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976133:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976138:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976143:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976149:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976154:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976158:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976163:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976169:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976174:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976470:0:38445:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95d68385e800:38445] 1 exiting: rc = 0 00000100:00100000:2.0:1788391099.976470:0:38444:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95d6846d7000:38444] 0 exiting: rc = 1 00000100:00100000:3.0:1788391099.976524:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976530:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976536:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976541:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976546:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976551:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976556:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976561:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976567:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976578:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976581:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976585:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976590:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976595:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976600:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976605:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976610:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976615:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976620:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976625:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976630:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976635:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976640:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976644:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976647:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976651:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976655:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976658:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976661:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976664:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976667:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976671:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976675:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976680:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976685:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976690:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976695:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976700:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976705:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976710:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976716:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976721:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976727:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976731:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976741:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976744:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976748:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976751:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976755:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976758:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976761:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976764:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976767:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976770:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976773:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976775:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976778:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976781:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976784:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976787:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976790:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976793:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976795:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.976798:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977049:0:38447:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff95d6846d7c00:38447] 1 exiting: rc = 0 00000100:00100000:2.0:1788391099.977049:0:38446:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff95d6a1742e00:38446] 0 exiting: rc = 1 00000100:00100000:3.0:1788391099.977102:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977110:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977115:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977120:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977125:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977131:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977137:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977143:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977151:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977157:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977162:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977171:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977177:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977182:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977195:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977200:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977205:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977211:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977217:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977222:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977227:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977234:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977237:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977241:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977245:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977249:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977254:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977258:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977262:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977268:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977272:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977275:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977280:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977284:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977289:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977293:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977297:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977301:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977305:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977309:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977313:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977318:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977328:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977337:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977357:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977364:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977370:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977376:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977381:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977392:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977395:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977398:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977401:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977405:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977408:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977411:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977414:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977417:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977419:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977422:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977425:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977428:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977430:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.977433:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391099.977888:0:38450:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff95d5852ffc00:38450] 2 exiting: rc = 0 00000100:00100000:2.0:1788391099.978899:0:38449:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff95d6922a9200:38449] 1 exiting: rc = 0 00000100:00100000:0.0:1788391099.978906:0:38448:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff95d6922a9600:38448] 0 exiting: rc = 1 00000100:00100000:3.0:1788391099.979799:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979807:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979813:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979823:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979829:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979842:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979847:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979853:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979861:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979866:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979872:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979878:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979884:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979890:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979896:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979903:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979909:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979915:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979921:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979927:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979941:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979952:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979957:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979976:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979983:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979990:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.979997:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980002:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980010:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980034:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980043:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980050:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980057:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980071:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980079:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980087:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980093:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980100:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980105:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980115:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980121:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980127:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980133:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980143:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980149:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980154:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980159:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980165:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980170:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980175:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980189:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980303:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980312:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980319:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980324:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980338:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980343:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980361:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980368:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980374:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980379:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980387:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980393:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391099.980398:0:41250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788391099.984551:0:41250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391099.984565:0:41250:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788391099.984569:0:41250:0:(genops.c:885:class_export_put()) final put ffff95d682e3d000/MDS_uuid 00000020:00000080:3.0:1788391099.984573:0:41250:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e3d000/MDS_uuid for MDS 00000020:01000000:3.0:1788391099.984579:0:41250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788391099.984706:0:41250:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788391101.005122:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788391101.755699:0:41402:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788391101.767805:0:41402:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788391101.767855:0:41402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.767871:0:41402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.767878:0:41402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.767885:0:41402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.767904:0:41402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788391101.767909:0:41402:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788391101.767933:0:41402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788391101.767938:0:41402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788391101.767944:0:41402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788391101.767951:0:41402:0:(import.c:65:import_set_state_nolock()) ffff95d587169800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788391101.767955:0:41402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788391101.767957:0:41402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788391101.767981:0:41402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788391101.768037:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391101.768045:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391101.768071:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d5877ab800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391101.768075:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391101.768084:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391101.768091:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391101.768097:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391101.768100:0:38424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788391101.768103:0:38424:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788391101.768186:0:38424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391101.768194:0:38424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391101.768218:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391101.768224:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d5877ab800/0x9aafc5f04cd3570e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35715 expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391101.768235:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391101.768237:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391101.768238:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391101.768254:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103433216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391101.768321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391101.768401:0:40545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433216 00000100:00100000:1.0:1788391101.768414:0:40545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433216 00000100:00100000:1.0:1788391101.768450:0:40545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788391101.768457:0:40545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3287:x1875263103433216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788391101.768463:0:40545:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788391101 with bad export cookie 11146345238637008311 00010000:00010000:2.0:1788391101.769582:0:41402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769594:0:41402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769611:0:41402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769619:0:41402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769639:0:41402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391101.769650:0:41402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769656:0:41402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769662:0:41402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391101.769668:0:41402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769671:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391101.769684:0:41402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391101.769687:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391101.769689:0:41402:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788391101.769697:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391101.769700:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769706:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391101.769710:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788391101.769715:0:41402:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788391101.769720:0:41402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:01000000:0.0:1788391101.769724:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788391101.769727:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788391101.769728:0:38423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00000080:2.0:1788391101.769731:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788391101.769737:0:41402:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788391101.769742:0:41402:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d6bc75b370) has no exports 00010000:00010000:0.0:1788391101.769749:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769754:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788391101.769770:0:41402:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff95d6bc75b370) has no exports 00010000:00010000:0.0:1788391101.769771:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769779:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc800/0x9aafc5f04cd356e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd356eb expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769787:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391101.769789:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769792:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391101.769794:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769799:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391101.769802:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391101.769805:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788391101.769806:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788391101.769811:0:38423:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788391101.769819:0:38423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769823:0:38423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391101.769827:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769830:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc000/0x9aafc5f04cd35b8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9aafc5f04cd35b91 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391101.769836:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391101.769837:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391101.769838:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391101.769850:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103433344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391101.769908:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391101.769937:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391101.769943:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103433472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391101.769995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391101.770024:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433344 00000100:00100000:0.0:1788391101.770029:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433344 00000100:00100000:0.0:1788391101.770050:0:38420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433472 00000100:00100000:0.0:1788391101.770052:0:38420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433472 00000100:00100000:0.0:1788391101.770062:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788391101.770068:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3288:x1875263103433344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788391101.770073:0:38420:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788391101 with bad export cookie 11146345238637008311 00000100:00100000:0.0:1788391101.770111:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3288:x1875263103433344:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (203us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788391101.770118:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788391101.770133:0:38420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788391101.770142:0:38420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3288:x1875263103433472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788391101.770146:0:38420:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788391101 with bad export cookie 11146345238637008311 00000100:00100000:0.0:1788391101.770170:0:38420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3288:x1875263103433472:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (175us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788391101.770175:0:38420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788391101.770216:0:3288:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788391101.770220:0:3288:0:(import.c:65:import_set_state_nolock()) ffff95d682e3a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788391101.770224:0:3288:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1788391101.774141:0:41402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d692cab300 - data ffff95d68b2ce0d8/ffff95d5852bb800 00000020:01000000:2.0:1788391101.774301:0:41402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d68a830c00 - data ffff95d6b5e21a20/ffff95d585b40000 00010000:00010000:1.0:1788391101.782078:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391101.782715:0:40545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3287:x1875263103433216:12345-0@lo:103:ldlm_bl.0 Request processed in 14251us (14388us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788391101.782726:0:40545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788391101.782794:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788391101.791146:0:3288:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788391101.791151:0:3288:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788391101.791159:0:3288:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf0380 x1875263103433216/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788391117 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391101.791171:0:3288:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d586480000 x1875263103433344/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788391117 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391101.791178:0:3288:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d586483480 x1875263103433472/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788391117 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788391101.791190:0:3288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788391101.791193:0:3288:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788391101.791194:0:3288:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788391101.791198:0:3288:0:(import.c:65:import_set_state_nolock()) ffff95d682e3a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391101.791203:0:3288:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 854 00000100:00080000:0.0:1788391101.791210:0:3288:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d682e3a800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391101.791435:0:3288:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf3480 x1875263103433600/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788391101.791483:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103433344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391101.791510:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f33d137e-f79f-4925-8ad8-5351efff92b3:3288:1875263103433472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391101.793066:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f33d137e-f79f-4925-8ad8-5351efff92b3:3285:1875263103433600:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788391101.793122:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875263103433600 offset 0 length 520: 4 00000100:00080000:2.0:1788391101.795457:0:3287:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff95d682e3a800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788391101.795655:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f33d137e-f79f-4925-8ad8-5351efff92b3:3287:1875263103433216:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1788391101.800543:0:41402:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788391101.818361:0:41402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd356f9 00000020:00000080:3.0:1788391101.818369:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d6853bf000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788391101.818405:0:41402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6bbee1000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788391101.818409:0:41402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bbee1000 2 00000020:01000004:3.0:1788391101.818413:0:41402:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d6bbee1000 from lustre-OST0000 00000020:00000080:0.0:1788391101.818439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853bf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788391101.818444:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391101.818453:0:41402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788391101.818456:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d6853b8800/lustre-OST0000_UUID 00000020:00000080:3.0:1788391101.818458:0:41402:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6853b8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788391101.818465:0:41402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788391101.818517:0:41402:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788391101.818520:0:41402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788391101.818523:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391101.818526:0:41402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788391101.818531:0:41402:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95d58716a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788391101.818536:0:41402:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff95d6bc2799b8) has exports, disconnecting them 00000020:00080000:3.0:1788391101.818547:0:41402:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95d58716a800), last request at 1788391046 00000020:00000080:3.0:1788391101.818550:0:41402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35723 00000020:00080000:3.0:1788391101.818557:0:41402:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d58716a800): rc 0 00000020:00000080:3.0:1788391101.818561:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d58716a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788391101.818594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58716a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788391101.826064:0:41402:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788391101.826082:0:41402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391101.826086:0:41402:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788391101.826094:0:41402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788391101.826200:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d587169800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788391101.826286:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788391101.826295:0:41402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788391101.826300:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d690529000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788391101.826311:0:41402:0:(genops.c:844:class_export_destroy()) destroying export ffff95d690529000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788391101.826320:0:41402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788391101.826384:0:41402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bbee1000 1 00000020:00000080:0.0:1788391101.826389:0:41402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd356c8 00000020:00000080:0.0:1788391101.826395:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d688579000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788391101.826409:0:41402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788391101.826413:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391101.826422:0:41402:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788391101.826426:0:41402:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff95d6bc75cd28) has no exports 00000020:00000080:1.0:1788391101.826439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d688579000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788391101.837504:0:41402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391101.837520:0:41402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788391101.837526:0:41402:0:(genops.c:885:class_export_put()) final put ffff95d6bbee1800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788391101.837531:0:41402:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788391101.837539:0:41402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788391101.837827:0:41402:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d6bbee5800 00000020:02000400:1.0:1788391101.837894:0:41402:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788391101.901072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f33d137e-f79f-4925-8ad8-5351efff92b3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788391101.901081:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f33d137e-f79f-4925-8ad8-5351efff92b3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788391101.901084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788391101.901088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788391101.901093:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391101.901101:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 913 00000100:00080000:0.0:1788391101.901107:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788391101.901113:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d5866e7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391101.901148:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d586481180 x1875263103433728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391101.901204:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103433728:0@lo:38:kworker.0 00000400:00000100:2.0:1788391101.901261:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875263103433728 offset 0 length 520: 4 00010000:00010000:0.0:1788391102.030380:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391103.055385:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788391103.614449:0:41552:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788391103.628514:0:41552:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788391103.628595:0:41552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391103.628621:0:41552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391103.628630:0:41552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391103.628637:0:41552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391103.628666:0:41552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788391103.628672:0:41552:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788391103.628694:0:41552:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391103.628706:0:41552:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d586481180 x1875263103433728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788391116 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788391103.628777:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391103.628785:0:38423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391103.628792:0:38423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1200 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:2.0:1788391103.628795:0:38423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391103.628803:0:38423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788391103.628810:0:38423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391103.628816:0:38423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788391103.628818:0:38423:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788391103.628820:0:38423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788391103.628833:0:38423:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682e3a800 00010000:00010000:2.0:1788391103.628838:0:38423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391103.628844:0:38423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3585e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd35865 expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391103.628865:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391103.628866:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391103.628868:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391103.628897:0:41552:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788391103.628904:0:41552:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788391103.628909:0:41552:0:(import.c:65:import_set_state_nolock()) ffff95d5866e7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788391103.628914:0:41552:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788391103.628918:0:41552:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d586481180 x1875263103433728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788391116 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391103.631005:0:41552:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788391103.631825:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103433728:0@lo:38:kworker.0 00000100:00100000:0.0:1788391103.631890:0:41552:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788391103.632931:0:41552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.632947:0:41552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633172:0:41552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633179:0:41552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391103.633451:0:41552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391103.633461:0:41552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391103.633468:0:41552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391103.633473:0:41552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391103.633478:0:41552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633505:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788391103.633510:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633517:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391103.633520:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633528:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391103.633534:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391103.633539:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788391103.633541:0:38424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788391103.633550:0:38424:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682e3a800 00010000:00010000:1.0:1788391103.633553:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633559:0:38424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd0400/0x9aafc5f04cd35834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd3583b expref: -99 pid: 39836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633587:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391103.633590:0:38424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633595:0:38424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391103.633598:0:38424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633604:0:38424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391103.633611:0:38424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391103.633616:0:38424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788391103.633618:0:38424:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788391103.633623:0:38424:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682e3a800 00010000:00010000:1.0:1788391103.633625:0:38424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391103.633632:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391103.633634:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391103.633636:0:38424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391103.633686:0:41552:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788391103.633690:0:41552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4c1e600/0x9aafc5f04cd35b7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd35b83 expref: -99 pid: 38432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391103.633702:0:41552:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788391103.633707:0:41552:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788391103.633709:0:41552:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788391103.633730:0:41552:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788391103.633734:0:41552:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788391103.633739:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391103.633744:0:41552:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788391103.633752:0:41552:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d683d499b8) has no exports 00000020:00080000:3.0:1788391103.633782:0:41552:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff95d683d499b8) has no exports 00000020:01000000:3.0:1788391103.635500:0:41552:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d6a35bd360 - data ffff95d6b5e6e5e8/ffff95d5859c3800 00000020:01000000:3.0:1788391103.635648:0:41552:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95d69040c540 - data ffff95d6b5e810d8/ffff95d5852b9c00 00010000:00010000:2.0:1788391103.636069:0:38423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788391103.646941:0:41552:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788391103.662410:0:41552:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35849 00000020:00000080:0.0:1788391103.662421:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d585fc2000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788391103.662436:0:41552:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d58716d800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788391103.662439:0:41552:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58716d800 2 00000020:01000004:0.0:1788391103.662442:0:41552:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95d58716d800 from lustre-OST0001 00000020:00000080:0.0:1788391103.662470:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391103.662483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585fc2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788391103.662488:0:41552:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788391103.662491:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d585fc6800/lustre-OST0001_UUID 00000020:00000080:0.0:1788391103.662493:0:41552:0:(genops.c:844:class_export_destroy()) destroying export ffff95d585fc6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788391103.662499:0:41552:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788391103.662638:0:41552:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f33d137e-f79f-4925-8ad8-5351efff92b3->MGS 00010000:00010000:0.0:1788391103.662658:0:41552:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391103.662670:0:41552:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391103.662677:0:41552:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788391103.662680:0:41552:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788391103.662683:0:41552:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788391103.662696:0:41552:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682e3a800 00010000:00010000:0.0:1788391103.662700:0:41552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd356d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd356dd expref: -99 pid: 39117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391103.662716:0:41552:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391103.662723:0:41552:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391103.662728:0:41552:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788391103.662730:0:41552:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788391103.662732:0:41552:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788391103.662767:0:41552:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95d682e3a800 00010000:00010000:0.0:1788391103.662770:0:41552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cdc200/0x9aafc5f04cd355be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9aafc5f04cd355c5 expref: -99 pid: 38417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788391103.662788:0:41552:0:(import.c:65:import_set_state_nolock()) ffff95d682e3a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788391103.662797:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788391103.662800:0:41552:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788391103.662801:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788391103.662805:0:41552:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788391103.662815:0:41552:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95d6bbcf3480 x1875263103433600/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788391111 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788391103.662975:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788391103.662978:0:41552:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1788391103.663029:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f33d137e-f79f-4925-8ad8-5351efff92b3:3285:1875263103433600:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1788391103.663079:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788391103.663086:0:41552:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd355a9 00000020:00000080:0.0:1788391103.663091:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d682e3b800/f33d137e-f79f-4925-8ad8-5351efff92b3 00000020:01000000:0.0:1788391103.663101:0:41552:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:0.0:1788391103.663106:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391103.663111:0:41552:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788391103.663114:0:41552:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff95d5873ecd28) has no exports 00000020:00000080:1.0:1788391103.663116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e3b800/f33d137e-f79f-4925-8ad8-5351efff92b3 for MGC192.168.202.101@tcp 10000000:01000000:2.0:1788391103.663195:0:38432:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788391103.663253:0:41552:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:0.0:1788391103.663256:0:41552:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788391103.663258:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788391103.663260:0:41552:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788391103.663261:0:41552:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788391103.663330:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788391103.663335:0:41552:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid f33d137e-f79f-4925-8ad8-5351efff92b3) 00000020:01000000:0.0:1788391103.663339:0:41552:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788391103.663345:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788391103.663349:0:41552:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788391103.663353:0:41552:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95d5866e4800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788391103.663372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d682e3a800 for MGC192.168.202.101@tcp 00000020:00000080:1.0:1788391103.663379:0:8:0:(genops.c:885:class_export_put()) final put ffff95d682e39000/f33d137e-f79f-4925-8ad8-5351efff92b3 00000020:00000080:1.0:1788391103.663381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d682e39000/f33d137e-f79f-4925-8ad8-5351efff92b3 for MGC192.168.202.101@tcp 00000020:00080000:0.0:1788391103.663385:0:41552:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff95d6a6bd4d28) has exports, disconnecting them 00000020:00080000:0.0:1788391103.663389:0:41552:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95d5866e4800), last request at 1788391055 00000020:01000000:1.0:1788391103.663390:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (f33d137e-f79f-4925-8ad8-5351efff92b3) 00000020:00000080:0.0:1788391103.663393:0:41552:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd35873 00000020:00080000:0.0:1788391103.663401:0:41552:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95d5866e4800): rc 0 00000020:00000080:0.0:1788391103.663405:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d5866e4800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788391103.663654:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d5866e4800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788391103.667016:0:41552:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788391103.667025:0:41552:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788391103.667029:0:41552:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788391103.667037:0:41552:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788391103.667188:0:38424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788391103.667458:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d5866e7800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788391103.667475:0:38423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788391103.667630:0:38419:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95d6865c8c00:38419] 1 exiting: rc = 0 00000100:00100000:2.0:1788391103.667902:0:38418:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95d6865c9e00:38418] 0 exiting: rc = 1 00000100:00100000:1.0:1788391103.668041:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668291:0:38422:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95d6865c8200:38422] 2 exiting: rc = 0 00000100:00100000:2.0:1788391103.668298:0:38420:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95d6865c9600:38420] 0 exiting: rc = 1 00000100:00100000:1.0:1788391103.668360:0:40545:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95d587dee200:40545] 3 exiting: rc = 0 00000100:00100000:3.0:1788391103.668440:0:38421:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95d6865c9800:38421] 1 exiting: rc = 0 00000100:00100000:1.0:1788391103.668489:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668497:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668503:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668508:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668518:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668525:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668531:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668538:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668548:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668556:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668561:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668566:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668574:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668579:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668657:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668665:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668670:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668676:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668681:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668687:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668692:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668698:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668717:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668722:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668727:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668733:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668738:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668743:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668748:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668753:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668758:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668763:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668769:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668774:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668777:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668781:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668785:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668789:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668793:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668796:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668800:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668803:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668806:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668809:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668812:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668816:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668819:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668822:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668825:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668828:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668831:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668835:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668838:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668852:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668855:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668859:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668864:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668873:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668876:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668880:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668884:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668888:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668891:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.668895:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788391103.669453:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788391103.669460:0:41552:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788391103.669464:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d6bc639800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788391103.669467:0:41552:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bc639800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788391103.669471:0:41552:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788391103.669500:0:41552:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d58716d800 1 00000020:00000080:1.0:1788391103.669504:0:41552:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3582d 00000020:00000080:1.0:1788391103.669509:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d6a6b04000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788391103.669520:0:41552:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788391103.669524:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788391103.669529:0:41552:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788391103.669532:0:41552:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95d6bc27b370) has no exports 00000020:00000080:2.0:1788391103.669539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6b04000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788391103.682999:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391103.683018:0:41552:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788391103.683024:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d58716c800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788391103.683029:0:41552:0:(genops.c:844:class_export_destroy()) destroying export ffff95d58716c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788391103.683036:0:41552:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788391103.683235:0:41552:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95d58716d000 00000020:01000000:3.0:1788391103.683256:0:41552:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788391103.683260:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788391103.683265:0:41552:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788391103.683270:0:41552:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff95d6a6bd19b8) has no exports 00000020:00000080:3.0:1788391103.683297:0:41552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788391103.683303:0:41552:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788391103.683306:0:41552:0:(genops.c:885:class_export_put()) final put ffff95d6bbee4000/OSS_uuid 00000020:00000080:3.0:1788391103.683308:0:41552:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6bbee4000/OSS_uuid for OSS 00000020:01000000:3.0:1788391103.683324:0:41552:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788391103.683342:0:38431:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788391103.683456:0:39118:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff95d6922d0400:39118] 0 exiting: rc = 1 00000100:00100000:2.0:1788391103.683462:0:39120:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff95d58719fc00:39120] 1 exiting: rc = 0 00000100:00100000:1.0:1788391103.683512:0:39225:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff95d587060600:39225] 3 exiting: rc = 0 00000100:00100000:0.0:1788391103.684947:0:40764:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff95d5859ffe00:40764] 4 exiting: rc = 0 00000100:00100000:0.0:1788391103.685033:0:39121:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff95d6a6973400:39121] 2 exiting: rc = 0 00000100:00100000:3.0:1788391103.685089:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685098:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685103:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685108:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685113:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685118:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685123:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685129:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685135:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685140:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685145:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685163:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685168:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685174:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685179:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685183:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685189:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685194:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685199:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685204:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685209:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685215:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685221:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685227:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685233:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685238:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685243:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685248:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685253:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685258:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685263:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685268:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685273:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685279:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685284:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685289:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685294:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685301:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685308:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685325:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685331:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685336:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685341:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685347:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685352:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685358:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685371:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685377:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685382:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685386:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685391:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685397:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685402:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685409:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685414:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685419:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685425:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685430:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685436:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685441:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685447:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685451:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685456:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.685461:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.687614:0:39123:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95d6a6972800:39123] 1 exiting: rc = 0 00000100:00100000:0.0:1788391103.687730:0:39122:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95d6a6973c00:39122] 0 exiting: rc = 1 00000100:00100000:3.0:1788391103.687777:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687786:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687792:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687797:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687802:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687808:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687814:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687820:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687825:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687829:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687834:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687839:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687844:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687849:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687854:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687860:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687864:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687883:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687888:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687893:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687898:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687903:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687909:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687915:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687920:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687925:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687930:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687935:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687939:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687943:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687948:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.687956:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688028:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688034:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688039:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688044:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688049:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688054:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688060:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688065:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688071:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688076:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688081:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688086:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688092:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688097:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688102:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688109:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688116:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688120:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688123:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688127:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688136:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688140:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688143:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688146:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688149:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688153:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688157:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688160:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688163:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688167:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688169:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.688172:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391103.689113:0:39124:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95d6a6972200:39124] 0 exiting: rc = 1 00000100:00100000:2.0:1788391103.689285:0:39125:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95d68385e200:39125] 1 exiting: rc = 0 00000100:00100000:1.0:1788391103.689369:0:39126:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95d58719ee00:39126] 2 exiting: rc = 0 00000100:00100000:3.0:1788391103.689412:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689418:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689424:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689433:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689438:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689443:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689448:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689454:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689459:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689464:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689470:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689476:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689482:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689488:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689494:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689499:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689505:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689510:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689515:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689520:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689525:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689531:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689573:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689587:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689772:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689777:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689782:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689788:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689794:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689800:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689806:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689811:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689816:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689822:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689827:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689833:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689839:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689845:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689850:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689856:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689861:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689867:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689872:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689879:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689885:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689890:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689904:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689909:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689912:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689916:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689920:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689923:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689927:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689931:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689934:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689938:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689941:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689945:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689953:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.689956:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.690036:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.690043:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.690049:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788391103.690055:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788391103.694911:0:39127:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95d58719f000:39127] 0 exiting: rc = 1 00000100:00100000:3.0:1788391103.694917:0:39128:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95d58719e000:39128] 1 exiting: rc = 0 00000100:00100000:2.0:1788391103.695121:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695129:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695135:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695140:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695146:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695156:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695162:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695194:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695201:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695208:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695213:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695218:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695224:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695229:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695233:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695251:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695257:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695262:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695268:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695273:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695276:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695280:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695283:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695286:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695290:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695293:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695296:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695300:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695304:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695307:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695336:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695342:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695348:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695352:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695358:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695363:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695368:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695373:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695379:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695384:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695388:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695393:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695398:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695404:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695408:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695413:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695420:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695426:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695431:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695438:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695458:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695463:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695468:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695473:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695478:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695484:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695489:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695494:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695497:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695501:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695504:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695509:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695515:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.695520:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788391103.696347:0:39129:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95d584a1de00:39129] 0 exiting: rc = 1 00000100:00100000:1.0:1788391103.696350:0:39130:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95d683a7e800:39130] 1 exiting: rc = 0 00000100:00100000:2.0:1788391103.696446:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696460:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696466:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696471:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696475:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696479:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696494:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696498:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696502:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696507:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696512:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696516:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696520:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696524:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696528:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696532:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696535:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696540:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696552:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696556:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696560:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696572:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696578:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696585:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696590:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696596:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696603:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696610:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696615:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696619:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696633:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696638:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696643:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696646:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696651:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696654:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696658:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696662:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696666:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696734:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696739:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696743:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696759:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696767:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696773:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696779:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696784:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696792:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696798:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696804:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696811:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696815:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696818:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696822:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696838:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696846:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696860:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696867:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696878:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696884:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696889:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696893:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696905:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788391103.696914:0:41552:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788391103.704735:0:41552:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788391114.167004:0:42164:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788391118.763495:0:42625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788391118.763500:0:42625:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788391118.763614:0:42625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d586c62000 00000020:01000004:1.0:1788391118.763629:0:42625:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788391118.763637:0:42625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788391118.763660:0:42625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95d683d4cd28) 00000020:00000080:1.0:1788391118.763674:0:42625:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788391118.775955:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788391118.778141:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3a:0x0] (8/32) 00100000:10000000:1.0:1788391118.778513:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788391118.778648:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788391118.778831:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788391118.778899:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788391118.779075:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788391118.779187:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788391118.779286:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788391118.779527:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1788391118.780707:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 68: rc = 0 00100000:10000000:1.0:1788391118.780808:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 68: rc = 0 00100000:10000000:1.0:1788391118.781400:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.781651:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:1.0:1788391118.781893:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:1.0:1788391118.782294:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.782535:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:1.0:1788391118.782767:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.783038:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.783296:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:1.0:1788391118.783537:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.784343:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:1.0:1788391118.784599:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:1.0:1788391118.784823:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:1.0:1788391118.785514:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 95: rc = 0 00100000:10000000:1.0:1788391118.785788:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 95: rc = 0 00100000:10000000:1.0:1788391118.786119:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 95: rc = 0 00100000:10000000:1.0:1788391118.786375:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 95: rc = 0 00100000:10000000:1.0:1788391118.786617:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 95: rc = 0 00100000:10000000:1.0:1788391118.786875:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 95: rc = 0 00100000:10000000:1.0:1788391118.787147:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 95: rc = 0 00100000:10000000:1.0:1788391118.787403:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 95: rc = 0 00100000:10000000:1.0:1788391118.787644:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 95: rc = 0 00100000:10000000:1.0:1788391118.787902:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 95: rc = 0 00100000:10000000:1.0:1788391118.788243:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 95: rc = 0 00100000:10000000:1.0:1788391118.788481:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 95: rc = 0 00100000:10000000:1.0:1788391118.788720:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 95: rc = 0 00100000:10000000:1.0:1788391118.789087:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 95: rc = 0 00100000:10000000:1.0:1788391118.789362:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 95: rc = 0 00100000:10000000:1.0:1788391118.789608:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 95: rc = 0 00100000:10000000:1.0:1788391118.789845:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 95: rc = 0 00100000:10000000:1.0:1788391118.790196:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 95: rc = 0 00100000:10000000:1.0:1788391118.790435:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 95: rc = 0 00100000:10000000:1.0:1788391118.790675:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 95: rc = 0 00100000:10000000:1.0:1788391118.790902:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 95: rc = 0 00100000:10000000:1.0:1788391118.791187:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 95: rc = 0 00100000:10000000:1.0:1788391118.791427:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 95: rc = 0 00100000:10000000:1.0:1788391118.791662:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 95: rc = 0 00100000:10000000:1.0:1788391118.791905:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 95: rc = 0 00100000:10000000:1.0:1788391118.792284:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 95: rc = 0 00100000:10000000:1.0:1788391118.792525:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 95: rc = 0 00100000:10000000:1.0:1788391118.792768:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 95: rc = 0 00100000:10000000:1.0:1788391118.793352:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 95: rc = 0 00100000:10000000:1.0:1788391118.793606:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 95: rc = 0 00100000:10000000:1.0:1788391118.793843:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 95: rc = 0 00100000:10000000:1.0:1788391118.794192:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 95: rc = 0 00100000:10000000:1.0:1788391118.794551:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 84: rc = 0 00100000:10000000:1.0:1788391118.795045:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788391118.795224:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 69: rc = 0 00100000:10000000:1.0:1788391118.795420:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788391118.795487:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 69: rc = 0 00100000:10000000:1.0:1788391118.795664:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788391118.795729:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 69: rc = 0 00100000:10000000:1.0:1788391118.796166:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788391118.796247:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 73: rc = 0 00100000:10000000:1.0:1788391118.796427:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788391118.796493:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 73: rc = 0 00100000:10000000:1.0:1788391118.796671:0:42625:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788391118.796738:0:42625:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 73: rc = 0 00000020:00000080:1.0:1788391118.797673:0:42625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788391118.797681:0:42625:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788391118.797690:0:42625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd361fe 00000020:01000004:1.0:1788391118.797697:0:42625:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788391118.797703:0:42625:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788391118.797708:0:42625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d586c62000 from MGS 00000020:01000004:1.0:1788391118.797712:0:42625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788391118.797722:0:42625:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff95d683d48000) 00000020:00000080:1.0:1788391118.797731:0:42625:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788391118.797781:0:42625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d586c62000 from MGS, refs=2 00080000:01000000:1.0:1788391118.797790:0:42625:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788391118.797794:0:42625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd3620c 00000100:00100000:1.0:1788391118.797889:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788391118.798250:0:42625:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788391118.798257:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788391118.798611:0:42625:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788391118.798617:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788391118.799704:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788391118.799848:0:42625:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788391118.799854:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788391118.800334:0:42625:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788391118.800340:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788391118.800654:0:42625:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788391118.800660:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788391118.801234:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391118.801237:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391118.801239:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391118.801482:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391118.801485:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391118.801486:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391118.801912:0:42625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788391118.807051:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788391118.814470:0:42625:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788391118.814488:0:42625:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788391118.814492:0:42625:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788391118.820211:0:42635:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788391118.820434:0:42625:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788391118.820543:0:42625:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788391118.821047:0:42625:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788391118.821462:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391118.821607:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788391118.821612:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788391118.824621:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788391118.824631:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788391118.824896:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788391118.824901:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788391118.825650:0:42625:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788391118.825670:0:42625:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:0.0:1788391118.825672:0:42625:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788391118.825698:0:42625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:0.0:1788391118.825710:0:42625:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff95d6bc2799b8) 00000020:00000080:0.0:1788391118.825725:0:42625:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788391118.825796:0:42625:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d5851c5000@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788391118.825950:0:42625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:0.0:1788391118.825956:0:42625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788391118.827342:0:42641:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788391118.827418:0:42625:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid d2d257ec-6d90-4f1c-863a-372d5df14bf2) 00000020:00000080:0.0:1788391118.827435:0:42625:0:(genops.c:1385:class_connect()) connect: client d2d257ec-6d90-4f1c-863a-372d5df14bf2, cookie 0x9aafc5f04cd3621a 00000100:00080000:0.0:1788391118.827446:0:42625:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788391118.827452:0:42625:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff95d5851c5000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391118.827479:0:42625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d586481f80 x1875263103433856/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788391118.827504:0:42625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d2d257ec-6d90-4f1c-863a-372d5df14bf2->MGS 00000020:01000004:0.0:1788391118.827530:0:42625:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788391118.827534:0:42625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788391118.827544:0:42625:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95d6bc27cd28) 00000020:00000080:0.0:1788391118.827553:0:42625:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788391118.829208:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3285:1875263103433856:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788391118.829275:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.835241:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433856 00000100:00100000:2.0:1788391118.835257:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433856 00000100:00100000:2.0:1788391118.835295:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391118.835303:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1875263103433856:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788391118.835328:0:42637:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d2d257ec-6d90-4f1c-863a-372d5df14bf2@0@lo t0 exp 0000000000000000 cur 935 last 0 00000020:00000080:2.0:1788391118.835358:0:42637:0:(genops.c:1385:class_connect()) connect: client d2d257ec-6d90-4f1c-863a-372d5df14bf2, cookie 0x9aafc5f04cd36228 00000100:00080000:2.0:1788391118.835477:0:42637:0:(import.c:65:import_set_state_nolock()) ffff95d6a6dc9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391118.835562:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:3285:x1875263103433856:12345-0@lo:250:mount.lustre.0 Request processed in 259us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391118.835570:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391118.835621:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788391118.835636:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1788391118.835643:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788391118.835648:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788391118.835651:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d5851c5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788391118.835653:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788391118.835661:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788391118.835667:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3285:1875263103433856:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788391118.836058:0:42640:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788391118.842821:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391118.843029:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788391118.843036:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788391118.846365:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788391118.846375:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788391118.849337:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788391118.849350:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788391118.850496:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391118.850640:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788391118.850644:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788391118.852756:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788391118.852767:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788391118.876129:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788391118.876355:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788391118.876362:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788391118.877270:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788391118.877280:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788391118.877782:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391118.877927:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788391118.877933:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788391118.878390:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788391118.878397:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788391118.878817:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788391118.878945:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788391118.878950:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788391118.879586:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788391118.879593:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788391118.880266:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788391118.880411:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788391118.880418:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788391118.881087:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788391118.881094:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788391118.895384:0:42625:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788391118.895595:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788391118.895610:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788391118.896673:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788391118.896681:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788391118.897333:0:42625:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788391118.897340:0:42625:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788391118.897989:0:42625:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788391118.898013:0:42625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788391118.898019:0:42625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788391118.898145:0:42625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788391118.899359:0:42625:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788391118.899365:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788391118.899367:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391118.899369:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391118.899370:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391118.899371:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391118.899372:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391118.899373:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391118.899374:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391118.899375:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391118.899376:0:42625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788391118.899378:0:42625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788391118.899380:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788391118.899381:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391118.899382:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391118.899382:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391118.899383:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391118.899383:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391118.899384:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391118.899385:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391118.899385:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391118.899386:0:42625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788391118.899423:0:42625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788391118.899439:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103433984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788391118.899492:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.899527:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79900 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.899548:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103433984 00000100:00100000:3.0:1788391118.899556:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103433984 00000100:00100000:3.0:1788391118.899602:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391118.899612:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:42625:x1875263103433984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788391118.899650:0:42639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788391118.899654:0:42639:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788391118.899656:0:42639:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788391118.899974:0:42660:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788391118.900564:0:42639:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 20 20000000:01000000:1.0:1788391118.902139:0:42661:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788391118.902156:0:42661:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788391118.902159:0:42661:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788391118.902213:0:42661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788391118.902555:0:42639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788391118.902565:0:42639:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788391118.907917:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:42625:x1875263103433984:12345-0@lo:253:mount.lustre.0 Request processed in 8295us (8411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.907934:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391118.908104:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103433984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788391118.908131:0:42625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788391118.908134:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788391118.908136:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391118.908138:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391118.908139:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391118.908140:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391118.908142:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391118.908143:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391118.908145:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391118.908147:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391118.908148:0:42625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788391118.908168:0:42625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d586c62000 from lustre-MDT0000 10000000:01000000:1.0:1788391118.908201:0:42625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788391118.908204:0:42625:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788391118.908208:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95d6bc2799b8 10000000:01000000:1.0:1788391118.908213:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391118.908219:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95d6bc2799b8 from 1 10000000:01000000:1.0:1788391118.908221:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788391118.908264:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.908276:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.908286:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391118.908304:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391118.908341:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.908389:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.908423:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434112 00000100:00100000:0.0:1788391118.908431:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434112 00000100:00100000:0.0:1788391118.908569:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788391118.908578:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:42625:x1875263103434112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391118.908591:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391118.908605:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd36236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3622f expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.908634:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd36236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3622f expref: 6 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.908641:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79be00/0x9aafc5f04cd36236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3622f expref: 6 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.908649:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79be00, rc 0) 00000100:00100000:0.0:1788391118.908684:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+6:42625:x1875263103434112:12345-0@lo:101:mount.lustre.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.908692:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391118.908705:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391118.908719:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.908728:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391118.908771:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391118.908795:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.908841:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.908865:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434240 00000100:00100000:3.0:1788391118.908868:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434240 00000100:00100000:3.0:1788391118.908890:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391118.908901:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+6:42625:x1875263103434240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391118.909164:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+6:42625:x1875263103434240:12345-0@lo:501:mount.lustre.0 Request processed in 258us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788391118.909171:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391118.909210:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434240:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788391118.909236:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788391118.909255:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909264:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391118.909272:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d586c62000 10000000:01000000:1.0:1788391118.909276:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788391118.909280:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95d586c62000 10000000:01000000:1.0:1788391118.909283:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788391118.909286:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95d586c62000 from 1 10000000:01000000:1.0:1788391118.909288:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788391118.909304:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909312:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909325:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391118.909337:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391118.909357:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.909376:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.909404:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434368 00000100:00100000:0.0:1788391118.909416:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434368 00000100:00100000:0.0:1788391118.909447:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391118.909454:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+6:42625:x1875263103434368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788391118.909461:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391118.909471:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd36244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3623d expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.909486:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd36244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3623d expref: 7 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.909495:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79a000/0x9aafc5f04cd36244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3623d expref: 7 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.909499:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a000, rc 0) 00000100:00100000:0.0:1788391118.909525:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+7:42625:x1875263103434368:12345-0@lo:101:mount.lustre.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.909529:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391118.909556:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391118.909568:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36244 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909575:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36244 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391118.909585:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788391118.909596:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36244 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909603:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7c00/0x9aafc5f04cd3623d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36244 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391118.909609:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788391118.909613:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391118.909617:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95d586c62000 10000000:01000000:1.0:1788391118.909619:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788391118.909622:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788391118.909623:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788391118.909634:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909643:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909648:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391118.909655:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391118.909673:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.909685:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.909706:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434496 00000100:00100000:3.0:1788391118.909712:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434496 00000100:00100000:3.0:1788391118.909738:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788391118.909754:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+7:42625:x1875263103434496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391118.909763:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391118.909772:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd36252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3624b expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.909785:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd36252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3624b expref: 8 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.909794:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0200/0x9aafc5f04cd36252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3624b expref: 8 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.909800:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0200, rc 0) 00000100:00100000:3.0:1788391118.909833:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+8:42625:x1875263103434496:12345-0@lo:101:mount.lustre.0 Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.909840:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391118.909925:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391118.909935:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36252 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.909943:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36252 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391118.909996:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391118.910021:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.910047:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.910100:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434624 00000100:00100000:0.0:1788391118.910104:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434624 00000100:00100000:0.0:1788391118.910134:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391118.910142:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+8:42625:x1875263103434624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391118.910463:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42625:x1875263103434624:12345-0@lo:501:mount.lustre.0 Request processed in 322us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.910470:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391118.910528:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391118.910553:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391118.910581:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.910593:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a79300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.910615:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434752 00000100:00100000:3.0:1788391118.910620:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434752 00000100:00100000:3.0:1788391118.910649:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788391118.910656:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42625:x1875263103434752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391118.910935:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42625:x1875263103434752:12345-0@lo:503:mount.lustre.0 Request processed in 279us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.910942:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788391118.910987:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103434752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391118.911486:0:42662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42662:1875263103434880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788391118.911519:0:42662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391118.911548:0:42662:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.911551:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103434880 00000100:00100000:3.0:1788391118.911558:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103434880 00000100:00100000:3.0:1788391118.911595:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788391118.911612:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42662:x1875263103434880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391118.911833:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42662:x1875263103434880:12345-0@lo:502:llog_process_th.0 Request processed in 230us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.911847:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788391118.911865:0:42662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42662:1875263103434880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788391118.911890:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391118.911898:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.911900:0:42662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788391118.911905:0:42662:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788391118.911907:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788391118.911917:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95d6bc278000) 00000020:00000080:0.0:1788391118.911930:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788391118.911933:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788391118.912035:0:42662:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788391118.912042:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd36260 00000020:00000080:0.0:1788391118.912290:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788391118.912294:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391118.912298:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.912299:0:42662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788391118.912302:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391118.912305:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.912306:0:42662:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788391118.912309:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788391118.912316:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95d6bc27b370) 00000020:00000080:0.0:1788391118.912325:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788391118.912328:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788391118.912330:0:42662:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788391118.912333:0:42662:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788391118.912338:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788391118.912372:0:42662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d586c62000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788391118.912386:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95d5873ecd28) 00000020:00000080:0.0:1788391118.912395:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788391118.912434:0:42662:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788391118.912439:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd36275 00000020:00000080:0.0:1788391118.912520:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788391118.912527:0:42662:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788391118.912531:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9aafc5f04cd3627c 00080000:01000000:0.0:1788391118.912542:0:42662:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788391118.912545:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd36283 00010000:00010000:2.0:1788391118.961514:0:42662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788391118.961932:0:42662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803896 00000001:00080000:2.0:1788391118.962102:0:42662:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788391118.962549:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95d6a6bd0000) 00000020:00000080:2.0:1788391118.962566:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788391118.962625:0:42662:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788391118.962633:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd36291 00000020:00000080:3.0:1788391118.963762:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788391118.966229:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9aafc5f04cd36298 00000020:00000080:0.0:1788391118.968371:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788391118.968383:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391118.968389:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.968391:0:42662:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788391118.968394:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391118.968399:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.968401:0:42662:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788391118.968404:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788391118.968441:0:42662:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788391118.968453:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391118.968456:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.968457:0:42662:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788391118.968459:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788391118.968461:0:42662:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788391118.968463:0:42662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788391118.968464:0:42662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788391118.968465:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788391118.968467:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.968468:0:42662:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788391118.968470:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788391118.968473:0:42662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788391118.968476:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391118.968477:0:42662:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788391118.968481:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788391118.968486:0:42662:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:0.0:1788391118.968510:0:42662:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788391118.968512:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788391118.968526:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95d5873e99b8) 00000020:00000080:0.0:1788391118.968541:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788391118.968545:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788391118.968590:0:42662:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788391118.968598:0:42662:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788391118.968603:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd362a6 00010000:00080000:0.0:1788391118.968626:0:42662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6bcb41000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1788391118.968781:0:42662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788391118.969146:0:42662:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788391118.969202:0:42662:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788391118.969894:0:42662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391118.969929:0:42662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:2.0:1788391118.970090:0:42662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].1, 64 off8256 00000040:00080000:2.0:1788391118.970396:0:42666:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391118.970400:0:42666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x28:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788391118.970810:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788391118.970819:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788391118.970845:0:42662:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788391118.970860:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd362ad 00000100:00080000:2.0:1788391118.970868:0:42662:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788391118.970874:0:42662:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6bcb41000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391118.970908:0:42662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687860700 x1875263103435008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788391118.970988:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103435008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788391118.971041:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103435008 offset 0 length 520: 4 00000100:00080000:2.0:1788391118.971316:0:42662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788391118.971367:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391118.971371:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.971373:0:42662:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788391118.971376:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788391118.971378:0:42662:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788391118.971379:0:42662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391118.971381:0:42662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391118.971382:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788391118.971385:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.971386:0:42662:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788391118.971388:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788391118.971392:0:42662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788391118.971396:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.971397:0:42662:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788391118.971400:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788391118.971404:0:42662:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1788391118.971423:0:42662:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788391118.971425:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788391118.971437:0:42662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95d6a6bd3370) 00000020:00000080:2.0:1788391118.971447:0:42662:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788391118.971459:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788391118.971518:0:42662:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788391118.971522:0:42662:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788391118.971529:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9aafc5f04cd362bb 00010000:00080000:2.0:1788391118.971549:0:42662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6bc73f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788391118.971777:0:42662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788391118.971918:0:42662:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788391118.971935:0:42662:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788391118.972860:0:42662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788391118.972903:0:42662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:2.0:1788391118.973275:0:42662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].1, 64 off8256 00000040:00080000:2.0:1788391118.973884:0:42668:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391118.973888:0:42668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788391118.974683:0:42662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788391118.974693:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788391118.974721:0:42662:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788391118.974735:0:42662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd362c2 00000100:00080000:3.0:1788391118.974745:0:42662:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788391118.974750:0:42662:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6bc73f000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788391118.974780:0:42662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d5866a0a80 x1875263103435136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788391118.974803:0:42662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788391118.974843:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103435136:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788391118.974864:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391118.974869:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.974871:0:42662:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788391118.974874:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391118.974878:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.974880:0:42662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788391118.974883:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788391118.974885:0:42662:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788391118.974887:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391118.974891:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.974893:0:42662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000400:00000100:0.0:1788391118.974896:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875263103435136 offset 0 length 520: 4 00000020:01000000:3.0:1788391118.974897:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788391118.974902:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.974905:0:42662:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788391118.974909:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788391118.974937:0:42662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42662:1875263103435264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391118.975012:0:42662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.975043:0:42662:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391118.975070:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435264 00000100:00100000:2.0:1788391118.975076:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435264 00000100:00100000:2.0:1788391118.975114:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391118.975123:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42662:x1875263103435264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788391118.975301:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42662:x1875263103435264:12345-0@lo:502:llog_process_th.0 Request processed in 178us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391118.975308:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391118.975330:0:42662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42662:1875263103435264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788391118.975352:0:42662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391118.975356:0:42662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.975358:0:42662:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788391118.975362:0:42662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788391118.975414:0:42625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788391118.975435:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788391118.975457:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36252 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.975468:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7600/0x9aafc5f04cd3624b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36252 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391118.975475:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586c62000 from 1 10000000:01000000:2.0:1788391118.975477:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788391118.975505:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.975512:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.975521:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391118.975532:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788391118.975562:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.975577:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.975594:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435392 00000100:00100000:3.0:1788391118.975598:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435392 00000100:00100000:3.0:1788391118.975670:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788391118.975678:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+9:42625:x1875263103435392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391118.975687:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391118.975699:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd362c9 expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.975718:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 10 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.975728:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 10 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.975737:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1e00, rc 0) 00000100:00100000:3.0:1788391118.975769:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+10:42625:x1875263103435392:12345-0@lo:101:mount.lustre.0 Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.975775:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391118.975837:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391118.975849:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.975858:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391118.976396:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435520:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788391118.976429:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.976456:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.976484:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435520 00000100:00100000:3.0:1788391118.976490:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435520 00000100:00100000:3.0:1788391118.976591:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391118.976600:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+10:42625:x1875263103435520:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788391118.976614:0:42639:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788391118.976627:0:42639:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788391118.976710:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+10:42625:x1875263103435520:12345-0@lo:256:mount.lustre.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.976718:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788391118.976720:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435520:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788391118.977340:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788391118.977354:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.977363:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788391118.977378:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586c62000 from 1 10000000:01000000:2.0:1788391118.977381:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788391118.977402:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.977409:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.977418:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391118.977431:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788391118.977457:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.977479:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.977490:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435648 00000100:00100000:3.0:1788391118.977495:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435648 00000100:00100000:3.0:1788391118.977527:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391118.977535:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+10:42625:x1875263103435648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391118.977542:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391118.977553:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd362d7 expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.977568:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.977578:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.977586:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1800, rc 0) 00000100:00100000:3.0:1788391118.977617:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103435648:12345-0@lo:101:mount.lustre.0 Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.977623:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788391118.977640:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391118.977653:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.977661:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391118.977703:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391118.977726:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.977742:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.977760:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435776 00000100:00100000:3.0:1788391118.977764:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435776 00000100:00100000:3.0:1788391118.977789:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788391118.977796:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103435776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391118.978368:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103435776:12345-0@lo:501:mount.lustre.0 Request processed in 572us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.978373:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788391118.978890:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391118.978917:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391118.978957:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.978996:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.979024:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103435904 00000100:00100000:0.0:1788391118.979029:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103435904 00000100:00100000:0.0:1788391118.979062:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788391118.979070:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103435904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391118.979385:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103435904:12345-0@lo:503:mount.lustre.0 Request processed in 315us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.979392:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788391118.979629:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103435904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391118.980250:0:42670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42670:1875263103436032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788391118.980283:0:42670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.980313:0:42670:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.980314:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436032 00000100:00100000:3.0:1788391118.980319:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436032 00000100:00100000:3.0:1788391118.980342:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788391118.980349:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42670:x1875263103436032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391118.980478:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42670:x1875263103436032:12345-0@lo:502:llog_process_th.0 Request processed in 130us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.980483:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788391118.980629:0:42670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42670:1875263103436032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788391118.980650:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391118.980658:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.980660:0:42670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788391118.980668:0:42670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d586c62000 00000020:00000080:2.0:1788391118.980671:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391118.980679:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391118.980681:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.980682:0:42670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788391118.980685:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391118.980687:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.980689:0:42670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788391118.980692:0:42670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d586c62000 00000020:00000080:2.0:1788391118.980693:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391118.980744:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391118.980747:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.980749:0:42670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788391118.980752:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391118.980755:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391118.980757:0:42670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788391118.980760:0:42670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d586c62000 00000020:00000080:2.0:1788391118.980763:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788391118.980805:0:42670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42670:1875263103436160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788391118.980843:0:42670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391118.980866:0:42670:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.982807:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436160 00000100:00100000:0.0:1788391118.982816:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436160 00000100:00100000:0.0:1788391118.982862:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391118.982872:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42670:x1875263103436160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788391118.983112:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42670:x1875263103436160:12345-0@lo:502:llog_process_th.0 Request processed in 241us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.983120:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788391118.983135:0:42670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42670:1875263103436160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788391118.983165:0:42670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788391118.983182:0:42670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788391118.983184:0:42670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788391118.983189:0:42670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788391118.983518:0:42625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788391118.983535:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788391118.983551:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.983573:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391118.983620:0:42625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788391118.983624:0:42625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d586c62000 10000000:01000000:0.0:1788391118.983627:0:42625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d586c62000 10000000:01000000:0.0:1788391118.983631:0:42625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788391118.983637:0:42625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d586c62000 from 1 10000000:01000000:0.0:1788391118.983640:0:42625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788391118.983670:0:42625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.983679:0:42625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391118.983689:0:42625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391118.983707:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788391118.983743:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391118.983768:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.984082:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436288 00000100:00100000:3.0:1788391118.984088:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436288 00000100:00100000:3.0:1788391118.984119:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788391118.984128:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103436288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391118.984138:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391118.984151:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd362ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd362e5 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.985475:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd362ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd362e5 expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.985491:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0600/0x9aafc5f04cd362ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd362e5 expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391118.985500:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0600, rc 0) 00000100:00100000:2.0:1788391118.985586:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391118.985610:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103436288:12345-0@lo:101:mount.lustre.0 Request processed in 1423us (1806us total) trans 0 rc 0/0 00010000:00010000:2.0:1788391118.985614:0:42625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362ec expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391118.985627:0:42625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd362ec expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391118.985684:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391118.985714:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.985728:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391118.985742:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436416 00000100:00100000:0.0:1788391118.985746:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436416 00000100:00100000:2.0:1788391118.985752:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391118.985774:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391118.985782:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103436416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391118.986621:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103436416:12345-0@lo:501:mount.lustre.0 Request processed in 838us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391118.986629:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788391118.987277:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391118.987317:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391118.987364:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.987390:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436544 00000100:00100000:3.0:1788391118.987396:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436544 00000100:00100000:2.0:1788391118.987401:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.987429:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788391118.987437:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103436544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391118.988108:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103436544:12345-0@lo:503:mount.lustre.0 Request processed in 669us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.988116:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788391118.988125:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103436544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391118.988820:0:42674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42674:1875263103436672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391118.988850:0:42674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.988878:0:42674:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d681473900 going to sleep for 11 seconds 00000100:00100000:1.0:1788391118.988886:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436672 00000100:00100000:1.0:1788391118.988895:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436672 00000100:00100000:1.0:1788391118.988931:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788391118.988939:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42674:x1875263103436672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391118.989147:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42674:x1875263103436672:12345-0@lo:502:llog_process_th.0 Request processed in 208us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391118.989154:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788391118.989209:0:42674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42674:1875263103436672:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788391118.989251:0:42674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788391118.989263:0:42674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95d6bc75b370) 00000020:00000080:3.0:1788391118.989277:0:42674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788391118.989339:0:42674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d586c62000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788391118.989342:0:42674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d586c62000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788391118.989343:0:42674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d586c62000 4 00010000:00080000:3.0:1788391118.989365:0:42674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6a6915000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1788391118.991148:0:42674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788391118.991340:0:42674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788391118.991372:0:42674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788391118.991383:0:42674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9aafc5f04cd362fa 00000100:00080000:3.0:1788391118.991393:0:42674:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788391118.991399:0:42674:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d6a6915000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788391118.991429:0:42674:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d5866a1500 x1875263103436800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788391118.991463:0:42674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788391118.991493:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103436800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788391118.991545:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.992071:0:42674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42674:1875263103436928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788391118.992117:0:42674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391118.992143:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436928 00000100:00100000:3.0:1788391118.992148:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436928 00000100:00100000:3.0:1788391118.992193:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788391118.992203:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42674:x1875263103436928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788391118.992250:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103436800 00000100:00100000:1.0:1788391118.992256:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103436800 00000100:00100000:1.0:1788391118.992289:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391118.992296:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103436800:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788391118.992348:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103436800:12345-0@lo:38:llog_process_th.0 Request processed in 51us (803us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788391118.992356:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391118.992438:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788391118.992445:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a6915000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788391118.992450:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788391118.992453:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103436800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788391118.992458:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42674:x1875263103436928:12345-0@lo:502:llog_process_th.0 Request processed in 258us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391118.992464:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788391118.992503:0:42674:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391118.992516:0:42674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42674:1875263103436928:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788391118.992536:0:42674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788391118.992590:0:42625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788391118.992615:0:42625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788391118.992644:0:42625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362ec expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391118.992655:0:42625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79a800/0x9aafc5f04cd362e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd362ec expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788391118.992703:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788391118.992706:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391118.992707:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391118.992709:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391118.992711:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391118.992712:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391118.992714:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391118.992716:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391118.992718:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391118.992719:0:42625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391118.992729:0:42625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788391118.992731:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788391118.992733:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391118.992735:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391118.992736:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391118.992737:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391118.992739:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391118.992740:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391118.992741:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391118.992743:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391118.992744:0:42625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788391118.992759:0:42625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788391118.992770:0:42625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103437056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788391118.992802:0:42625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391118.992818:0:42625:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5332e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391118.992843:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437056 00000100:00100000:1.0:1788391118.992848:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437056 00000100:00100000:1.0:1788391118.992875:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788391118.992883:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42625:x1875263103437056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788391118.992911:0:42637:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788391118.992925:0:42637:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788391119.018631:0:42637:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788391119.018646:0:42637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788391119.018661:0:42660:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788391119.018715:0:42660:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788391119.018733:0:42660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391119.018749:0:42660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391119.018755:0:42660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391119.018795:0:42660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391119.018823:0:42660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 12 pid: 42637 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391119.018835:0:42660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103437184:0@lo:104: 00000100:00100000:3.0:1788391119.018888:0:42660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391119.018925:0:42660:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b322ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391119.019189:0:42627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437184 00000100:00100000:2.0:1788391119.019197:0:42627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437184 00000100:00100000:2.0:1788391119.019252:0:42627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391119.019263:0:42627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103437184:12345-0@lo:104: 00010000:00010000:2.0:1788391119.019275:0:42627:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391119.019360:0:42627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788391119.019367:0:42627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103437184:12345-0@lo:104: Request processed in 107us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391119.019376:0:42660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103437184:0@lo:104: 00000100:00100000:2.0:1788391119.019377:0:42627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788391119.019395:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391119.019398:0:42660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019406:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019416:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391119.019421:0:42633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019429:0:42633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391119.019436:0:42633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391119.019450:0:42633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788391119.019484:0:42633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019490:0:42633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391119.019517:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019524:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d68fcc1e00/0x9aafc5f04cd362c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362d0 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019539:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391119.019540:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788391119.019542:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391119.019547:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391119.019553:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103437312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788391119.019583:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391119.019779:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437312 00000100:00100000:1.0:1788391119.019784:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437312 00010000:00010000:1.0:1788391119.019806:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 13 pid: 42637 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391119.019831:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391119.019838:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+13:3287:x1875263103437312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391119.019848:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391119.019853:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 13 pid: 42637 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019863:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 13 pid: 42637 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019875:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd362d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd362c9 expref: 13 pid: 42637 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019893:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019901:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788391119.019911:0:42629:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001197586s 00010000:00010000:1.0:1788391119.019915:0:42629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019922:0:42629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019939:0:42629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019946:0:42629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019952:0:42629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391119.019955:0:42629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019980:0:42629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.019995:0:42629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391119.020004:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391119.020031:0:42660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391119.020041:0:42660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391119.020048:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:3287:x1875263103437312:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (461us total) trans 0 rc 0/0 00010000:00010000:3.0:1788391119.020052:0:42660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1000/0x9aafc5f04cd36301 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391119.020059:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391119.020064:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103437312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788391119.023662:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42625:x1875263103437056:12345-0@lo:253:mount.lustre.0 Request processed in 30771us (30849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391119.023684:0:42625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42625:1875263103437056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788391119.023690:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:01000000:1.0:1788391119.023702:0:42625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788391119.023707:0:42625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788391119.023709:0:42625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788391119.023710:0:42625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788391119.023712:0:42625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788391119.023713:0:42625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788391119.023714:0:42625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788391119.023716:0:42625:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788391119.023718:0:42625:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788391119.023720:0:42625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788391119.023722:0:42625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788391119.023737:0:42625:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788391119.029101:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.029241:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391119.029509:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.030393:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391119.030562:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.030655:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391119.031083:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.031216:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391119.031453:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.031611:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788391119.031766:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788391119.031858:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788391119.044446:0:42625:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 21474836520 00000040:01000000:1.0:1788391119.044696:0:42625:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788391119.044740:0:42682:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 21474836520 00000020:00080000:3.0:1788391119.044745:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000040:01000000:3.0:1788391119.044882:0:42683:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788391119.044950:0:42683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788391119.046215:0:42625:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788391119.046336:0:42625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788391119.048335:0:42625:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788391119.048349:0:42625:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788391119.048540:0:42625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391119.049085:0:42683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788391119.049143:0:42683:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788391119.049153:0:42683:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788391119.049510:0:42625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788391119.050078:0:42625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788391119.050105:0:42625:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788391119.050471:0:42625:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 5, last_idx 6 00080000:10000000:1.0:1788391119.051263:0:42625:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00000001:00000004:1.0:1788391119.054398:0:42625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:1.0:1788391119.069431:0:42625:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788391119.069465:0:42625:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba8581c67988 00100000:10000000:1.0:1788391119.069473:0:42625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788391119.070322:0:42625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788391119.070337:0:42625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788391119.070354:0:42625:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788391119.070370:0:42625:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788391119.822458:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391120.013233:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391120.013244:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391120.013599:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:0.0:1788391120.013606:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 10000000:01000000:3.0:1788391120.141268:0:42641:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788391120.141276:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586c62000 from 21 10000000:01000000:3.0:1788391120.141281:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788391120.141376:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391120.141387:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391120.141398:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391120.141423:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788391120.141505:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391120.141554:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391120.141577:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437440 00000100:00100000:3.0:1788391120.141584:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437440 00000100:00100000:3.0:1788391120.141645:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788391120.141656:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42641:x1875263103437440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391120.141669:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391120.141683:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd36308 expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391120.141705:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 12 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391120.141716:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 12 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391120.141736:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1e00, rc 0) 00000100:00100000:3.0:1788391120.141782:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103437440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391120.141789:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788391120.141878:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391120.141892:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391120.141908:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391120.141987:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788391120.142020:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391120.142039:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391120.142049:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437568 00000100:00100000:1.0:1788391120.142051:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437568 00000100:00100000:1.0:1788391120.142083:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788391120.142091:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103437568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788391120.142105:0:42637:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788391120.142120:0:42637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788391120.142122:0:42637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 21 00000100:00100000:1.0:1788391120.142247:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103437568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391120.142256:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788391120.142353:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788391120.142389:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788391120.142411:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391120.142420:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1788391120.776137:0:42925:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788391120.847268:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391121.037225:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391121.037235:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391121.037272:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:0.0:1788391121.037279:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1788391121.871108:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788391122.441418:0:43075:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9b9baca0 20000000:00000080:1.0:1788391122.441434:0:43075:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d69f4a1400 uarg=0000000000000000 20000000:01000000:1.0:1788391122.441464:0:43075:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788391122.441471:0:43075:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788391122.441475:0:43075:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788391122.442369:0:43076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788391122.442513:0:43075:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788391122.442519:0:43075:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788391122.442537:0:43075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.442554:0:43075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.442572:0:43075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.442607:0:43075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.442619:0:43075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 11 pid: 42637 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391122.442634:0:43075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43075:1875263103437696:0@lo:104: 00000100:00100000:1.0:1788391122.442688:0:43075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391122.442756:0:43075:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391122.442795:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437696 00000100:00100000:3.0:1788391122.442802:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437696 00000100:00100000:3.0:1788391122.442842:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391122.442850:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:43075:x1875263103437696:12345-0@lo:104: 00010000:00010000:3.0:1788391122.442862:0:42628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391122.443003:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788391122.443010:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:43075:x1875263103437696:12345-0@lo:104: Request processed in 160us (320us total) trans 0 rc 0/0 00010000:00010000:0.0:1788391122.443011:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788391122.443020:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788391122.443021:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443032:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:0.0:1788391122.443035:0:42633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443042:0:42633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391122.443046:0:42633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391122.443058:0:42633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788391122.443088:0:42633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443095:0:42633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788391122.443098:0:43075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:43075:1875263103437696:0@lo:104: 00010000:00010000:1.0:1788391122.443117:0:43075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443124:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443130:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0e00/0x9aafc5f04cd362d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd362de expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391122.443152:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391122.443154:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391122.443155:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391122.443162:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391122.443172:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103437824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391122.443199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391122.443267:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437824 00000100:00100000:1.0:1788391122.443272:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437824 00010000:00010000:1.0:1788391122.443313:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 12 pid: 42637 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391122.443372:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391122.443379:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:3286:x1875263103437824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391122.443389:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391122.443395:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 12 pid: 42637 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443406:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 12 pid: 42637 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443425:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1800/0x9aafc5f04cd362de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd362d7 expref: 12 pid: 42637 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443438:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443446:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443458:0:42631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443466:0:42631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443472:0:42631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443479:0:42631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443484:0:42631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391122.443488:0:42631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443495:0:42631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443514:0:42631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391122.443560:0:43075:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.443593:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391122.443633:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:3286:x1875263103437824:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391122.443639:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391122.443694:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103437824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391122.443835:0:43075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391122.443841:0:43075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df7000/0x9aafc5f04cd36316 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 43075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391122.896040:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391123.922978:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788391124.045085:0:42641:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788391124.045097:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586c62000 from 10 10000000:01000000:2.0:1788391124.045106:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788391124.045188:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391124.045207:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391124.045222:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391124.045282:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788391124.045374:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391124.045443:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788391124.045581:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103437952 00000100:00100000:3.0:1788391124.045602:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103437952 00000100:00100000:3.0:1788391124.045670:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788391124.045683:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+11:42641:x1875263103437952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391124.045699:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391124.045717:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3631d expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391124.045747:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 12 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391124.045768:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 12 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391124.045780:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0400, rc 0) 00000100:00100000:3.0:1788391124.045843:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103437952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391124.045851:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788391124.046063:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103437952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391124.046083:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391124.046094:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391124.046852:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103438080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788391124.046913:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391124.046958:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391124.047021:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438080 00000100:00100000:2.0:1788391124.047040:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438080 00000100:00100000:2.0:1788391124.047078:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788391124.047086:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103438080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391124.047424:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103438080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391124.047433:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788391124.047924:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103438080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391124.047996:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103438208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788391124.048042:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391124.048067:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574540 going to sleep for 11 seconds 00000100:00100000:2.0:1788391124.048151:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438208 00000100:00100000:2.0:1788391124.048157:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438208 00000100:00100000:2.0:1788391124.048231:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788391124.048240:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103438208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391124.048425:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:42641:x1875263103438208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391124.048433:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391124.048509:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103438208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788391124.049704:0:43194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788391124.049986:0:42641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788391124.050014:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788391124.050036:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391124.050048:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788391124.429027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391124.429035:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788391124.429044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391124.429047:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788391124.429050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788391124.429053:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788391124.429057:0:8:0:(import.c:65:import_set_state_nolock()) ffff95d6a6915000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788391124.429069:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95d6a6915000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1788391124.429173:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d586482d80 x1875263103438336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391124.430242:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103438336:0@lo:38:kworker.0 00000100:00100000:2.0:1788391124.430316:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391124.430518:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438336 00000100:00100000:1.0:1788391124.430525:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438336 00000100:00100000:1.0:1788391124.430564:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391124.430572:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103438336:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788391124.430597:0:42646:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 941 last 0 00000020:00000080:1.0:1788391124.430628:0:42646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9aafc5f04cd3632b 00000004:00100000:1.0:1788391124.430653:0:42646:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788391124.430772:0:42646:0:(import.c:65:import_set_state_nolock()) ffff95d6b6536800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788391124.430827:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875263103438336:12345-0@lo:38:kworker.0 Request processed in 254us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391124.430834:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788391124.430941:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d586482d80 x1875263103438336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788391124.430978:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1788391124.430986:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788391124.430990:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788391124.430998:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6a6915000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788391124.431005:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875263103438336:0@lo:38:kworker.0 00010000:00010000:1.0:1788391124.942655:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788391125.434793:0:43324:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788391125.434797:0:43324:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788391125.434908:0:43324:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d6bbf78800 00000020:01000004:1.0:1788391125.434923:0:43324:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788391125.434935:0:43324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788391125.434947:0:43324:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95d683d4b370) 00000020:00000080:1.0:1788391125.434991:0:43324:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788391125.447943:0:43324:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788391125.448174:0:43324:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788391125.448647:0:43324:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788391125.448875:0:43324:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788391125.450239:0:43324:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:1.0:1788391125.450795:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 657: rc = 0 00100000:10000000:1.0:1788391125.450900:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 657: rc = 0 00100000:10000000:1.0:1788391125.451034:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 657: rc = 0 00100000:10000000:1.0:1788391125.451591:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788391125.451858:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 571: rc = 0 00100000:10000000:1.0:1788391125.452192:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788391125.452363:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 571: rc = 0 00100000:10000000:1.0:1788391125.452537:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 571: rc = 0 00100000:10000000:1.0:1788391125.452723:0:43324:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 571: rc = 0 00000020:00000080:1.0:1788391125.453285:0:43324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788391125.453298:0:43324:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788391125.453315:0:43324:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd36339 00000020:01000004:1.0:1788391125.453325:0:43324:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788391125.453346:0:43324:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788391125.453349:0:43324:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788391125.453355:0:43324:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788391125.453365:0:43324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788391125.453377:0:43324:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95d683d499b8) 00000020:00000080:1.0:1788391125.453388:0:43324:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788391125.457378:0:43324:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391125.457604:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788391125.457611:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788391125.462931:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788391125.462943:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788391125.463834:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788391125.463846:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788391125.465677:0:43324:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391125.465841:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788391125.465847:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788391125.466404:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788391125.466416:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788391125.478376:0:43324:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788391125.478631:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788391125.478637:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788391125.480015:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788391125.480024:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788391125.480617:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788391125.480623:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788391125.482594:0:43324:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391125.482792:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788391125.482798:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788391125.485658:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788391125.485671:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788391125.517539:0:43324:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788391125.517736:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788391125.517742:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788391125.519223:0:43324:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788391125.519235:0:43324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788391125.524393:0:43324:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788391125.524430:0:43324:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788391125.524436:0:43324:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788391125.530826:0:43324:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788391125.530866:0:43324:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788391125.530870:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788391125.530871:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.530872:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.530873:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.530874:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.530874:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.530876:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.530877:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.530877:0:43324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391125.530880:0:43324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788391125.530881:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788391125.530882:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.530883:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.530883:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.530884:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.530885:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.530885:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.530886:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.530886:0:43324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391125.530908:0:43324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788391125.530923:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788391125.531045:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.531086:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438464 00000100:00100000:3.0:1788391125.531090:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788391125.531094:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438464 00000100:00100000:0.0:1788391125.531165:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788391125.531175:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:43324:x1875263103438464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788391125.531213:0:42638:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788391125.531217:0:42638:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788391125.531220:0:42638:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788391125.535810:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:43324:x1875263103438464:12345-0@lo:253:mount.lustre.0 Request processed in 4627us (4755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.535823:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788391125.535900:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788391125.535912:0:43324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788391125.535915:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788391125.535916:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.535917:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.535918:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.535919:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.535919:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.535920:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.535922:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.535923:0:43324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788391125.535937:0:43324:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d6bbf78800 from lustre-OST0000 10000000:01000000:3.0:1788391125.536003:0:43324:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788391125.536016:0:43324:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788391125.536021:0:43324:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d6bc2799b8 local copy 00010000:00010000:3.0:1788391125.536030:0:43324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391125.536207:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.536233:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.536291:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683046d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.536318:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438592 00000100:00100000:2.0:1788391125.536323:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438592 00000100:00100000:2.0:1788391125.536373:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788391125.536380:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:43324:x1875263103438592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391125.536530:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:43324:x1875263103438592:12345-0@lo:501:mount.lustre.0 Request processed in 151us (296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391125.536535:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788391125.536596:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438592:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788391125.536610:0:43324:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788391125.536743:0:43324:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788391125.536748:0:43324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391125.536754:0:43324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391125.536768:0:43324:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6bbf78800 10000000:01000000:0.0:1788391125.536771:0:43324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788391125.536774:0:43324:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95d6bc2799b8 10000000:01000000:0.0:1788391125.536776:0:43324:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788391125.536778:0:43324:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95d6bc2799b8 from 1 10000000:01000000:0.0:1788391125.536780:0:43324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788391125.536802:0:43324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391125.536809:0:43324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391125.536819:0:43324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391125.536832:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788391125.536862:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.536907:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.536939:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438720 00000100:00100000:2.0:1788391125.536942:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438720 00000100:00100000:2.0:1788391125.536978:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788391125.536983:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+12:43324:x1875263103438720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391125.536989:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391125.536998:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc0000/0x9aafc5f04cd3634e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd36347 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.537013:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc0000/0x9aafc5f04cd3634e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd36347 expref: 13 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.537019:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc0000/0x9aafc5f04cd3634e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36347 expref: 13 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.537025:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0000, rc 0) 00000100:00100000:2.0:1788391125.537053:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+13:43324:x1875263103438720:12345-0@lo:101:mount.lustre.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.537061:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788391125.537149:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391125.537158:0:43324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3634e expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.537164:0:43324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3634e expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391125.537174:0:43324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788391125.537212:0:43324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3634e expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.537217:0:43324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ac00/0x9aafc5f04cd36347 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3634e expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391125.537220:0:43324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788391125.537223:0:43324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391125.537226:0:43324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788391125.537227:0:43324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788391125.537237:0:43324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.537241:0:43324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.537245:0:43324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391125.537253:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391125.537276:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391125.537296:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6921c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788391125.537339:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438848 00000100:00100000:3.0:1788391125.537342:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438848 00000100:00100000:3.0:1788391125.537357:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788391125.537361:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+13:43324:x1875263103438848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391125.537366:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391125.537371:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3635c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd36355 expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.537380:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd36355 expref: 14 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.537385:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0800/0x9aafc5f04cd3635c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36355 expref: 14 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.537390:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0800, rc 0) 00000100:00100000:3.0:1788391125.537407:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103438848:12345-0@lo:101:mount.lustre.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391125.537411:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788391125.537460:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391125.537467:0:43324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3635c expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.537472:0:43324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd3635c expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391125.538666:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:1.0:1788391125.539488:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788391125.539669:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:1.0:1788391125.539697:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:1.0:1788391125.539713:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:1.0:1788391125.539736:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:1.0:1788391125.539753:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:1.0:1788391125.539769:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:1.0:1788391125.539791:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:1.0:1788391125.539839:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:1.0:1788391125.539865:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:1.0:1788391125.539901:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:1.0:1788391125.539922:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:1.0:1788391125.539945:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:1.0:1788391125.539993:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:1.0:1788391125.539998:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:1.0:1788391125.540048:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391125.540086:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391125.540125:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6921c3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391125.540194:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103438976 00000100:00100000:3.0:1788391125.540200:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103438976 00000100:00100000:3.0:1788391125.540236:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391125.540253:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103438976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.540526:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103438976:12345-0@lo:501:mount.lustre.0 Request processed in 274us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391125.540533:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788391125.540700:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103438976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391125.540724:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391125.540754:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.540781:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.540796:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439104 00000100:00100000:2.0:1788391125.540801:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439104 00000100:00100000:2.0:1788391125.540850:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788391125.540856:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391125.541130:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439104:12345-0@lo:503:mount.lustre.0 Request processed in 273us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.541137:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788391125.541138:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439104:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788391125.541533:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788391125.541567:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391125.541594:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.541616:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6915796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391125.541635:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439232 00000100:00100000:3.0:1788391125.541639:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439232 00000100:00100000:3.0:1788391125.541670:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788391125.541678:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.541832:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439232:12345-0@lo:502:mount.lustre.0 Request processed in 154us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391125.541839:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788391125.542287:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788391125.542462:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:0.0:1788391125.542499:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:0.0:1788391125.542527:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:0.0:1788391125.542570:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:0.0:1788391125.542605:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:0.0:1788391125.542633:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:0.0:1788391125.542670:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:0.0:1788391125.542710:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:0.0:1788391125.542735:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:0.0:1788391125.542770:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:0.0:1788391125.542856:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:0.0:1788391125.542897:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:0.0:1788391125.542918:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391125.542954:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.543049:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6915796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.543107:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439360 00000100:00100000:2.0:1788391125.543120:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439360 00000100:00100000:2.0:1788391125.543152:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788391125.543158:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391125.543325:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439360:12345-0@lo:502:mount.lustre.0 Request processed in 166us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.543332:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788391125.543418:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788391125.543467:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:0.0:1788391125.543475:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788391125.544238:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788391125.544246:0:43338:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788391125.544252:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.544254:0:43338:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788391125.544259:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788391125.544272:0:43338:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95d6a6bd19b8) 00000020:00000080:2.0:1788391125.544290:0:43338:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788391125.544294:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788391125.544345:0:43338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bbf78800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788391125.544351:0:43338:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788391125.544356:0:43338:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9aafc5f04cd3636a 00010000:00010000:2.0:1788391125.547491:0:43338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788391125.548234:0:43338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803793 00080000:10000000:2.0:1788391125.549586:0:43338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:2.0:1788391125.550861:0:43338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788391125.550872:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.550878:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.550880:0:43338:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788391125.550884:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788391125.550886:0:43338:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788391125.550888:0:43338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391125.550889:0:43338:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788391125.550891:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788391125.550893:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.550895:0:43338:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788391125.550897:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391125.550900:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.550901:0:43338:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788391125.550904:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788391125.550906:0:43338:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788391125.550908:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.550910:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.550912:0:43338:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788391125.550914:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391125.550916:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.550918:0:43338:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788391125.550921:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788391125.551008:0:43338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.551012:0:43338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.551014:0:43338:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788391125.551018:0:43338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:1.0:1788391125.551199:0:43324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788391125.551230:0:43324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788391125.551259:0:43324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3635c expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.551270:0:43324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7e00/0x9aafc5f04cd36355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd3635c expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391125.551279:0:43324:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bbf78800 from 1 10000000:01000000:1.0:1788391125.551282:0:43324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788391125.551317:0:43324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.551325:0:43324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.551336:0:43324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391125.551360:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391125.551426:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391125.551467:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6921c3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.551548:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439488 00000100:00100000:2.0:1788391125.551556:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439488 00000100:00100000:2.0:1788391125.551602:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788391125.551611:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+14:43324:x1875263103439488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391125.551623:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391125.551641:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd36371 expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.551662:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 15 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.551673:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 15 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.551682:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:2.0:1788391125.551731:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439488:12345-0@lo:101:mount.lustre.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.551737:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788391125.551811:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391125.551826:0:43324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.551835:0:43324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391125.552331:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:3.0:1788391125.552696:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391125.552828:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1788391125.552868:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:3.0:1788391125.552909:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:3.0:1788391125.552930:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:3.0:1788391125.552945:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:3.0:1788391125.552992:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:3.0:1788391125.553013:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:3.0:1788391125.553029:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:3.0:1788391125.553087:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:3.0:1788391125.553092:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:3.0:1788391125.553155:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.553192:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391125.553212:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439616 00000100:00100000:1.0:1788391125.553217:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439616 00000100:00100000:3.0:1788391125.553227:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391125.553244:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788391125.553252:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391125.553404:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439616:12345-0@lo:501:mount.lustre.0 Request processed in 152us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391125.553422:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788391125.553430:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.553455:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391125.553490:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.553558:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391125.553592:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439744 00000100:00100000:1.0:1788391125.553596:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439744 00000100:00100000:1.0:1788391125.553659:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788391125.553666:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391125.553798:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439744:12345-0@lo:503:mount.lustre.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391125.553805:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788391125.553864:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788391125.554208:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788391125.554249:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.554282:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.554410:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.554454:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103439872 00000100:00100000:2.0:1788391125.554459:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103439872 00000100:00100000:2.0:1788391125.554481:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788391125.554488:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391125.554664:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103439872:12345-0@lo:502:mount.lustre.0 Request processed in 175us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.554670:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788391125.554758:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103439872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391125.554945:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:3.0:1788391125.555097:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:3.0:1788391125.555164:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:3.0:1788391125.555201:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:3.0:1788391125.555232:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:3.0:1788391125.555280:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:3.0:1788391125.555318:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:3.0:1788391125.555351:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:3.0:1788391125.555375:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.555410:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.555472:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.555510:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440000 00000100:00100000:2.0:1788391125.555514:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440000 00000100:00100000:2.0:1788391125.555584:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788391125.555591:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103440000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391125.555716:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103440000:12345-0@lo:502:mount.lustre.0 Request processed in 124us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.555722:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788391125.555783:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391125.555849:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:3.0:1788391125.555857:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788391125.556633:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391125.556647:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.556650:0:43342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788391125.556659:0:43342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bbf78800 00000020:00000080:2.0:1788391125.556661:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391125.556667:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.556670:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.556671:0:43342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788391125.556674:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391125.556676:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.556677:0:43342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788391125.556680:0:43342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6bbf78800 00000020:00000080:2.0:1788391125.556682:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391125.556773:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.556777:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.556778:0:43342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788391125.556781:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391125.556784:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.556785:0:43342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788391125.556788:0:43342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6bbf78800 00000020:00000080:2.0:1788391125.556791:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788391125.558167:0:43342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391125.558173:0:43342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391125.558175:0:43342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788391125.558179:0:43342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:3.0:1788391125.559347:0:43324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788391125.559376:0:43324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788391125.559432:0:43324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.559445:0:43324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391125.559490:0:43324:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788391125.559493:0:43324:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6bbf78800 10000000:01000000:3.0:1788391125.559497:0:43324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6bbf78800 10000000:01000000:3.0:1788391125.559501:0:43324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788391125.559506:0:43324:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6bbf78800 from 1 10000000:01000000:3.0:1788391125.559509:0:43324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788391125.559542:0:43324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.559551:0:43324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.559562:0:43324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391125.559583:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391125.559644:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.559685:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391125.559739:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440128 00000100:00100000:1.0:1788391125.559746:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440128 00000100:00100000:1.0:1788391125.559789:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788391125.559798:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103440128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391125.559809:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391125.559819:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4df6e00/0x9aafc5f04cd36386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3637f expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.559839:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df6e00/0x9aafc5f04cd36386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3637f expref: 16 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.559849:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4df6e00/0x9aafc5f04cd36386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3637f expref: 16 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.559859:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6e00, rc 0) 00000100:00100000:1.0:1788391125.559893:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440128:12345-0@lo:101:mount.lustre.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391125.559899:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788391125.559994:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391125.560011:0:43324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36386 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.560020:0:43324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd36386 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391125.560583:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:3.0:1788391125.560841:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391125.561104:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:3.0:1788391125.561165:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:3.0:1788391125.561198:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:3.0:1788391125.561244:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:3.0:1788391125.561281:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:3.0:1788391125.561333:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:3.0:1788391125.561371:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:3.0:1788391125.561408:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:3.0:1788391125.561457:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:3.0:1788391125.561492:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:3.0:1788391125.561525:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:3.0:1788391125.561569:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:3.0:1788391125.561603:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:3.0:1788391125.561636:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:3.0:1788391125.561677:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:3.0:1788391125.561707:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:3.0:1788391125.561754:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:3.0:1788391125.561801:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:3.0:1788391125.561836:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:3.0:1788391125.561868:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:3.0:1788391125.561913:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:3.0:1788391125.561949:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:3.0:1788391125.562002:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:3.0:1788391125.562059:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:3.0:1788391125.562093:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:3.0:1788391125.562142:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:3.0:1788391125.562190:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:3.0:1788391125.562225:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:3.0:1788391125.562254:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:3.0:1788391125.562294:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:3.0:1788391125.562326:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:3.0:1788391125.562359:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:3.0:1788391125.562404:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:3.0:1788391125.562450:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:3.0:1788391125.562486:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:3.0:1788391125.562534:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:3.0:1788391125.562571:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:3.0:1788391125.562603:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:3.0:1788391125.562650:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:3.0:1788391125.562688:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:3.0:1788391125.562771:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:3.0:1788391125.562780:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:3.0:1788391125.562859:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.562919:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.562953:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.563159:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440256 00000100:00100000:2.0:1788391125.563167:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440256 00000100:00100000:2.0:1788391125.563216:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788391125.563226:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391125.563429:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440256:12345-0@lo:501:mount.lustre.0 Request processed in 203us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.563436:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788391125.567236:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391125.567292:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391125.567361:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.567397:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440384 00000100:00100000:3.0:1788391125.567403:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440384 00000100:00100000:3.0:1788391125.567446:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788391125.567455:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391125.567772:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440384:12345-0@lo:503:mount.lustre.0 Request processed in 317us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391125.567780:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788391125.567843:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391125.567856:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788391125.568402:0:43324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788391125.568462:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.568498:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.568521:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391125.568778:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440512 00000100:00100000:0.0:1788391125.568795:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440512 00000100:00100000:0.0:1788391125.568831:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788391125.568840:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391125.569028:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440512:12345-0@lo:502:mount.lustre.0 Request processed in 189us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391125.569036:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788391125.569678:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391125.569921:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:3.0:1788391125.569995:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:3.0:1788391125.570031:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:3.0:1788391125.570080:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:3.0:1788391125.570145:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:3.0:1788391125.570194:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:3.0:1788391125.570232:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:3.0:1788391125.570262:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:3.0:1788391125.570307:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:3.0:1788391125.570342:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:3.0:1788391125.570377:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:3.0:1788391125.570424:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:3.0:1788391125.570461:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:3.0:1788391125.570496:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:3.0:1788391125.570540:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:3.0:1788391125.570576:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:3.0:1788391125.570610:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:3.0:1788391125.570653:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:3.0:1788391125.570696:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:3.0:1788391125.570728:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:3.0:1788391125.570785:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:3.0:1788391125.570820:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:3.0:1788391125.570851:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:3.0:1788391125.570896:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:3.0:1788391125.570931:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:3.0:1788391125.571018:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:3.0:1788391125.571081:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:3.0:1788391125.571137:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:3.0:1788391125.571172:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:3.0:1788391125.571221:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:3.0:1788391125.571256:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:3.0:1788391125.571286:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:3.0:1788391125.571313:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:3.0:1788391125.571357:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:3.0:1788391125.571392:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:3.0:1788391125.571437:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:3.0:1788391125.571487:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:3.0:1788391125.571522:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:3.0:1788391125.571571:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:3.0:1788391125.571604:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:3.0:1788391125.571651:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.571721:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.571760:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440640 00000100:00100000:3.0:1788391125.571767:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440640 00000100:00100000:3.0:1788391125.571816:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788391125.571824:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391125.572048:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103440640:12345-0@lo:502:mount.lustre.0 Request processed in 224us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391125.572064:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788391125.574747:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391125.574788:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103440640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788391125.575103:0:43324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:3.0:1788391125.575128:0:43324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788391125.577721:0:43346:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788391125.577910:0:43346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95d6a6bd4d28) 00000020:00000080:2.0:1788391125.577935:0:43346:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788391125.578087:0:43346:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6bbf78800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788391125.578092:0:43346:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6bbf78800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788391125.578094:0:43346:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6bbf78800 3 00010000:00080000:2.0:1788391125.578134:0:43346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d585010800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1788391125.581169:0:43346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788391125.581376:0:43346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788391125.581406:0:43346:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788391125.581414:0:43346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9aafc5f04cd36394 00000100:00080000:2.0:1788391125.581422:0:43346:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788391125.581427:0:43346:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95d585010800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391125.581457:0:43346:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687861180 x1875263103440768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788391125.581479:0:43346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788391125.581516:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103440768:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788391125.581589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391125.581594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788391125.581597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788391125.581600:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788391125.581651:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103440896:0@lo:400:kworker.0 00000100:00100000:0.0:1788391125.581700:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391125.581765:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440896 00000100:00100000:0.0:1788391125.581772:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440896 00000100:00100000:0.0:1788391125.581812:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788391125.581819:0:42644:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788391125.581822:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103440896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391125.581826:0:42644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788391125.581870:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103440896:12345-0@lo:400:kworker.0 Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391125.581877:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788391125.581909:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d586480700 x1875263103440896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391125.581930:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103440896:0@lo:400:kworker.0 00000100:00100000:2.0:1788391125.584607:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788391125.584855:0:43346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:3.0:1788391125.584911:0:43324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788391125.584937:0:43324:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788391125.584952:0:43324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36386 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.584979:0:43324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1200/0x9aafc5f04cd3637f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36386 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788391125.585020:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788391125.585022:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.585024:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.585025:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.585026:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.585028:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.585030:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.585031:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.585033:0:43324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788391125.585037:0:43324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788391125.585039:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788391125.585040:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.585041:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.585042:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.585043:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.585049:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.585051:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.585052:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.585053:0:43324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788391125.585075:0:43324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788391125.585092:0:43324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103441024:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788391125.585169:0:43324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.585197:0:43324:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.585206:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441024 00000100:00100000:2.0:1788391125.585213:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441024 00000100:00100000:2.0:1788391125.585253:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788391125.585263:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:43324:x1875263103441024:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788391125.585288:0:42637:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788391125.585302:0:42637:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788391125.585682:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103440768 00000100:00100000:1.0:1788391125.585688:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103440768 00000100:00100000:1.0:1788391125.585710:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391125.585716:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1875263103440768:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788391125.585735:0:42646:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 942 last 0 00000020:00000080:1.0:1788391125.585778:0:42646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9aafc5f04cd3639b 00000004:00100000:1.0:1788391125.585791:0:42646:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788391125.585823:0:42646:0:(import.c:65:import_set_state_nolock()) ffff95d585125800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788391125.585919:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875263103440768:12345-0@lo:38:llog_process_th.0 Request processed in 201us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391125.585927:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788391125.590226:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95d687861180 x1875263103440768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391125.590242:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788391125.590252:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:2.0:1788391125.590260:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788391125.590271:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788391125.590275:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d585010800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788391125.590281:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1875263103440768:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788391125.605813:0:42637:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788391125.605830:0:42637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788391125.605853:0:42660:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788391125.605857:0:42660:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788391125.605880:0:42660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.605899:0:42660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 16 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.605909:0:42660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.605950:0:42660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 16 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.605983:0:42660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 16 pid: 42638 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391125.605997:0:42660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103441152:0@lo:104: 00000100:00100000:1.0:1788391125.606058:0:42660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391125.606098:0:42660:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065780 going to sleep for 11 seconds 00000100:00100000:2.0:1788391125.606130:0:42627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441152 00000100:00100000:2.0:1788391125.606138:0:42627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441152 00000100:00100000:2.0:1788391125.606186:0:42627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391125.606196:0:42627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103441152:12345-0@lo:104: 00010000:00010000:2.0:1788391125.606208:0:42627:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606265:0:42627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788391125.606272:0:42627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103441152:12345-0@lo:104: Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.606278:0:42627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788391125.606282:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391125.606289:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.606296:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:3.0:1788391125.606300:0:42633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.606308:0:42633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788391125.606316:0:42633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391125.606322:0:42633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788391125.606355:0:42633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.606361:0:42633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788391125.606386:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391125.606393:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd36308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd3630f expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391125.606411:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103441280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788391125.606425:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391125.606426:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391125.606428:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391125.606441:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391125.606457:0:42660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103441152:0@lo:104: 00010000:00010000:3.0:1788391125.606474:0:42660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391125.606517:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441280 00000100:00100000:2.0:1788391125.606521:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441280 00010000:00010000:2.0:1788391125.606538:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 17 pid: 42638 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391125.606565:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391125.606572:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:3289:x1875263103441280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391125.606582:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391125.606586:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 17 pid: 42638 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606596:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 17 pid: 42638 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606618:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd1e00/0x9aafc5f04cd3630f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd36308 expref: 17 pid: 42638 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606629:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606636:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788391125.606647:0:42629:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001197586s 00010000:00010000:2.0:1788391125.606651:0:42629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606910:0:42629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606918:0:42629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606924:0:42629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606929:0:42629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391125.606933:0:42629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606940:0:42629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606978:0:42629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391125.606995:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391125.607023:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:3289:x1875263103441280:12345-0@lo:103:ldlm_bl.0 Request processed in 451us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391125.607030:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788391125.607033:0:42660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.607050:0:42660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391125.607057:0:42660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df6000/0x9aafc5f04cd363a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391125.607094:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103441280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391125.614676:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:43324:x1875263103441024:12345-0@lo:253:mount.lustre.0 Request processed in 29406us (29498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391125.614686:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788391125.614733:0:43324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:43324:1875263103441024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788391125.614759:0:43324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788391125.614764:0:43324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788391125.614765:0:43324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788391125.614767:0:43324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391125.614768:0:43324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391125.614769:0:43324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391125.614771:0:43324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391125.614772:0:43324:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391125.614774:0:43324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391125.614776:0:43324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788391125.614795:0:43324:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788391125.615407:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391125.615570:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391125.615701:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391125.615843:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788391125.615947:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788391125.616238:0:43324:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788391125.617417:0:43324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:0.0:1788391125.654382:0:43324:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788391125.654390:0:43324:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788391125.654438:0:43324:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788391125.654515:0:43324:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788391125.654535:0:43324:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788391125.654562:0:43324:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788391125.965440:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391126.989887:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788391127.440431:0:42641:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788391127.440438:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586c62000 from 22 10000000:01000000:3.0:1788391127.440444:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788391127.440492:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391127.440503:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391127.440515:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391127.440539:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103441408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788391127.440603:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391127.440652:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788391127.440697:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441408 00000100:00100000:1.0:1788391127.440705:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441408 00000100:00100000:1.0:1788391127.440758:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788391127.440767:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+15:42641:x1875263103441408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391127.440780:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391127.440792:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd363a9 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391127.440813:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 16 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391127.440822:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 16 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391127.440831:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391127.440872:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:42641:x1875263103441408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391127.440879:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788391127.440948:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103441408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788391127.441369:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391127.441379:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391127.441425:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103441536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788391127.441459:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391127.441489:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788391127.441531:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441536 00000100:00100000:1.0:1788391127.441542:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441536 00000100:00100000:1.0:1788391127.441577:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788391127.441584:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:42641:x1875263103441536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788391127.441598:0:42637:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788391127.441614:0:42637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788391127.441617:0:42637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 22 00000100:00100000:1.0:1788391127.441695:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:42641:x1875263103441536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391127.441702:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788391127.441734:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103441536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788391127.441793:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788391127.441799:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391127.441808:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.017238:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391128.593373:0:43691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788391128.654103:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788391118/real 1788391118] req@ffff95d5866a0a80 x1875263103435136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391128 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391128.654134:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d5866a0a80 x1875263103435136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391128 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391128.654144:0:3285:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788391118/real 1788391118] req@ffff95d687860700 x1875263103435008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391128 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391128.654220:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95d687860700 x1875263103435008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788391128 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788391128.654244:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788391128.654263:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788391128.654267:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103435136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788391128.654273:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb41000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788391128.654279:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788391128.654281:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103435008:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788391128.654462:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788391128.654466:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788391128.654470:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb41000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788391128.654475:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 936 00000100:00080000:2.0:1788391128.654479:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788391128.654485:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95d6bcb41000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391128.654503:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687863800 x1875263103441792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788391128.654515:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788391128.654517:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788391128.654519:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788391128.654521:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 936 00000100:00080000:2.0:1788391128.654523:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788391128.654525:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6bc73f000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1788391128.654533:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d687861880 x1875263103441920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391128.654574:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103442176:0@lo:400:kworker.0 00000100:00100000:2.0:1788391128.654631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391128.654791:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103442048:0@lo:400:kworker.0 00000100:00100000:1.0:1788391128.654822:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391128.654847:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391128.654854:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103441664:0@lo:400:kworker.0 00000100:00100000:1.0:1788391128.654882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391128.654913:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441664 00000100:00100000:1.0:1788391128.654920:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441664 00000100:00100000:2.0:1788391128.655073:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442176 00000100:00100000:2.0:1788391128.655093:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442176 00000100:00100000:2.0:1788391128.655134:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442048 00000100:00100000:2.0:1788391128.655138:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442048 00000100:00100000:2.0:1788391128.655225:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788391128.655234:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103442176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391128.655283:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103442176:12345-0@lo:400:kworker.0 Request processed in 50us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391128.655290:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788391128.655308:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391128.655314:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103442048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391128.655341:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103442048:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391128.655346:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391128.655380:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788391128.655388:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:3287:x1875263103441664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391128.655414:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:3287:x1875263103441664:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00080000:3.0:1788391128.655481:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788391128.657270:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687860e00 x1875263103442176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391128.657287:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103442176:0@lo:400:kworker.0 00000100:00100000:2.0:1788391128.657318:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103441664:0@lo:400:kworker.0 00010000:00080000:2.0:1788391128.657328:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687860000 x1875263103442048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391128.657335:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103442048:0@lo:400:kworker.0 00000100:00100000:2.0:1788391128.657353:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103441792:0@lo:8:kworker.0 00000100:00100000:2.0:1788391128.657402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391128.657445:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103441920:0@lo:8:kworker.0 00000100:00100000:2.0:1788391128.657484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391128.657865:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441792 00000100:00100000:0.0:1788391128.657873:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441792 00000100:00100000:0.0:1788391128.657908:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103441920 00000100:00100000:0.0:1788391128.657912:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103441920 00000100:00100000:0.0:1788391128.657924:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391128.657931:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103441792:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788391128.657958:0:43326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 945 last 0 00000020:00000080:0.0:1788391128.658009:0:43326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd363b7 00002000:00100000:0.0:1788391128.658023:0:43326:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95d6bc639800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788391128.658027:0:43326:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788391128.658030:0:43326:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788391128.658348:0:43326:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788391128.658372:0:43326:0:(import.c:65:import_set_state_nolock()) ffff95d6bc63a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391128.658433:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103441792:12345-0@lo:8:kworker.0 Request processed in 502us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391128.658448:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788391128.658467:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788391128.658472:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103441920:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788391128.658482:0:43326:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788391128.658489:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d687863800 x1875263103441792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788391143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391128.658497:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788391128.658503:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1788391128.658509:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788391128.658514:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788391128.658516:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bcb41000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788391128.658531:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788391128.658536:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103441792:0@lo:8:kworker.0 00000004:00080000:2.0:1788391128.658559:0:42666:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788391128.658825:0:42666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 945765863124ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788391128.659948:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788391128.664099:0:42667:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0xa3:0x0] 00000100:00100000:3.0:1788391128.664128:0:42667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:42667:1875263103442432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788391128.664205:0:42667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391128.664233:0:42667:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391128.664258:0:43327:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788391128.664271:0:43327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788391128.664298:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103442304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391128.664325:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391128.664363:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442304 00000100:00100000:3.0:1788391128.664370:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442304 00000100:00100000:3.0:1788391128.664417:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788391128.664428:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103442304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391128.664457:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788391128.664500:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103442304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391128.664507:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788391128.664527:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788391128.664553:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d5866a1180 x1875263103442304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788391144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391128.664571:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103442304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391128.664602:0:43328:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788391128.664610:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442432 00000100:00100000:3.0:1788391128.664613:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442432 00000100:00100000:1.0:1788391128.665396:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391128.665406:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:42667:x1875263103442432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788391128.671415:0:43698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788391128.671426:0:43698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -30 00002000:02000040:1.0:1788391128.671431:0:43698:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:164 to 0x240000400:193) 00000100:00100000:3.0:1788391128.673881:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1875263103441920:12345-0@lo:8:kworker.0 Request processed in 15399us (16387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788391128.673895:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788391128.674056:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788391128.674061:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788391128.674066:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103441920:0@lo:8:kworker.0 00002000:00010000:1.0:1788391128.679538:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.679555:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679572:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.679576:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.679583:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679600:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679610:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679618:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679635:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.679646:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.679651:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679658:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.679662:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679670:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679692:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679700:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be70e084/0x9aafc5f04cd363be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.679778:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.679781:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.679783:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.680455:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.680461:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.680471:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.680474:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.680479:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.680488:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.680496:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.680503:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.680596:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391128.681075:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.681081:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681101:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.681105:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.681109:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681119:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681126:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681134:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681213:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788391128.681214:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788391128.681220:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681227:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391128.681231:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681239:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681254:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681262:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069311ed7/0x9aafc5f04cd363c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681275:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391128.681278:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681294:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391128.681297:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681304:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681316:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681323:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009987e6e8/0x9aafc5f04cd363cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681336:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.681337:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.681339:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.681586:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.681592:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681601:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.681610:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.681614:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681624:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681632:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681640:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.681656:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391128.681667:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391128.681671:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681679:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391128.681683:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681691:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681708:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681715:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd363d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.681727:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.681729:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.681731:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.682116:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.682122:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682130:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.682133:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.682137:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682146:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682480:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682492:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682505:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.682512:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.682516:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682522:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.682526:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682533:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682544:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682550:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713dce87/0x9aafc5f04cd363da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682562:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.682563:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.682564:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.682947:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.682975:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.682984:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.682987:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.682992:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683001:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683010:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683016:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683029:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.683038:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.683041:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683048:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.683051:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683059:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683076:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683092:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ba7b650/0x9aafc5f04cd363e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683106:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.683108:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.683109:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391128.683387:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.683763:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.683770:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683779:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.683786:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.683791:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683801:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683808:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683815:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.683847:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391128.684077:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391128.684082:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.684099:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391128.684103:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.684110:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.684121:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.684128:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd363e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.684153:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.684155:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391128.684156:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.684329:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.684335:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684343:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.684346:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.684351:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684360:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684368:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684375:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684388:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391128.684471:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391128.684477:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.684485:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391128.684489:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.684496:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.684510:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.684522:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb381152/0x9aafc5f04cd363ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.684537:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391128.684538:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391128.684540:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.684788:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.684794:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684802:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.684810:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.684814:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684823:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684831:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684839:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684852:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.684860:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.684864:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684871:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.684874:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684882:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684891:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684908:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd363f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.684920:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.684921:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.684923:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.685397:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.685403:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685413:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.685416:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.685420:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685429:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685437:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685444:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685459:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.685468:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.685477:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685483:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.685486:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685495:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685506:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685513:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd363fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.685526:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.685528:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.685529:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.686490:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.686498:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.686507:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.686511:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.686515:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.686537:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.686546:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.686553:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.686610:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391128.687030:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.687036:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687045:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.687048:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.687052:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687061:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687068:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687097:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687265:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391128.687272:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687281:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.687285:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687305:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687322:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687330:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0f7f16/0x9aafc5f04cd36404 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687348:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.687351:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687358:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.687361:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687369:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687378:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.687386:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.687387:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.687394:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.687457:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.687462:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3640b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391128.687912:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.687918:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687926:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.687928:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.687932:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687941:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687949:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.687956:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688039:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.688045:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688053:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.688056:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688064:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688075:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688093:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.688095:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.688096:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.688216:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.688221:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051776990/0x9aafc5f04cd36412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391128.688585:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.688591:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.688599:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.688602:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.688607:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.688615:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.688623:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.688630:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688656:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.688660:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688667:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdda00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.688671:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688678:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688699:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.688717:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.688719:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.688721:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788391128.689478:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788391128.690004:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.690011:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002ae745d/0x9aafc5f04cd36419 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391128.690576:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.690583:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.690594:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.690598:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.690604:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.690616:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.690625:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.690632:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.690665:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.690671:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.690678:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.690682:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.690690:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.690771:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.690782:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.690783:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.690785:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.690845:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.690850:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd36420 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.691208:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.691884:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.691891:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.691909:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.691913:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.691918:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.691930:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.691938:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.691946:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.691988:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391128.691999:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391128.692003:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.692010:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391128.692014:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.692022:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.692045:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.692052:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36427 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.692067:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.692069:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.692071:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.693667:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.693676:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.693687:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.693690:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.693695:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.693777:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.693788:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.693797:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.693827:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.694132:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.694138:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694222:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.694226:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694235:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694250:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694257:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec32dcdf/0x9aafc5f04cd3642e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694273:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.694275:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.694277:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.694556:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.694562:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.694570:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.694573:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.694578:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.694587:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.694594:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.694602:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.694624:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.694783:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.694789:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694796:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.694800:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694808:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694824:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694831:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89fd26d/0x9aafc5f04cd36435 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.694843:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.694845:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.694847:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.695384:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.695391:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.695400:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.695408:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.695413:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.695423:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.695431:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.695437:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.695457:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.695793:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.695799:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.695808:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.695812:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.695819:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.695832:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.695839:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f741205/0x9aafc5f04cd3643c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.695864:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.695866:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.695867:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.696245:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.696252:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696261:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.696264:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.696268:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696278:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696286:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696299:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696352:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788391128.696786:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.696792:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696801:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.696804:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.696808:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696817:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696825:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.696832:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696860:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391128.696866:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696873:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.696877:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696885:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696896:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696903:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000314cb879/0x9aafc5f04cd36443 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696916:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.696919:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696924:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.696932:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696940:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696949:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.696957:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.696958:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.696976:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.697100:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.697105:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05e8502/0x9aafc5f04cd3644a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391128.697493:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.697500:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.697508:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.697511:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.697515:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.697524:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.697531:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.697537:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.697629:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.697634:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.697641:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.697645:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.697652:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.697662:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.697670:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.697677:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.697678:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391128.698245:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788391128.698251:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c33a052/0x9aafc5f04cd36451 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.698298:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.699691:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.699701:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.699737:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.699740:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.699746:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.699759:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.699768:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.699776:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.699801:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.700139:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.700146:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.700218:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.700223:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.700233:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.700249:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.700256:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3258be5/0x9aafc5f04cd36458 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.700272:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.700273:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.700275:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788391128.702288:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391128.702299:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.702312:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=945s v=(0 0) 00010000:00010000:1.0:1788391128.702317:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391128.702322:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.702334:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.702350:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.702355:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391128.702479:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391128.702481:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391128.702487:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.702495:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391128.702500:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.702508:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.702523:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.702530:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082649b88/0x9aafc5f04cd3645f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.702544:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391128.702546:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391128.702553:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391128.703130:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391128.703136:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703143:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=945s v=(0 0) 00010000:00010000:0.0:1788391128.703145:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391128.703148:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703157:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703165:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703172:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703192:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.703210:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.703216:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703223:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.703232:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703240:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703252:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703259:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0fa73cf/0x9aafc5f04cd36466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703272:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.703274:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.703275:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391128.703510:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391128.703514:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703526:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=945s v=(0 0) 00010000:00010000:0.0:1788391128.703528:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391128.703531:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703537:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703541:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703546:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703559:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.703578:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.703583:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703591:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79aa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.703595:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703603:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703614:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703627:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d632c7c6/0x9aafc5f04cd3646d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703639:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.703641:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.703643:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391128.703861:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391128.703865:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703870:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=945s v=(0 0) 00010000:00010000:0.0:1788391128.703872:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391128.703875:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703880:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703892:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703896:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.703908:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.703927:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.703932:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703939:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ae00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.703942:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.703950:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704126:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704136:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a78315/0x9aafc5f04cd36474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704148:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704213:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704215:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391128.704330:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391128.704334:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704340:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=945s v=(0 0) 00010000:00010000:0.0:1788391128.704342:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391128.704345:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704351:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704355:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704360:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704379:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.704399:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.704404:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704411:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.704415:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704423:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704433:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704441:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022237995/0x9aafc5f04cd3647b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704452:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704454:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704456:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788391128.704674:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391128.704678:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704683:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=945s v=(0 0) 00010000:00010000:0.0:1788391128.704685:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391128.704688:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704693:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704698:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704703:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391128.704722:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391128.704781:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391128.704786:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704793:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.704796:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704816:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704827:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704834:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000655c202a/0x9aafc5f04cd36482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.704846:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704848:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.704849:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391128.706196:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391128.706206:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.706217:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=945s v=(0 0) 00010000:00010000:2.0:1788391128.706220:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391128.706226:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.706238:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.706246:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.706254:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391128.706272:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788391128.706452:0:43698:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:163 00000100:00100000:2.0:1788391128.706547:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:42667:x1875263103442432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 41139us (42338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391128.706559:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788391128.706672:0:42667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:42667:1875263103442432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788391128.706689:0:42667:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xc1:0x0] from OST, last_created [0x240000400:0xc1:0x0]last_used is [0x240000400:0xa3:0x0] 00000100:00100000:0.0:1788391128.706733:0:42667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:42667:1875263103442560:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788391128.706767:0:42667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391128.706805:0:42667:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391128.706908:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442560 00000100:00100000:2.0:1788391128.706914:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442560 00010000:00010000:3.0:1788391128.707325:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788391128.707326:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788391128.707332:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391128.707335:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:42667:x1875263103442560:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788391128.707342:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391128.707346:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.707354:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788391128.707370:0:43328:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 194 00010000:00010000:3.0:1788391128.707371:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.707387:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36489 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391128.707402:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.707404:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391128.707406:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391128.710338:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:42667:x1875263103442560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2998us (3564us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1788391128.710348:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391128.710506:0:42667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:42667:1875263103442560:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788391128.710520:0:42667:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xc1:0x0]-[0x240000400:0xe1:0x0] 00010000:00010000:3.0:1788391129.038532:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391130.061230:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391131.085164:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391131.149512:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771073 is committed 00000001:00100000:1.0:1788391131.149530:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788391131.283187:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788391131.283197:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391131.283235:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:3.0:1788391131.283241:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788391132.113211:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788391132.820753:0:44040:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788391132.820756:0:44040:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788391132.820828:0:44040:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95d6b4edc800 00000020:01000004:3.0:1788391132.820839:0:44040:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788391132.820848:0:44040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788391132.820859:0:44040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95d6bc75cd28) 00000020:00000080:3.0:1788391132.820870:0:44040:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788391132.841386:0:44040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788391132.841618:0:44040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788391132.842354:0:44040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788391132.842578:0:44040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788391132.842764:0:44040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:2.0:1788391132.843113:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:2.0:1788391132.843251:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 539: rc = 0 00100000:10000000:2.0:1788391132.843335:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:2.0:1788391132.843793:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788391132.844042:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1788391132.846504:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788391132.846809:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788391132.847080:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1788391132.847314:0:44040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:2.0:1788391132.847824:0:44040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788391132.847836:0:44040:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788391132.847847:0:44040:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd36497 00000020:01000004:2.0:1788391132.847855:0:44040:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788391132.847874:0:44040:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788391132.847878:0:44040:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788391132.847883:0:44040:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788391132.847903:0:44040:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788391132.847907:0:44040:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788391132.861952:0:44040:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788391132.862015:0:44040:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788391132.862020:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788391132.862021:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788391132.862023:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391132.862024:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391132.862026:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391132.862027:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391132.862028:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391132.862030:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391132.862032:0:44040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391132.862040:0:44040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788391132.862042:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788391132.862044:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788391132.862057:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391132.862059:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391132.862060:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391132.862061:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391132.862062:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391132.862063:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391132.862064:0:44040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788391132.862090:0:44040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788391132.862110:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788391132.862175:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.862227:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.862232:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442688 00000100:00100000:1.0:1788391132.862241:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442688 00000100:00100000:1.0:1788391132.862299:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788391132.862310:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:44040:x1875263103442688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788391132.862339:0:42639:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788391132.862343:0:42639:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788391132.862347:0:42639:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788391132.873084:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:44040:x1875263103442688:12345-0@lo:253:mount.lustre.0 Request processed in 10770us (10901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.873100:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788391132.873201:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788391132.873218:0:44040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788391132.873221:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788391132.873223:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788391132.873224:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788391132.873226:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788391132.873227:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788391132.873228:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788391132.873229:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788391132.873231:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788391132.873233:0:44040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788391132.873252:0:44040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95d6b4edc800 from lustre-OST0001 10000000:01000000:3.0:1788391132.873278:0:44040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788391132.873282:0:44040:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788391132.873291:0:44040:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95d6bc2799b8 local copy 00010000:00010000:3.0:1788391132.873301:0:44040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391132.873514:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391132.873545:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.873925:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442816 00000100:00100000:1.0:1788391132.873930:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442816 00000100:00100000:1.0:1788391132.874076:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788391132.874088:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:44040:x1875263103442816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391132.874502:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:44040:x1875263103442816:12345-0@lo:501:mount.lustre.0 Request processed in 414us (955us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788391132.874510:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788391132.874634:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925600 going to sleep for 11 seconds 00000100:00100000:3.0:1788391132.874652:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788391132.874667:0:44040:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788391132.874812:0:44040:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788391132.874818:0:44040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.874921:0:44040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7400/0x9aafc5f04cd3622f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd36236 expref: -99 pid: 42625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788391132.874940:0:44040:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95d6b4edc800 10000000:01000000:3.0:1788391132.875040:0:44040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788391132.875056:0:44040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788391132.875060:0:44040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788391132.875065:0:44040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788391132.875068:0:44040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788391132.875089:0:44040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.875095:0:44040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.875102:0:44040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391132.875111:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788391132.875138:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.875197:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925600 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.875243:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103442944 00000100:00100000:1.0:1788391132.875248:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103442944 00000100:00100000:1.0:1788391132.875278:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788391132.875295:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:44040:x1875263103442944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391132.875307:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391132.875320:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd364a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd3649e expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.875342:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd364a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd3649e expref: 17 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.875351:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc800/0x9aafc5f04cd364a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3649e expref: 17 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.875361:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc800, rc 0) 00000100:00100000:1.0:1788391132.875452:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103442944:12345-0@lo:101:mount.lustre.0 Request processed in 166us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.875458:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788391132.875713:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103442944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788391132.875732:0:44040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364a5 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.875741:0:44040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd364a5 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391132.876405:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000040:00080000:3.0:1788391132.877486:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391132.877759:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788391132.877807:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1788391132.877839:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1788391132.877884:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1788391132.877918:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1788391132.877936:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1788391132.878018:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1788391132.878075:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1788391132.878126:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 120 off9752 00000040:00080000:3.0:1788391132.878192:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9976 00000040:00080000:3.0:1788391132.878206:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 11 00000100:00100000:3.0:1788391132.878264:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391132.878309:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.878347:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925780 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.878401:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443072 00000100:00100000:1.0:1788391132.878406:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443072 00000100:00100000:1.0:1788391132.878445:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788391132.878455:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391132.878753:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443072:12345-0@lo:501:mount.lustre.0 Request processed in 299us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.878768:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788391132.878823:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788391132.878850:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788391132.878888:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.878942:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925780 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.879026:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443200 00000100:00100000:1.0:1788391132.879031:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443200 00000100:00100000:1.0:1788391132.879074:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788391132.879080:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391132.879309:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443200:12345-0@lo:503:mount.lustre.0 Request processed in 225us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.879317:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788391132.879343:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788391132.879720:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788391132.879772:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391132.879798:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.879822:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925780 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.879830:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443328 00000100:00100000:1.0:1788391132.879835:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443328 00000100:00100000:1.0:1788391132.879864:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788391132.879872:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391132.880061:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443328:12345-0@lo:502:mount.lustre.0 Request processed in 187us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.880068:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788391132.880148:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788391132.880339:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:0.0:1788391132.880371:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:0.0:1788391132.880388:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:0.0:1788391132.880412:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:0.0:1788391132.880444:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:0.0:1788391132.880475:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:0.0:1788391132.880525:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:0.0:1788391132.880563:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:0.0:1788391132.880622:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 120 off9752 00000100:00100000:0.0:1788391132.880646:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391132.880683:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391132.880723:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.880895:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443456 00000100:00100000:2.0:1788391132.880900:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443456 00000100:00100000:2.0:1788391132.880935:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788391132.880943:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391132.881121:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443456:12345-0@lo:502:mount.lustre.0 Request processed in 179us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.881136:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788391132.881254:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788391132.881309:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9976 00000040:00080000:0.0:1788391132.881317:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788391132.881865:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788391132.881872:0:44042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788391132.881879:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.881881:0:44042:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788391132.881887:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788391132.881901:0:44042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95d68a660000) 00000020:00000080:2.0:1788391132.881918:0:44042:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788391132.881922:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788391132.881992:0:44042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6b4edc800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788391132.882000:0:44042:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788391132.882008:0:44042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9aafc5f04cd364b3 00010000:00010000:2.0:1788391132.885621:0:44042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788391132.886059:0:44042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 25769803784 00080000:10000000:2.0:1788391132.887688:0:44042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:2.0:1788391132.888563:0:44042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788391132.888576:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391132.888580:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.888582:0:44042:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788391132.888584:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391132.888587:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.888588:0:44042:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788391132.888589:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788391132.888591:0:44042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788391132.888593:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391132.888594:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.888595:0:44042:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788391132.888596:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788391132.888597:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.888598:0:44042:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788391132.888600:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788391132.888629:0:44042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788391132.888635:0:44042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788391132.888636:0:44042:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788391132.888638:0:44042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000020:01000000:0.0:1788391132.888718:0:44040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788391132.888745:0:44040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788391132.888765:0:44040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364a5 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.888788:0:44040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cd1600/0x9aafc5f04cd3649e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364a5 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391132.888796:0:44040:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6b4edc800 from 1 10000000:01000000:0.0:1788391132.888799:0:44040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788391132.888831:0:44040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.888839:0:44040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.888850:0:44040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391132.888872:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788391132.888939:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391132.889098:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.889143:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443584 00000100:00100000:2.0:1788391132.889149:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443584 00000100:00100000:2.0:1788391132.889230:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788391132.889240:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:44040:x1875263103443584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788391132.889253:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391132.889264:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd364ba expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391132.889286:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391132.889295:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391132.889304:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:2.0:1788391132.889352:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443584:12345-0@lo:101:mount.lustre.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.889358:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788391132.889428:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391132.889442:0:44040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.889451:0:44040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391132.889901:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:1.0:1788391132.890319:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788391132.890550:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:1.0:1788391132.890593:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:1.0:1788391132.890650:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:1.0:1788391132.890684:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:1.0:1788391132.890715:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:1.0:1788391132.890762:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:1.0:1788391132.890796:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:1.0:1788391132.890830:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:1.0:1788391132.890894:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:1.0:1788391132.890903:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:1.0:1788391132.890992:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391132.891037:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391132.891214:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443712 00000100:00100000:0.0:1788391132.891219:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443712 00000100:00100000:0.0:1788391132.891250:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788391132.891258:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788391132.891436:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443712:12345-0@lo:501:mount.lustre.0 Request processed in 178us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391132.891443:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788391132.891564:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.891584:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391132.891611:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788391132.891649:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.891709:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391132.891752:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443840 00000100:00100000:0.0:1788391132.891756:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443840 00000100:00100000:0.0:1788391132.891787:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788391132.891793:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788391132.892042:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443840:12345-0@lo:503:mount.lustre.0 Request processed in 248us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391132.892059:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788391132.892139:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443840:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788391132.892623:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788391132.892679:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391132.892714:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.892789:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391132.892830:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103443968 00000100:00100000:0.0:1788391132.892835:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103443968 00000100:00100000:0.0:1788391132.892897:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788391132.892905:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788391132.893066:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103443968:12345-0@lo:502:mount.lustre.0 Request processed in 162us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391132.893073:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788391132.893146:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103443968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788391132.893329:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:1.0:1788391132.893371:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:1.0:1788391132.893417:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:1.0:1788391132.893452:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:1.0:1788391132.893484:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:1.0:1788391132.893532:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:1.0:1788391132.893576:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:1.0:1788391132.893616:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:1.0:1788391132.893640:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788391132.893674:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.893772:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.893811:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444096 00000100:00100000:2.0:1788391132.893816:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444096 00000100:00100000:2.0:1788391132.893840:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788391132.893846:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103444096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391132.894106:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103444096:12345-0@lo:502:mount.lustre.0 Request processed in 259us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.894114:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788391132.894215:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788391132.894288:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:1.0:1788391132.894298:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788391132.896620:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391132.896629:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896632:0:44045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788391132.896639:0:44045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6b4edc800 00000020:00000080:0.0:1788391132.896641:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788391132.896648:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391132.896651:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896652:0:44045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788391132.896654:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391132.896657:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896658:0:44045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788391132.896661:0:44045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95d6b4edc800 00000020:00000080:0.0:1788391132.896663:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788391132.896695:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391132.896698:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896699:0:44045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788391132.896702:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788391132.896704:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896705:0:44045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788391132.896709:0:44045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95d6b4edc800 00000020:00000080:0.0:1788391132.896716:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788391132.896753:0:44045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788391132.896756:0:44045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788391132.896758:0:44045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788391132.896761:0:44045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:1.0:1788391132.898597:0:44040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788391132.898630:0:44040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788391132.898647:0:44040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.898659:0:44040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391132.898733:0:44040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788391132.898736:0:44040:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95d6b4edc800 10000000:01000000:1.0:1788391132.898739:0:44040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95d6b4edc800 10000000:01000000:1.0:1788391132.898743:0:44040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788391132.898749:0:44040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95d6b4edc800 from 1 10000000:01000000:1.0:1788391132.898752:0:44040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788391132.898784:0:44040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.898793:0:44040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.898804:0:44040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391132.898838:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788391132.898908:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.898944:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444224 00000100:00100000:1.0:1788391132.898950:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444224 00000100:00100000:1.0:1788391132.899014:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788391132.899023:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103444224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391132.899036:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391132.899058:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd364cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd364c8 expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.899078:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd364cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd364c8 expref: 19 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.899088:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdc200/0x9aafc5f04cd364cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd364c8 expref: 19 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.899097:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc200, rc 0) 00000100:00100000:1.0:1788391132.899126:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444224:12345-0@lo:101:mount.lustre.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391132.899133:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788391132.899169:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.899189:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788391132.899202:0:44040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364cf expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.899210:0:44040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd364cf expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391132.900779:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:1.0:1788391132.901132:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788391132.901385:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1788391132.901423:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:1.0:1788391132.901456:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:1.0:1788391132.901503:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:1.0:1788391132.901540:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:1.0:1788391132.901590:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:1.0:1788391132.901630:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:1.0:1788391132.901662:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:1.0:1788391132.901709:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:1.0:1788391132.901748:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:1.0:1788391132.901784:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:1.0:1788391132.901834:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:1.0:1788391132.901873:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:1.0:1788391132.901924:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:1.0:1788391132.901996:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:1.0:1788391132.902037:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:1.0:1788391132.902086:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:1.0:1788391132.902132:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:1.0:1788391132.902167:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:1.0:1788391132.902203:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:1.0:1788391132.902253:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:1.0:1788391132.902292:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:1.0:1788391132.902329:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:1.0:1788391132.902376:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:1.0:1788391132.902412:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:1.0:1788391132.902445:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:1.0:1788391132.902491:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:1.0:1788391132.902524:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:1.0:1788391132.902566:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:1.0:1788391132.902629:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:1.0:1788391132.902663:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:1.0:1788391132.902695:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:1.0:1788391132.902727:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:1.0:1788391132.902776:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:1.0:1788391132.902812:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:1.0:1788391132.902860:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:1.0:1788391132.902896:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:1.0:1788391132.902929:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:1.0:1788391132.902990:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:1.0:1788391132.903027:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:1.0:1788391132.904810:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:1.0:1788391132.904824:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:1.0:1788391132.904931:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788391132.905022:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.905074:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.905171:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444352 00000100:00100000:2.0:1788391132.905185:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444352 00000100:00100000:2.0:1788391132.905224:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788391132.905233:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391132.906117:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444352:12345-0@lo:501:mount.lustre.0 Request processed in 883us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.906125:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788391132.906182:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788391132.906214:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391132.906247:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391132.906269:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444480 00000100:00100000:2.0:1788391132.906272:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444480 00000100:00100000:2.0:1788391132.906294:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788391132.906300:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788391132.906435:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444480:12345-0@lo:503:mount.lustre.0 Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.906443:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788391132.906489:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.906503:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444480:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788391132.907018:0:44040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788391132.907089:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391132.907121:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391132.907140:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444608 00000100:00100000:2.0:1788391132.907144:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444608 00000100:00100000:2.0:1788391132.907164:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788391132.907170:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391132.907321:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444608:12345-0@lo:502:mount.lustre.0 Request processed in 150us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.907328:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788391132.907364:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.907376:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788391132.907581:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:2.0:1788391132.907622:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:2.0:1788391132.907656:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:2.0:1788391132.907702:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:2.0:1788391132.907742:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:2.0:1788391132.907794:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:2.0:1788391132.907844:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:2.0:1788391132.907878:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:2.0:1788391132.907923:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:2.0:1788391132.907979:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:2.0:1788391132.908017:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:2.0:1788391132.908539:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:2.0:1788391132.908580:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:2.0:1788391132.908613:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:2.0:1788391132.908660:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:2.0:1788391132.908697:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:2.0:1788391132.908732:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:2.0:1788391132.908780:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:2.0:1788391132.908817:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:2.0:1788391132.908852:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:2.0:1788391132.908903:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:2.0:1788391132.908940:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:2.0:1788391132.911942:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:2.0:1788391132.912058:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:2.0:1788391132.912101:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:2.0:1788391132.912150:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:2.0:1788391132.912202:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:2.0:1788391132.912236:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:2.0:1788391132.912270:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:2.0:1788391132.912319:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:2.0:1788391132.912357:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:2.0:1788391132.912394:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:2.0:1788391132.912428:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:2.0:1788391132.912476:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:2.0:1788391132.912514:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:2.0:1788391132.912564:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:2.0:1788391132.912602:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:2.0:1788391132.912637:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:2.0:1788391132.912707:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:2.0:1788391132.912745:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:2.0:1788391132.912793:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788391132.912865:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391132.912912:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391132.913001:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444736 00000100:00100000:3.0:1788391132.913009:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444736 00000100:00100000:3.0:1788391132.913063:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788391132.913073:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788391132.913289:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103444736:12345-0@lo:502:mount.lustre.0 Request processed in 216us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391132.913297:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788391132.914082:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103444736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788391132.914170:0:44040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:2.0:1788391132.914181:0:44040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788391132.918387:0:44051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788391132.918414:0:44051:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95d58a9819b8) 00000020:00000080:1.0:1788391132.918437:0:44051:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788391132.918512:0:44051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95d6b4edc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788391132.918516:0:44051:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95d6b4edc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788391132.918519:0:44051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95d6b4edc800 3 00010000:00080000:1.0:1788391132.918555:0:44051:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95d6865e3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1788391132.920722:0:44051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788391132.920911:0:44051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788391132.920945:0:44051:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788391132.920956:0:44051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9aafc5f04cd364dd 00000100:00080000:1.0:1788391132.920996:0:44051:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788391132.921001:0:44051:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95d6865e3800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1788391132.921068:0:44051:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d6bbcf2680 x1875263103444864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788391132.921097:0:44051:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788391132.921197:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788391132.921202:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788391132.921205:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788391132.921210:0:32887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 945 00000100:00080000:3.0:1788391132.921214:0:32887:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788391132.921218:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6bc73f000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788391132.921232:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d5866a2680 x1875263103445120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788391132.921280:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103445248:0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921343:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.921389:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391132.921397:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103444992:0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.921616:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103445376:0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921640:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.921678:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445248 00000100:00100000:3.0:1788391132.921684:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445248 00000100:00100000:3.0:1788391132.921717:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445376 00000100:00100000:3.0:1788391132.921719:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445376 00000100:00100000:3.0:1788391132.921744:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391132.921752:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103445248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921794:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103445248:12345-0@lo:400:kworker.0 Request processed in 42us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391132.921801:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391132.921813:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391132.921819:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103445376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921844:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103445376:12345-0@lo:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391132.921850:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391132.921865:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444992 00000100:00100000:3.0:1788391132.921868:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444992 00000100:00100000:3.0:1788391132.921891:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788391132.921897:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103444992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.921922:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103444992:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391132.921927:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788391132.922266:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391132.922270:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788391132.922295:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d5866a0380 x1875263103445376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391132.922308:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103445376:0@lo:400:kworker.0 00000100:00100000:3.0:1788391132.922333:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:3.0:1788391132.922349:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103444992:0@lo:400:kworker.0 00010000:00080000:3.0:1788391132.922360:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d5866a0e00 x1875263103445248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788391148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391132.922368:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103445248:0@lo:400:kworker.0 00000100:00100000:2.0:1788391132.923145:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103444864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788391132.923198:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391132.923242:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103445120:0@lo:8:kworker.0 00000100:00100000:0.0:1788391132.923243:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103444864 00000100:00100000:0.0:1788391132.923250:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103444864 00000100:00100000:2.0:1788391132.923278:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391132.923284:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391132.923292:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875263103444864:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788391132.923314:0:42644:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 950 last 0 00000020:00000080:0.0:1788391132.923345:0:42644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9aafc5f04cd364e4 00000004:00100000:0.0:1788391132.923360:0:42644:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788391132.923388:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445120 00000100:00080000:0.0:1788391132.923388:0:42644:0:(import.c:65:import_set_state_nolock()) ffff95d6bc63f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391132.923394:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445120 00000100:00100000:2.0:1788391132.923436:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788391132.923442:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875263103444864:12345-0@lo:38:llog_process_th.0 Request processed in 148us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.923445:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103445120:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788391132.923452:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788391132.923492:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95d6bbcf2680 x1875263103444864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788391142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788391132.923502:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788391132.923503:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103445120:12345-0@lo:8:kworker.0 Request processed in 57us (223us total) trans 0 rc -11/-11 00000100:00080000:0.0:1788391132.923510:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:0.0:1788391132.923519:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788391132.923523:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788391132.923526:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6865e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788391132.923533:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1875263103444864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788391132.923545:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788391132.923548:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788391132.923551:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788391132.923559:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103445120:0@lo:8:kworker.0 00000100:00100000:2.0:1788391132.923568:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788391132.924156:0:44051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:2.0:1788391132.924257:0:44040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788391132.924295:0:44040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788391132.924308:0:44040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364cf expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391132.924390:0:44040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc400/0x9aafc5f04cd364c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364cf expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788391132.924437:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788391132.924439:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788391132.924441:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788391132.924443:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788391132.924444:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788391132.924446:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788391132.924448:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788391132.924451:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788391132.924452:0:44040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788391132.924456:0:44040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788391132.924459:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788391132.924460:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788391132.924462:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788391132.924464:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788391132.924465:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788391132.924467:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788391132.924468:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788391132.924469:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788391132.924471:0:44040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788391132.924491:0:44040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788391132.924506:0:44040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103445504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788391132.924563:0:44040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391132.924647:0:44040:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391132.924680:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445504 00000100:00100000:1.0:1788391132.924684:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445504 00000100:00100000:1.0:1788391132.924755:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788391132.924764:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:44040:x1875263103445504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788391132.924787:0:42638:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788391132.924801:0:42638:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788391132.947390:0:42638:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788391132.947407:0:42638:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788391132.947477:0:42660:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788391132.947483:0:42660:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788391132.947506:0:42660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.947524:0:42660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 19 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.947533:0:42660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.947574:0:42660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 19 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391132.947589:0:42660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 19 pid: 42639 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391132.947604:0:42660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103445632:0@lo:104: 00000100:00100000:3.0:1788391132.947670:0:42660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391132.947794:0:42660:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788391132.947918:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445632 00000100:00100000:2.0:1788391132.947927:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445632 00000100:00100000:2.0:1788391132.947987:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788391132.947995:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103445632:12345-0@lo:104: 00010000:00010000:2.0:1788391132.948005:0:42628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391132.948068:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788391132.948075:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:42660:x1875263103445632:12345-0@lo:104: Request processed in 81us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1788391132.948079:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788391132.948086:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788391132.948090:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948099:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc1d52c20) 00000100:00100000:1.0:1788391132.948105:0:42660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:42660:1875263103445632:0@lo:104: 10000000:00010000:0.0:1788391132.948105:0:42633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948119:0:42633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788391132.948127:0:42633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948131:0:42660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391132.948132:0:42633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788391132.948164:0:42633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948171:0:42633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788391132.948199:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948206:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d684cd1000/0x9aafc5f04cd363a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd363b0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948342:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391132.948345:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391132.948347:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391132.948355:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391132.948366:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103445760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788391132.948413:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391132.948483:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445760 00000100:00100000:1.0:1788391132.948489:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445760 00010000:00010000:1.0:1788391132.948507:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 20 pid: 42639 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391132.948532:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391132.948540:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+20:3288:x1875263103445760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391132.948551:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391132.948555:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 20 pid: 42639 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948564:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 20 pid: 42639 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948576:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4df6200/0x9aafc5f04cd363b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd363a9 expref: 20 pid: 42639 timeout: 1050 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948597:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948604:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788391132.948615:0:42630:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001197586s 00010000:00010000:1.0:1788391132.948619:0:42630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948625:0:42630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948632:0:42630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948637:0:42630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948642:0:42630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391132.948646:0:42630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948652:0:42630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948669:0:42630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391132.948688:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391132.948690:0:42660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948701:0:42660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391132.948707:0:42660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0c00/0x9aafc5f04cd364eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391132.948742:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103445760:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391132.948745:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103445760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391132.948757:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788391132.956820:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:44040:x1875263103445504:12345-0@lo:253:mount.lustre.0 Request processed in 32048us (32248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391132.956836:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788391132.956923:0:44040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2d257ec-6d90-4f1c-863a-372d5df14bf2:44040:1875263103445504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788391132.956939:0:44040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788391132.956942:0:44040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788391132.956944:0:44040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788391132.956945:0:44040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788391132.957029:0:44040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788391132.957031:0:44040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788391132.957033:0:44040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788391132.957034:0:44040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788391132.957036:0:44040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788391132.957038:0:44040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788391132.957063:0:44040:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788391132.957459:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788391132.957622:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788391132.957857:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788391132.958201:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788391132.958348:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788391132.958514:0:44040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788391132.959398:0:44040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:1.0:1788391132.983522:0:44040:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788391132.983531:0:44040:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788391132.983623:0:44040:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788391132.983692:0:44040:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788391132.983706:0:44040:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788391132.983733:0:44040:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788391133.133575:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788391134.093116:0:42641:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788391134.093122:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95d586c62000 from 23 10000000:01000000:1.0:1788391134.093127:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788391134.093169:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391134.093178:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391134.093187:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391134.093208:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103445888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788391134.093259:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391134.093298:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925600 going to sleep for 11 seconds 00000100:00100000:2.0:1788391134.093303:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103445888 00000100:00100000:2.0:1788391134.093310:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103445888 00000100:00100000:2.0:1788391134.093391:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788391134.093398:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103445888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391134.093408:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391134.093418:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc0600/0x9aafc5f04cd364f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd364f2 expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391134.093433:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc0600/0x9aafc5f04cd364f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd364f2 expref: 19 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391134.093440:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc0600/0x9aafc5f04cd364f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd364f2 expref: 19 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391134.093453:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0600, rc 0) 00000100:00100000:2.0:1788391134.093488:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103445888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391134.093495:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788391134.093525:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103445888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391134.093539:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364f9 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391134.093548:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd364f9 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391134.093597:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103446016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788391134.093620:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391134.093636:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925600 going to sleep for 11 seconds 00000100:00100000:2.0:1788391134.093656:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446016 00000100:00100000:2.0:1788391134.093660:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446016 00000100:00100000:2.0:1788391134.093715:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788391134.093721:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103446016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788391134.093731:0:42638:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788391134.093743:0:42638:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788391134.093745:0:42638:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:2.0:1788391134.093827:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103446016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391134.093836:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103446016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788391134.093843:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 10000000:01000000:1.0:1788391134.093951:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788391134.094241:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364f9 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391134.094251:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdc600/0x9aafc5f04cd364f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd364f9 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391134.157158:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391134.161564:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391134.161584:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103446144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391134.161645:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391134.161689:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446144 00000100:00100000:1.0:1788391134.161696:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446144 00000100:00100000:1.0:1788391134.161745:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391134.161754:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103446144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391134.161785:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391134.161825:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103446144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391134.161831:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788391134.161850:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391134.161884:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103446144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391135.181634:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391136.206427:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788391136.222985:0:44395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788391137.229128:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391137.469189:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.470567:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094084736 00000100:00100000:2.0:1788391137.470579:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094084736 00000100:00100000:2.0:1788391137.470675:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788391137.470683:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1875263094084736:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788391137.470712:0:42637:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 12917691-423e-4064-ad89-5d05a8181e9d@192.168.202.1@tcp t0 exp 0000000000000000 cur 954 last 0 00000020:00000080:2.0:1788391137.470745:0:42637:0:(genops.c:1385:class_connect()) connect: client 12917691-423e-4064-ad89-5d05a8181e9d, cookie 0x9aafc5f04cd36500 00000100:00080000:2.0:1788391137.470886:0:42637:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391137.470979:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+5:2355:x1875263094084736:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 276us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.470986:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788391137.474528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.474893:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094084864 00000100:00100000:2.0:1788391137.474903:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094084864 00000100:00100000:2.0:1788391137.475033:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788391137.475043:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+5:32276:x1875263094084864:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788391137.475059:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391137.475076:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc1200/0x9aafc5f04cd36507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb94 expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.475104:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc1200/0x9aafc5f04cd36507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb94 expref: 6 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.475115:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc1200/0x9aafc5f04cd36507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb94 expref: 6 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.475124:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1200, rc 0) 00000100:00100000:2.0:1788391137.475178:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+6:32276:x1875263094084864:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 137us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.475185:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:0.0:1788391137.476727:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.476809:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094084992 00000100:00100000:3.0:1788391137.476816:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094084992 00000100:00100000:3.0:1788391137.476858:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391137.476867:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+6:32276:x1875263094084992:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788391137.478707:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+6:32276:x1875263094084992:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 1835us (1978us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788391137.478720:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788391137.481242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.481469:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085120 00000100:00100000:2.0:1788391137.481479:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085120 00000100:00100000:2.0:1788391137.481534:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391137.481544:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+6:32276:x1875263094085120:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788391137.481560:0:42638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391137.481577:0:42638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc0c00/0x9aafc5f04cd3650e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffb9b expref: -99 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.481606:0:42638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc0c00/0x9aafc5f04cd3650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb9b expref: 7 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.481634:0:42638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc0c00/0x9aafc5f04cd3650e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffb9b expref: 7 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.481643:0:42638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0c00, rc 0) 00000100:00100000:2.0:1788391137.481700:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+7:32276:x1875263094085120:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 157us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.481707:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788391137.484657:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.484754:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085248 00000100:00100000:3.0:1788391137.484764:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085248 00000100:00100000:3.0:1788391137.484811:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788391137.484821:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+7:32276:x1875263094085248:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788391137.485302:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+8:32276:x1875263094085248:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 480us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391137.485312:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788391137.487998:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.488057:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085376 00000100:00100000:2.0:1788391137.488068:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085376 00000100:00100000:2.0:1788391137.488124:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788391137.488135:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+8:32276:x1875263094085376:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788391137.488496:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+8:32276:x1875263094085376:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 362us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.488505:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1788391137.494894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.495214:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085504 00000100:00100000:3.0:1788391137.495224:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085504 00000100:00100000:3.0:1788391137.495331:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1788391137.495342:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+8:32294:x1875263094085504:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788391137.495692:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+8:32294:x1875263094085504:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 351us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391137.495700:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788391137.503459:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.503556:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085632 00000100:00100000:0.0:1788391137.503566:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085632 00000100:00100000:0.0:1788391137.503661:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788391137.503672:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+8:32294:x1875263094085632:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391137.503953:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+8:32294:x1875263094085632:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 282us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391137.503985:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788391137.506846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.507261:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085760 00000100:00100000:3.0:1788391137.507271:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085760 00000100:00100000:3.0:1788391137.507375:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391137.507385:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+8:32276:x1875263094085760:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788391137.507414:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391137.507432:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd36515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffbc5 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391137.507458:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd36515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbc5 expref: 9 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391137.507469:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cd0000/0x9aafc5f04cd36515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbc5 expref: 9 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391137.507477:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd0000, rc 0) 00000100:00100000:3.0:1788391137.507537:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+9:32276:x1875263094085760:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 154us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391137.507544:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788391137.510104:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.510204:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094085888 00000100:00100000:0.0:1788391137.510214:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094085888 00000100:00100000:0.0:1788391137.510310:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788391137.510330:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+9:32276:x1875263094085888:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788391137.510356:0:42637:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788391137.510379:0:42637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788391137.510384:0:42637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788391137.510387:0:42637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788391137.510389:0:42637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:0.0:1788391137.513086:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+9:32276:x1875263094085888:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 2758us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391137.513100:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788391137.518587:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.518685:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086016 00000100:00100000:2.0:1788391137.518695:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086016 00000100:00100000:2.0:1788391137.518751:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391137.518761:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+9:32276:x1875263094086016:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788391137.518778:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391137.518796:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffbcc expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.518822:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 10 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.518832:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 10 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391137.518854:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:2.0:1788391137.518922:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+10:32276:x1875263094086016:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 162us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.518929:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391137.520397:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.520474:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086144 00000100:00100000:0.0:1788391137.520482:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086144 00000100:00100000:0.0:1788391137.520523:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1788391137.520532:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+10:32276:x1875263094086144:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788391137.520769:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+10:32276:x1875263094086144:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 238us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391137.520779:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788391137.525183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.525242:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086272 00000100:00100000:0.0:1788391137.525253:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086272 00000100:00100000:0.0:1788391137.525307:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788391137.525319:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+10:32276:x1875263094086272:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788391137.525857:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+10:32276:x1875263094086272:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 538us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391137.525874:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788391137.535444:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.535878:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086400 00000100:00100000:2.0:1788391137.535886:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086400 00000100:00100000:2.0:1788391137.535936:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788391137.535943:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+10:32298:x1875263094086400:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788391137.536383:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+10:32298:x1875263094086400:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 437us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391137.536393:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:1.0:1788391137.539567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.539657:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086528 00000100:00100000:2.0:1788391137.539667:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086528 00000100:00100000:2.0:1788391137.539711:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788391137.539721:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+10:32298:x1875263094086528:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788391137.539954:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+10:32298:x1875263094086528:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 232us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.539993:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788391137.558112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.558175:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086656 00000100:00100000:3.0:1788391137.558185:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086656 00000100:00100000:3.0:1788391137.558225:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788391137.558232:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875263094086656:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788391137.558257:0:42646:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp t0 exp 0000000000000000 cur 954 last 0 00000020:00000080:3.0:1788391137.558299:0:42646:0:(genops.c:1385:class_connect()) connect: client a67cef5d-639a-4d25-af65-3d93a762bd9f, cookie 0x9aafc5f04cd36523 00000004:00100000:3.0:1788391137.558323:0:42646:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788391137.558327:0:42646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00080000:2.0:1788391137.592417:0:42646:0:(import.c:65:import_set_state_nolock()) ffff95d69fc6f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391137.592510:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2355:x1875263094086656:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 34276us (34405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.592521:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391137.598836:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391137.598881:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391137.598992:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086912 00000100:00100000:3.0:1788391137.599010:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094086784 00000100:00100000:1.0:1788391137.599012:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086912 00000100:00100000:3.0:1788391137.599021:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094086784 00000100:00100000:1.0:1788391137.599089:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391137.599100:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32276:x1875263094086912:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788391137.599142:0:43348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788391137.599226:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32276:x1875263094086912:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391137.599239:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391137.599259:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788391137.599267:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:0:x1875263094086784:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788391137.599278:0:43348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788391137.599300:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:0:x1875263094086784:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391137.599306:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00080000:2.0:1788391137.599347:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391137.607391:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391137.607867:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087040 00000100:00100000:3.0:1788391137.607875:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087040 00000100:00100000:3.0:1788391137.607922:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788391137.607929:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32276:x1875263094087040:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788391137.608047:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32276:x1875263094087040:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 117us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391137.608055:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391137.614488:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391137.614530:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391137.614602:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.614669:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087424 00000100:00100000:0.0:1788391137.614679:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087424 00000100:00100000:0.0:1788391137.614729:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788391137.614740:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32276:x1875263094087424:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788391137.616193:0:42647:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1392us 00000100:00100000:3.0:1788391137.620154:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087168 00000100:00100000:3.0:1788391137.620168:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087168 00000100:00100000:2.0:1788391137.620507:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087296 00000100:00100000:2.0:1788391137.620518:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087296 00000100:00100000:2.0:1788391137.620562:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391137.620571:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875263094087296:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788391137.620601:0:43328:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp t0 exp 0000000000000000 cur 954 last 0 00000020:00000080:2.0:1788391137.620633:0:43328:0:(genops.c:1385:class_connect()) connect: client a67cef5d-639a-4d25-af65-3d93a762bd9f, cookie 0x9aafc5f04cd3652a 00002000:00100000:2.0:1788391137.620645:0:43328:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a67cef5d-639a-4d25-af65-3d93a762bd9f/ffff95d68f07e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788391137.620667:0:43328:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788391137.621020:0:43328:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788391137.621050:0:43328:0:(import.c:65:import_set_state_nolock()) ffff95d68f07f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391137.621120:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2355:x1875263094087296:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 548us (6516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.621127:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391137.621198:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391137.621204:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875263094087168:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788391137.621219:0:43326:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp t0 exp 0000000000000000 cur 954 last 0 00000020:00000080:2.0:1788391137.621243:0:43326:0:(genops.c:1385:class_connect()) connect: client a67cef5d-639a-4d25-af65-3d93a762bd9f, cookie 0x9aafc5f04cd36531 00002000:00100000:2.0:1788391137.621250:0:43326:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a67cef5d-639a-4d25-af65-3d93a762bd9f/ffff95d68f07b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788391137.621264:0:43326:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788391137.621467:0:43326:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788391137.621483:0:43326:0:(import.c:65:import_set_state_nolock()) ffff95d68f07c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788391137.621520:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2355:x1875263094087168:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 314us (6988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391137.621526:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000004:00200000:1.0:1788391137.630833:0:42647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788391137.631043:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32276:x1875263094087424:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 16298us (16558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391137.631063:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391137.765594:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391137.765728:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087552 00000100:00100000:0.0:1788391137.765741:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087552 00000100:00100000:0.0:1788391137.765814:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391137.765827:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32319:x1875263094087552:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1788391137.765856:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391137.765894:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd36538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffbf6 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766091:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766108:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766141:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391137.766185:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391137.766190:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391137.766233:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766264:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ae00/0x9aafc5f04cd36538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbf6 expref: 8 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766289:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbf6 expref: 7 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391137.766300:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391137.766303:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391137.766307:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79aa00, rc 0) 00000100:00100000:0.0:1788391137.766429:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32319:x1875263094087552:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 604us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391137.766437:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:2.0:1788391138.253245:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391138.253308:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788391138.253333:0:32887:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788391138.253336:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103446272:0@lo:400:kworker.0 00000100:00080000:3.0:1788391138.253339:0:32887:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788391138.253344:0:32887:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788391138.253353:0:32887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95d6bc73f000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1788391138.253380:0:32887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95d5866a1880 x1875263103446528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788391138.253448:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391138.253515:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103446784:0@lo:400:kworker.0 00000100:00100000:3.0:1788391138.253527:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446272 00000100:00100000:3.0:1788391138.253537:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446272 00000100:00100000:2.0:1788391138.253545:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391138.253566:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391138.253571:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103446912:0@lo:400:kworker.0 00000100:00100000:2.0:1788391138.253592:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391138.253593:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788391138.253603:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103446272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391138.253633:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446784 00000100:00100000:2.0:1788391138.253637:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446784 00000100:00100000:2.0:1788391138.253677:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446912 00000100:00100000:2.0:1788391138.253680:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446912 00000100:00100000:3.0:1788391138.253682:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103446272:12345-0@lo:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391138.253689:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788391138.253700:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391138.253706:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103446784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391138.253733:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391138.253740:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103446784:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391138.253746:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391138.253758:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788391138.253764:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103446912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391138.253766:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103446784:0@lo:400:kworker.0 00000100:00100000:3.0:1788391138.253787:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103446272:0@lo:400:kworker.0 00000100:00100000:2.0:1788391138.253788:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103446912:12345-0@lo:400:kworker.0 Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391138.253793:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788391138.253820:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103446912:0@lo:400:kworker.0 00000100:00100000:0.0:1788391138.254101:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103446400:0@lo:400:kworker.0 00000100:00100000:0.0:1788391138.254138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391138.254161:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391138.254166:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103446656:0@lo:400:kworker.0 00000100:00100000:3.0:1788391138.254181:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446400 00000100:00100000:3.0:1788391138.254186:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446400 00000100:00100000:0.0:1788391138.254189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391138.254215:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103446528:0@lo:8:kworker.0 00000100:00100000:3.0:1788391138.254218:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391138.254225:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391138.254239:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391138.254259:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103446400:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391138.254265:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391138.254274:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446528 00000100:00100000:0.0:1788391138.254276:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103446656 00000100:00100000:3.0:1788391138.254277:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446528 00000100:00100000:0.0:1788391138.254279:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103446656 00000100:00100000:3.0:1788391138.254295:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788391138.254299:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1875263103446528:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788391138.254300:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788391138.254305:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103446656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391138.254334:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103446656:12345-0@lo:400:kworker.0 Request processed in 28us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391138.254340:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788391138.254379:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103446656:0@lo:400:kworker.0 00000100:00100000:0.0:1788391138.254390:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103446400:0@lo:400:kworker.0 00000100:00080000:0.0:1788391138.254426:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788391138.254475:0:43698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 955 last 0 00000020:00000080:3.0:1788391138.254510:0:43698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9aafc5f04cd36546 00002000:00100000:3.0:1788391138.254527:0:43698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95d68a92a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788391138.254533:0:43698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788391138.254536:0:43698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788391138.254866:0:43698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788391138.254904:0:43698:0:(import.c:65:import_set_state_nolock()) ffff95d68a929800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788391138.254955:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875263103446528:12345-0@lo:8:kworker.0 Request processed in 654us (715us total) trans 0 rc 0/0 00010000:00080000:1.0:1788391138.255041:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d5866a1880 x1875263103446528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788391158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788391138.255056:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 7 00000100:00100000:3.0:1788391138.255064:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788391138.255066:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788391138.255071:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788391138.255074:0:3285:0:(import.c:65:import_set_state_nolock()) ffff95d6bc73f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788391138.255270:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788391138.255277:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1875263103446528:0@lo:8:kworker.0 00000004:00080000:1.0:1788391138.255306:0:42668:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788391138.255331:0:42669:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0xa4:0x0] 00000100:00100000:3.0:1788391138.255350:0:42669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:42669:1875263103447168:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788391138.255397:0:42669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391138.255414:0:42669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788391138.255430:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447168 00000100:00100000:3.0:1788391138.255434:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447168 00000100:00100000:3.0:1788391138.255468:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788391138.255475:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:42669:x1875263103447168:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788391138.255753:0:42668:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 955362791702ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788391138.255772:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391138.255781:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103447040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391138.255814:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391138.255843:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447040 00000100:00100000:1.0:1788391138.255846:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447040 00000100:00100000:1.0:1788391138.255884:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788391138.255891:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103447040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391138.255908:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788391138.255945:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103447040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391138.255952:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788391138.256013:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95d5866a1f80 x1875263103447040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788391154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788391138.256053:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103447040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788391138.257626:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788391138.261268:0:43327:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788391138.261282:0:43327:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -29 00002000:02000040:2.0:1788391138.261289:0:43327:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:165 to 0x280000400:193) 00002000:00010000:2.0:1788391138.278568:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.278585:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.278614:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.278620:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.278629:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.278648:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.278656:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.278662:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.278685:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391138.278715:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391138.278723:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391138.278732:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391138.278738:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391138.278748:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391138.278772:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391138.278779:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd3654d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391138.278811:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391138.278813:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391138.278815:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.280884:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.280904:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.280920:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.280924:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.280929:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.280941:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.280958:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.280981:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.281007:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.281711:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.281721:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.281732:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.281738:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.281749:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.281777:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.281786:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.281807:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.281810:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.281812:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.282045:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.282052:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.282061:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.282064:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.282069:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.282079:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.282087:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.282095:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.282128:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.282723:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.282738:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.282748:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.282753:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.282763:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.282779:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.282787:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd3655b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.282896:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.282899:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.282901:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.283144:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.283152:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283231:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.283235:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.283242:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283254:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283263:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283271:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283290:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.283301:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.283306:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283315:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.283326:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283335:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283348:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283356:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36562 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.283370:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.283372:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.283374:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.284240:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.284250:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284261:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.284264:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.284268:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284280:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284288:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284302:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284320:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788391138.284871:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.284878:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.284887:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.284890:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.284990:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285013:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285022:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285029:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285044:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788391138.285056:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788391138.285061:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285075:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.285080:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285089:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285105:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285112:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc7562b/0x9aafc5f04cd36569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285131:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.285134:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285140:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.285144:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285152:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.285188:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.285744:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285762:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36570 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.285779:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.285780:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.285782:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.286598:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.286608:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286620:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.286624:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.286731:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286747:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286757:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286764:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286783:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.286794:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.286805:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286813:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.286817:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286826:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286838:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286844:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd36577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.286860:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.286862:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.286865:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.288136:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.288150:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288228:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.288231:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.288235:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288257:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288264:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288269:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288311:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.288366:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.288374:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.288383:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.288388:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.288407:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.288423:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.288431:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9349ff/0x9aafc5f04cd3657e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.288883:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.288886:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.288888:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.288933:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.288939:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.288949:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.288952:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.288957:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289140:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289146:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289230:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289246:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.289256:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.289262:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289270:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.289275:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289284:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289298:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289306:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36585 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289323:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.289325:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.289327:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.289861:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.289874:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289883:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.289886:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.289892:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289902:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289911:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.289919:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.290032:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.290039:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.290048:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.290051:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.290060:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.290071:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.290092:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.290093:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.290095:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.290115:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788391138.290120:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000909858f6/0x9aafc5f04cd3658c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391138.292372:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.292388:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.292407:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.292411:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.292431:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.292448:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.292459:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.292467:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.292490:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.292512:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.292520:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.292528:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.292533:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.292542:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.292561:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.292579:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a68acc/0x9aafc5f04cd36593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.292602:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.292604:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.292606:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788391138.293275:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1788391138.293298:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a67cef5d-639a-4d25-af65-3d93a762bd9f 00000001:00100000:0.0:1788391138.293431:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a67cef5d-639a-4d25-af65-3d93a762bd9f 00002000:00010000:2.0:1788391138.293890:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.293898:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.293911:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.293915:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.293920:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.293932:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.293941:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.293978:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.294007:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.294033:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.294041:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.294059:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.294064:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.294073:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.294090:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.294099:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3659a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.294118:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.294120:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.294122:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.294621:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.295750:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.295769:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.295773:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.295778:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.295792:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.295801:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.295808:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.295881:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788391138.296553:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.296561:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.296581:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.296584:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.296589:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.296600:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.296609:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.296617:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297283:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788391138.297295:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297305:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.297311:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297331:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297362:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297367:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd365a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297389:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.297392:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297395:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.297397:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297402:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297408:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297412:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.297413:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.297414:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.297493:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788391138.297500:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd365a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.297558:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.298413:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.298421:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.298434:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.298438:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.298444:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.298469:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.298477:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.298484:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.298530:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.298581:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.298589:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.298603:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.298607:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.298616:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.298629:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.298637:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ab2333/0x9aafc5f04cd365af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.298665:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.298667:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.298670:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.299071:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.299076:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299082:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.299084:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.299087:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299093:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299098:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299110:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299123:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.299144:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.299150:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299158:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.299161:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299169:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299186:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299193:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd365b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299208:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.299210:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.299212:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.299567:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.299571:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299577:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.299579:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.299582:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299588:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299593:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299597:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.299609:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.299629:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.299634:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299642:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.299645:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299665:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299677:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299684:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006739c86f/0x9aafc5f04cd365bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.299710:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.299712:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.299713:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788391138.300068:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391138.300072:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.300082:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=955s v=(0 0) 00010000:00010000:2.0:1788391138.300084:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391138.300087:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.300093:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.300098:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.300103:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.301034:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391138.301039:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391138.301047:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.301057:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391138.301061:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.301070:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.301088:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.301095:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340d67d4/0x9aafc5f04cd365c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.301116:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.301118:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391138.301120:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.302841:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.302856:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.302890:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.302895:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.302902:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.302918:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.302929:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.302937:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303044:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788391138.303044:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.303052:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303060:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.303066:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303075:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303102:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303110:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd8844a/0x9aafc5f04cd365cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303131:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.303133:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.303135:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.303574:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.303581:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303591:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.303594:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.303598:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303607:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303625:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303633:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.303666:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.303776:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.303782:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303791:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.303794:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303803:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303814:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303822:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c885ac/0x9aafc5f04cd365d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.303853:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.303855:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.303857:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.304113:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.304119:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304126:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.304129:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.304133:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304141:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304149:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304156:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304187:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.304235:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.304241:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304250:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.304254:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304262:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304273:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304280:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d36116/0x9aafc5f04cd365d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304293:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.304295:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.304297:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.304571:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.304577:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304586:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.304589:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.304593:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304601:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304609:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304617:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.304637:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.304684:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.304690:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304707:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.304711:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304720:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304731:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304739:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d652c3/0x9aafc5f04cd365e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.304754:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.304755:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.304757:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.305027:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.305033:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305041:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.305049:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.305054:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305063:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305071:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305079:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305097:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.305233:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.305239:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305247:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.305250:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305259:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305278:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305285:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ade054/0x9aafc5f04cd365e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305298:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.305300:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.305301:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.305469:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.305474:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305482:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.305484:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.305488:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305498:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305506:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305518:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305537:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.305741:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.305746:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305753:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.305756:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305764:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305775:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305783:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cec6ccc/0x9aafc5f04cd365ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.305808:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.305810:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.305811:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.305894:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.305899:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305906:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.305909:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.305913:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305920:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305927:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305934:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.305953:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.306006:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.306011:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.306018:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.306022:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.306029:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.306040:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.306047:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fcc4fd/0x9aafc5f04cd365f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.306061:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.306062:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.306064:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.307387:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.307401:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.307430:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.307434:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.307439:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.307452:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.307461:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.307468:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.307494:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.307522:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.307530:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.307549:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.307554:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.307563:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.307580:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.307587:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007555a16b/0x9aafc5f04cd365fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.307607:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.307608:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.307610:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.308500:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.308507:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.308515:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.308518:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.308521:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.308528:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.308542:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.308549:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.308571:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.308601:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.308608:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.308616:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.308620:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.308630:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.308648:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.308667:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.308746:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.308749:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.308751:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.309206:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.309212:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.309221:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.309223:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.309228:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.309238:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.309247:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.309254:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.309402:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.309625:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.309631:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.309639:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.309643:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.309660:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.309774:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.309783:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3660a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.309813:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.309814:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.309816:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788391138.310292:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391138.310300:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.310311:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=955s v=(0 0) 00010000:00010000:3.0:1788391138.310314:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391138.310318:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.310329:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.310338:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.310345:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391138.310369:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391138.310393:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391138.310399:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.310408:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391138.310412:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.310420:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.310431:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.310438:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd36611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391138.310452:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.310454:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391138.310455:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788391138.310552:0:43327:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:164 00000100:00100000:3.0:1788391138.310685:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:42669:x1875263103447168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 55204us (55282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391138.310696:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391138.310780:0:42669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:42669:1875263103447168:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788391138.310801:0:42669:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xc1:0x0] from OST, last_created [0x280000400:0xc1:0x0]last_used is [0x280000400:0xa4:0x0] 00000100:00100000:2.0:1788391138.310865:0:42669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:42669:1875263103447296:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788391138.310908:0:42669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391138.310939:0:42669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6b9b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788391138.310950:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447296 00000100:00100000:3.0:1788391138.311011:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447296 00000100:00100000:3.0:1788391138.311062:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391138.311073:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:42669:x1875263103447296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788391138.311124:0:43328:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 194 00000100:00100000:2.0:1788391138.315161:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:42669:x1875263103447296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4079us (4241us total) trans 30064771073 rc 0/0 00000100:00100000:2.0:1788391138.315175:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391138.315191:0:42669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:42669:1875263103447296:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788391138.315211:0:42669:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xc1:0x0]-[0x280000400:0xe1:0x0] 00010000:00010000:2.0:1788391139.277211:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391139.277295:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103447424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391139.277393:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391139.277737:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447424 00000100:00100000:1.0:1788391139.277749:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447424 00000100:00100000:1.0:1788391139.277848:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788391139.277860:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103447424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391139.277910:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391139.278010:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103447424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.278018:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788391139.278109:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103447424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391139.371613:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391139.371734:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087680 00000100:00100000:2.0:1788391139.371744:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087680 00000100:00100000:2.0:1788391139.371829:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391139.371842:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32371:x1875263094087680:12345-192.168.202.1@tcp:13:lfs.0 00000100:00080000:1.0:1788391139.371853:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788391139.371865:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391139.371931:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32371:x1875263094087680:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391139.371937:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788391139.378169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391139.378291:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087808 00000100:00100000:2.0:1788391139.378300:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087808 00000100:00100000:2.0:1788391139.378426:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391139.378435:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:32371:x1875263094087808:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:2.0:1788391139.378457:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788391139.378546:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:32371:x1875263094087808:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391139.378551:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00080000:1.0:1788391139.378806:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391139.493427:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.494568:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094087936 00000100:00100000:0.0:1788391139.494585:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094087936 00000100:00100000:0.0:1788391139.494693:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391139.494707:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+10:32404:x1875263094087936:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788391139.494732:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391139.494756:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd36618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffbfd expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.494806:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd36618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbfd expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.494820:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79b000/0x9aafc5f04cd36618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbfd expref: 11 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.494832:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b000, rc 0) 00000100:00100000:0.0:1788391139.494934:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094087936:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 229us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.494942:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391139.499502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391139.501665:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088064 00000100:00100000:3.0:1788391139.501687:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088064 00000100:00100000:3.0:1788391139.502244:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1788391139.502260:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094088064:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788391139.502691:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094088064:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 435us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391139.502700:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788391139.506026:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.506164:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088192 00000100:00100000:0.0:1788391139.506188:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088192 00000100:00100000:0.0:1788391139.506245:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788391139.506254:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094088192:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788391139.506552:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094088192:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 298us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.506561:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788391139.509366:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391139.509558:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088320 00000100:00100000:3.0:1788391139.509569:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088320 00000100:00100000:3.0:1788391139.509630:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788391139.509638:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:32410:x1875263094088320:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788391139.510133:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:32410:x1875263094088320:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 492us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391139.510143:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788391139.528132:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.529200:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088448 00000100:00100000:1.0:1788391139.529218:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088448 00000100:00100000:1.0:1788391139.529310:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391139.529324:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+11:32410:x1875263094088448:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788391139.529715:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+11:32410:x1875263094088448:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 392us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.529724:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788391139.541253:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.542183:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088576 00000100:00100000:0.0:1788391139.542198:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088576 00000100:00100000:0.0:1788391139.542338:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788391139.542350:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+11:32404:x1875263094088576:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788391139.542373:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391139.542393:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79ae00/0x9aafc5f04cd3661f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc27 expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.542424:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79ae00/0x9aafc5f04cd3661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc27 expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.542433:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79ae00/0x9aafc5f04cd3661f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc27 expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.542440:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ae00, rc 0) 00000100:00100000:0.0:1788391139.542503:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+12:32404:x1875263094088576:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 156us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.542509:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391139.545514:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.546673:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088704 00000100:00100000:1.0:1788391139.546689:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088704 00000100:00100000:1.0:1788391139.546755:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788391139.546768:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+12:32404:x1875263094088704:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788391139.546823:0:42638:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788391139.546844:0:42638:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788391139.546848:0:42638:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788391139.546852:0:42638:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788391139.546854:0:42638:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:1.0:1788391139.548555:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+12:32404:x1875263094088704:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1778us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.548571:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1788391139.551468:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.551537:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088832 00000100:00100000:0.0:1788391139.551548:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088832 00000100:00100000:0.0:1788391139.551611:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1788391139.551644:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+12:32404:x1875263094088832:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788391139.551668:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391139.551690:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc2e expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.551736:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.551750:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.551766:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79ba00, rc 0) 00000100:00100000:0.0:1788391139.551828:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32404:x1875263094088832:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 189us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.551833:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788391139.557308:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.558491:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094088960 00000100:00100000:1.0:1788391139.558507:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094088960 00000100:00100000:1.0:1788391139.558587:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:1.0:1788391139.558601:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32404:x1875263094088960:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788391139.559192:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32404:x1875263094088960:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 589us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.559209:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1788391139.561199:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.561393:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089088 00000100:00100000:0.0:1788391139.561406:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089088 00000100:00100000:0.0:1788391139.561545:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788391139.561558:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32404:x1875263094089088:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788391139.562005:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32404:x1875263094089088:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 447us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.562243:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788391139.571823:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.572128:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089216 00000100:00100000:1.0:1788391139.572144:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089216 00000100:00100000:1.0:1788391139.572215:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788391139.572241:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32415:x1875263094089216:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788391139.573193:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32415:x1875263094089216:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 959us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.573206:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1788391139.585103:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.585341:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089344 00000100:00100000:0.0:1788391139.585364:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089344 00000100:00100000:0.0:1788391139.585433:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:0.0:1788391139.585444:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32415:x1875263094089344:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788391139.585747:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32415:x1875263094089344:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 303us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.585762:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788391139.594564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.595133:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089472 00000100:00100000:0.0:1788391139.595148:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089472 00000100:00100000:0.0:1788391139.595220:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788391139.595231:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875263094089472:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788391139.595272:0:42644:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp t0 exp 0000000000000000 cur 956 last 0 00000020:00000080:0.0:1788391139.595326:0:42644:0:(genops.c:1385:class_connect()) connect: client 52ce7de6-d362-4c91-9bea-438b5645df6d, cookie 0x9aafc5f04cd3662d 00000004:00100000:0.0:1788391139.595716:0:42644:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788391139.596258:0:42644:0:(import.c:65:import_set_state_nolock()) ffff95d6a6e16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391139.596423:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2355:x1875263094089472:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 1191us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.596435:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788391139.603841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391139.603884:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.604004:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089856 00000100:00100000:1.0:1788391139.604027:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089856 00000100:00100000:1.0:1788391139.604107:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788391139.604121:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094089856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391139.604238:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094089856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.604247:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788391139.604402:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089600 00000100:00100000:0.0:1788391139.604408:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089600 00000100:00100000:0.0:1788391139.605232:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391139.605244:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094089600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391139.605312:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094089600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.605320:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00080000:1.0:1788391139.611166:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391139.611498:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391139.611555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391139.611568:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090112 00000100:00100000:2.0:1788391139.611582:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090112 00000100:00100000:3.0:1788391139.611597:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.611724:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089728 00000100:00100000:0.0:1788391139.611730:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089728 00000100:00100000:0.0:1788391139.611770:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788391139.611783:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094089728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391139.611871:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094089728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.611890:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00080000:1.0:1788391139.612066:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391139.612277:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094089984 00000100:00100000:2.0:1788391139.612282:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094089984 00000100:00100000:1.0:1788391139.612338:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391139.612348:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32404:x1875263094090112:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788391139.612394:0:42644:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788391139.612434:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32404:x1875263094090112:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 89us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.612441:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391139.612457:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788391139.612464:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094089984:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788391139.612476:0:42644:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788391139.612494:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094089984:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 31us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.612501:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788391139.615882:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.616080:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090240 00000100:00100000:1.0:1788391139.616093:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090240 00000100:00100000:1.0:1788391139.616194:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391139.616206:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32404:x1875263094090240:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788391139.616323:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32404:x1875263094090240:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 118us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391139.616332:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391139.618138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.618215:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391139.618267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391139.618354:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090624 00000100:00100000:2.0:1788391139.618430:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090624 00000100:00100000:3.0:1788391139.618459:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090368 00000100:00100000:3.0:1788391139.618464:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090368 00000100:00100000:2.0:1788391139.618486:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788391139.618497:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32404:x1875263094090624:12345-192.168.202.1@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788391139.618529:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090496 00000100:00100000:0.0:1788391139.618535:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090496 00000004:00200000:2.0:1788391139.618594:0:42648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788391139.618599:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788391139.618605:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875263094090368:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788391139.618632:0:43698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp t0 exp 0000000000000000 cur 956 last 0 00000020:00000080:0.0:1788391139.618673:0:43698:0:(genops.c:1385:class_connect()) connect: client 52ce7de6-d362-4c91-9bea-438b5645df6d, cookie 0x9aafc5f04cd36634 00002000:00100000:0.0:1788391139.618687:0:43698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 52ce7de6-d362-4c91-9bea-438b5645df6d/ffff95d6a6e17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788391139.618693:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32404:x1875263094090624:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 198us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391139.618700:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:0.0:1788391139.618701:0:43698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788391139.618841:0:43698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788391139.618878:0:43698:0:(import.c:65:import_set_state_nolock()) ffff95d6a6e14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391139.618912:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2355:x1875263094090368:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 306us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.618919:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1788391139.618940:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788391139.618946:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875263094090496:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788391139.618982:0:43698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp t0 exp 0000000000000000 cur 956 last 0 00000020:00000080:0.0:1788391139.619012:0:43698:0:(genops.c:1385:class_connect()) connect: client 52ce7de6-d362-4c91-9bea-438b5645df6d, cookie 0x9aafc5f04cd3663b 00002000:00100000:0.0:1788391139.619017:0:43698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 52ce7de6-d362-4c91-9bea-438b5645df6d/ffff95d6a6e12000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788391139.619025:0:43698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788391139.619075:0:43698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788391139.619091:0:43698:0:(import.c:65:import_set_state_nolock()) ffff95d6a6e15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788391139.619125:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2355:x1875263094090496:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 177us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.619145:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788391139.714432:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391139.714814:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090752 00000100:00100000:0.0:1788391139.714830:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090752 00000100:00100000:0.0:1788391139.714912:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391139.714926:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32436:x1875263094090752:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1788391139.714957:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391139.715033:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc58 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715123:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715139:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715153:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391139.715202:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391139.715206:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391139.715230:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715263:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 8 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715287:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 7 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391139.715323:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391139.715326:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391139.715330:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a200, rc 0) 00000100:00100000:0.0:1788391139.715416:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32436:x1875263094090752:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 492us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391139.715424:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:2.0:1788391140.301453:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391141.328665:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788391141.355442:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52ce7de6-d362-4c91-9bea-438b5645df6d 00000001:00100000:1.0:1788391141.355464:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a67cef5d-639a-4d25-af65-3d93a762bd9f 00000001:02000400:1.0:1788391141.398763:0:44600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:0.0:1788391141.517477:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788391141.517490:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391141.518460:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:0.0:1788391141.518472:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1788391142.351434:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391143.373169:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788391143.373199:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103447808:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.373291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391143.373347:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.373375:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.373390:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103448192:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.373395:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103447552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391143.373419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.373428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391143.373439:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103448320:0@lo:400:kworker.0 00000100:00100000:1.0:1788391143.373459:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103447936:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.373460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.373480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391143.373640:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391143.373778:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391143.373788:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103448064:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.373811:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447808 00000100:00100000:1.0:1788391143.373813:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391143.373820:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447808 00000100:00100000:3.0:1788391143.373905:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447936 00000100:00100000:3.0:1788391143.373909:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447936 00000100:00100000:3.0:1788391143.373939:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391143.373949:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103447808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391143.374000:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448192 00000100:00100000:2.0:1788391143.374004:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448192 00000100:00100000:2.0:1788391143.374037:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448320 00000100:00100000:2.0:1788391143.374040:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448320 00000100:00100000:2.0:1788391143.374055:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448064 00000100:00100000:2.0:1788391143.374057:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448064 00000100:00100000:2.0:1788391143.374069:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391143.374076:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103448192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391143.374144:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103448192:12345-0@lo:400:kworker.0 Request processed in 67us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391143.374151:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391143.374170:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391143.374175:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103448320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391143.374207:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103448320:12345-0@lo:400:kworker.0 Request processed in 33us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391143.374219:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391143.374230:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788391143.374235:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103448064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391143.374265:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103448064:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391143.374271:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391143.374382:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103447808:12345-0@lo:400:kworker.0 Request processed in 435us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391143.374389:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788391143.374404:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788391143.374410:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103447936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.374437:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103447936:12345-0@lo:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391143.374443:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788391143.374460:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447552 00000100:00100000:3.0:1788391143.374464:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447552 00000100:00100000:3.0:1788391143.374525:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788391143.374532:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103447552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391143.374564:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391143.374611:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103447552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391143.374617:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391143.375440:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103447680 00000100:00100000:1.0:1788391143.375757:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103447680 00000100:00100000:1.0:1788391143.375804:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788391143.375814:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103447680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391143.375883:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103447680:12345-0@lo:400:kworker.0 Request processed in 70us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.375890:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788391143.375995:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391143.376003:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391143.376006:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391143.377858:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103448320:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.377883:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103447808:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.377893:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788391143.377922:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103447552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391143.383280:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103448192:0@lo:400:kworker.0 00000100:00100000:1.0:1788391143.383343:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103448064:0@lo:400:kworker.0 00000100:00100000:1.0:1788391143.383373:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103447936:0@lo:400:kworker.0 00000001:00100000:2.0:1788391143.416570:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 52ce7de6-d362-4c91-9bea-438b5645df6d 00000001:00100000:1.0:1788391143.434646:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52ce7de6-d362-4c91-9bea-438b5645df6d 00000001:00080000:1.0:1788391143.434663:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771073 is committed 00000001:00100000:1.0:1788391143.434711:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788391143.603489:0:44752:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5782aea0 20000000:00000080:1.0:1788391143.603516:0:44752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95d5877ba000 uarg=0000000000000000 20000000:01000000:1.0:1788391143.603576:0:44752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788391143.603583:0:44752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788391143.603589:0:44752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788391143.604784:0:44753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788391143.604999:0:44752:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788391143.605008:0:44752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788391143.605035:0:44752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605058:0:44752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 18 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605066:0:44752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 18 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605073:0:44752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605084:0:44752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605092:0:44752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605099:0:44752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605157:0:44752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 12 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605175:0:44752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 12 pid: 42637 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.605194:0:44752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448448:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391143.605396:0:44752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605406:0:44752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 12 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.605416:0:44752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448576:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391143.605445:0:44752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605454:0:44752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.605463:0:44752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448704:0@lo:104: 00000100:00100000:2.0:1788391143.605506:0:44752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391143.605544:0:44752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 18 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605552:0:44752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 18 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.605572:0:44752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448832:0@lo:104: 00000100:00100000:2.0:1788391143.605592:0:44752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391143.605611:0:44752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 18 pid: 42638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.605619:0:44752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 18 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.605627:0:44752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448960:0@lo:104: 00000100:00100000:2.0:1788391143.605649:0:44752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391143.605660:0:44752:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298900 going to sleep for 11 seconds 00000100:00100000:1.0:1788391143.605941:0:42628:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788391143.605985:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448704 00000100:00100000:1.0:1788391143.605999:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448704 00000100:00100000:1.0:1788391143.606039:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448832 00000100:00100000:1.0:1788391143.606041:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448832 00000100:00100000:1.0:1788391143.606049:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103448960 00000100:00100000:1.0:1788391143.606051:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103448960 00000100:00100000:1.0:1788391143.606063:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391143.606073:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:44752:x1875263103448704:12345-0@lo:104: 00010000:00010000:1.0:1788391143.606087:0:42628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606143:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788391143.606149:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+5:44752:x1875263103448704:12345-0@lo:104: Request processed in 78us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.606156:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391143.606173:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391143.606178:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+4:44752:x1875263103448832:12345-0@lo:104: 00010000:00010000:1.0:1788391143.606193:0:42628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606239:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788391143.606244:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+4:44752:x1875263103448832:12345-0@lo:104: Request processed in 66us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.606250:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391143.606264:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391143.606270:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:44752:x1875263103448960:12345-0@lo:104: 00010000:00010000:1.0:1788391143.606278:0:42628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606304:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788391143.606310:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbfdb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+3:44752:x1875263103448960:12345-0@lo:104: Request processed in 40us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.606315:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788391143.606354:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788391143.606361:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606369:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391143.606374:0:42632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606382:0:42632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391143.606391:0:42632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391143.606403:0:42632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788391143.606436:0:42632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606444:0:42632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391143.606465:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606472:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6bc79bc00/0x9aafc5f04cd364ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd364c1 expref: -99 pid: 44040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606487:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788391143.606490:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606497:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391143.606499:0:42632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606506:0:42632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391143.606513:0:42632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391143.606518:0:42632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788391143.606530:0:42632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606536:0:42632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391143.606548:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606556:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d6b4df7000/0x9aafc5f04cd36371 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36378 expref: -99 pid: 43324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606565:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391143.606568:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606574:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc1d52c20) 10000000:00010000:1.0:1788391143.606577:0:42632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606584:0:42632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788391143.606591:0:42632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788391143.606595:0:42632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788391143.606605:0:42632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606610:0:42632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788391143.606627:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606634:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff95d68fcc0800/0x9aafc5f04cd3631d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9aafc5f04cd36324 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.606658:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391143.606660:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391143.606662:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391143.606668:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391143.606690:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103449088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391143.606720:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.606756:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391143.606762:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103449216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391143.606783:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.606811:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103449344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391143.606838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391143.606866:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449088 00000100:00100000:1.0:1788391143.606870:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449088 00010000:00010000:1.0:1788391143.606891:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 19 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391143.606905:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449216 00000100:00100000:1.0:1788391143.606907:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449216 00010000:00010000:1.0:1788391143.606915:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 20 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391143.606924:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449344 00000100:00100000:1.0:1788391143.606926:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449344 00010000:00010000:1.0:1788391143.606934:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 21 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391143.606945:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391143.606991:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+21:3288:x1875263103449088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391143.607007:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391143.607013:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 21 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607024:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 21 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607042:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391143.607070:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+21:3288:x1875263103449088:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.607078:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788391143.607092:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391143.607098:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+20:3288:x1875263103449216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391143.607105:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391143.607109:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 20 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607117:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 20 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607127:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391143.607148:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+20:3288:x1875263103449216:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.607155:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788391143.607167:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391143.607173:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103449344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788391143.607180:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391143.607184:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 19 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607197:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 19 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391143.607206:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391143.607231:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103449344:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391143.607238:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788391143.607304:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103449344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391143.607328:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103449216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788391143.607335:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103449088:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788391143.607693:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d68fcc0e00/0x9aafc5f04cd364c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd364ba expref: 18 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.607706:0:44752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448704:0@lo:104: 00010000:00010000:2.0:1788391143.607717:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d68fcc1c00/0x9aafc5f04cd36378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd36371 expref: 17 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.607725:0:44752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448832:0@lo:104: 00010000:00010000:2.0:1788391143.607734:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d684cd0400/0x9aafc5f04cd36324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9aafc5f04cd3631d expref: 16 pid: 42638 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391143.607747:0:44752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448960:0@lo:104: 00000100:00100000:1.0:1788391143.611816:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391143.611882:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094090880 00000100:00100000:0.0:1788391143.611895:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094090880 00010000:00010000:0.0:1788391143.611946:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391143.612052:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788391143.612078:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094090880:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391143.612096:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391143.612104:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391143.612117:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391143.612141:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391143.612223:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094090880:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 139us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391143.612233:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788391143.612673:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391143.612781:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091008 00000100:00100000:0.0:1788391143.612787:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091008 00010000:00010000:0.0:1788391143.612809:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 13 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391143.612830:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391143.612837:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094091008:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391143.612847:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391143.612851:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 13 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612860:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 13 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612886:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612895:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612914:0:42631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612922:0:42631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612930:0:42631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391143.612936:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6bc79ba00/0x9aafc5f04cd36626 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc2e expref: 13 pid: 42637 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612939:0:42631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612958:0:42631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391143.612981:0:42631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.612990:0:42631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.613001:0:42631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391143.613013:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391143.613015:0:44752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448448:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391143.613072:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12917691-423e-4064-ad89-5d05a8181e9d+12:2357:x1875263094091008:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 233us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391143.613082:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00010000:00010000:3.0:1788391143.613122:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d68fcc1e00/0x9aafc5f04cd3651c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbcc expref: 11 pid: 42639 timeout: 1060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391143.613134:0:44752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:44752:1875263103448576:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391143.613213:0:44752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391143.613224:0:44752:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391143.613231:0:44752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391143.613248:0:44752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd36650 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 44752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.361841:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.362027:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091136 00000100:00100000:2.0:1788391144.362040:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091136 00000100:00100000:2.0:1788391144.362143:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391144.362157:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32891:x1875263094091136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391144.362188:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.362220:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc5f expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362307:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362325:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362341:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362359:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362367:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.362374:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788391144.363377:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391144.367574:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367600:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367625:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.367660:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391144.367664:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391144.367704:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367716:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367723:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367730:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367736:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.367740:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367748:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367761:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:2.0:1788391144.367764:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.367768:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367774:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3665e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367797:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367804:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367810:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367815:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.367818:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367825:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367833:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d6830d2b00) 00010000:00010000:2.0:1788391144.367835:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.367838:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.367843:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36665 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.368086:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc5f expref: 8 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.368102:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc5f expref: 7 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.368122:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391144.368125:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391144.368127:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788391144.368259:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32891:x1875263094091136:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 6056us (6394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.368269:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391144.379683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.379774:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091392 00000100:00100000:3.0:1788391144.379788:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091392 00000100:00100000:3.0:1788391144.379844:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788391144.379852:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32891:x1875263094091392:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391144.379876:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.379896:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36673 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc66 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380005:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380020:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380039:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380053:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380060:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380066:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380429:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd36688 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380437:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd36688 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380444:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd36688 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.380455:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788391144.380626:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380634:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380641:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380646:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.380651:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380658:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380671:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391144.380675:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.380679:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380696:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3667a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380708:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380714:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380720:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380724:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.380727:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380733:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380740:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d686a70500) 00010000:00010000:3.0:1788391144.380742:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.380745:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.380750:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd36681 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.381373:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd36673 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc66 expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.381402:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd36688 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc66 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.381409:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391144.381412:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.381414:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1a00, rc 0) 00000100:00100000:3.0:1788391144.381491:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32891:x1875263094091392:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1638us (1824us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1788391144.381499:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391144.390192:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.390363:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091520 00000100:00100000:3.0:1788391144.390380:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091520 00000100:00100000:3.0:1788391144.390463:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788391144.390476:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32891:x1875263094091520:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788391144.390631:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32891:x1875263094091520:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.390638:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00010000:00010000:1.0:1788391144.397178:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391144.397482:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103449472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391144.397595:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391144.397808:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449472 00000100:00100000:1.0:1788391144.397819:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449472 00000100:00100000:1.0:1788391144.397900:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788391144.397912:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103449472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391144.398002:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391144.398068:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103449472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391144.398076:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788391144.398174:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103449472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391144.414639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.414813:0:42653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091648 00000100:00100000:2.0:1788391144.414828:0:42653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091648 00000100:00100000:2.0:1788391144.414901:0:42653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391144.414914:0:42653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32900:x1875263094091648:12345-192.168.202.1@tcp:700:mkdir.0 00000100:00100000:2.0:1788391144.415078:0:42653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32900:x1875263094091648:12345-192.168.202.1@tcp:700:mkdir.0 Request processed in 166us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.415086:0:42653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391144.418330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.420379:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094091904 00000100:00100000:2.0:1788391144.420401:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094091904 00000100:00100000:2.0:1788391144.420487:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788391144.420498:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32900:x1875263094091904:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:2.0:1788391144.420578:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391144.420610:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3653f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffbf6 expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.420638:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:2.0:1788391144.420660:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391144.420947:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.421021:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.421031:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.421075:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.421091:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 5 pid: 43348 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.421107:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103449600:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391144.421481:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391144.424438:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103449600:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391144.424480:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.424577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.424657:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094092032 00000100:00100000:3.0:1788391144.424666:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094092032 00010000:00010000:3.0:1788391144.424802:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 6 pid: 43348 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.424848:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788391144.424859:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094092032:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391144.424878:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391144.424904:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 6 pid: 43348 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.424915:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 6 pid: 43348 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.424950:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a200/0x9aafc5f04cd36649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc58 expref: 6 pid: 43348 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.424991:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:3.0:1788391144.424996:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.425005:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.425011:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.425032:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391144.425083:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094092032:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 227us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.425089:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:1.0:1788391144.425462:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391144.426673:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.426689:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.426723:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.426752:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.426763:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.430417:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788391144.430445:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430458:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430465:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430471:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.430476:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430485:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430505:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:2.0:1788391144.430509:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.430515:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.430521:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36696 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391144.431101:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005953bcd9 reply state 00000000ef499c71 transno 30064771074 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.431114:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391144.431252:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:32900:x1875263094091904:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 10749us (12943us total) trans 30064771074 rc 0/0 00000100:00100000:2.0:1788391144.431264:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:2.0:1788391144.433505:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433527:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433536:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433543:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.433548:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433557:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433578:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d6830d2b00) 00010000:00010000:2.0:1788391144.433582:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.433588:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.433594:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3669d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.440886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.441195:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094092160 00000100:00100000:3.0:1788391144.441211:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094092160 00000100:00100000:3.0:1788391144.441334:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391144.441348:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32901:x1875263094092160:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391144.441382:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.441411:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc6d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441519:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441535:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441549:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.441608:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391144.441620:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391144.441672:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441698:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc6d expref: 11 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441727:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc6d expref: 10 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.441737:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:3.0:1788391144.441740:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391144.441744:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:3.0:1788391144.441877:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:32901:x1875263094092160:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 531us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.441886:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788391144.446280:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.446537:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094092288 00000100:00100000:3.0:1788391144.446550:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094092288 00000100:00100000:3.0:1788391144.446652:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391144.446665:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:32901:x1875263094092288:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391144.446692:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.446720:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd366b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc74 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446815:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446838:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446855:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446873:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446880:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.446887:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447221:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447231:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447239:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.447291:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391144.447296:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391144.447329:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447343:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447351:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447358:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447364:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.447369:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447378:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447393:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:3.0:1788391144.447396:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.447403:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447410:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447422:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447438:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447444:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447449:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.447453:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447460:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447468:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d686a70c00) 00010000:00010000:3.0:1788391144.447470:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.447473:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447479:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447513:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd366b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc74 expref: 12 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447528:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc74 expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.447536:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70a00) 00010000:00010000:3.0:1788391144.447539:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391144.447547:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:3.0:1788391144.447623:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:32901:x1875263094092288:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 961us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.447632:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1788391144.451957:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.452132:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094092544 00000100:00100000:2.0:1788391144.452146:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094092544 00000100:00100000:2.0:1788391144.452232:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391144.452246:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:32901:x1875263094092544:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391144.452284:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.452320:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd366ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc7b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.452456:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788391144.454755:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd366ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc7b expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.454784:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:0.0:1788391144.454787:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391144.454794:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd366ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc7b expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.454815:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:0.0:1788391144.455238:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32901:x1875263094092544:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2991us (3301us total) trans 30064771075 rc 301/301 00000100:00100000:0.0:1788391144.455249:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788391144.458130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.458210:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094092800 00000100:00100000:2.0:1788391144.458221:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094092800 00000100:00100000:2.0:1788391144.458283:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391144.458292:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32901:x1875263094092800:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1788391144.458360:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391144.458390:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd366c7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc74 expref: 12 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.458407:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70a00) 00010000:00010000:2.0:1788391144.458418:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391144.458445:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.458457:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.458464:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391144.458736:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039a8c33a reply state 0000000012a9adb8 transno 30064771076 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.458747:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788391144.458756:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788391144.459099:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32901:x1875263094092800:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 805us (978us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788391144.459106:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391144.461396:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.461704:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093056 00000100:00100000:2.0:1788391144.461718:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093056 00000100:00100000:2.0:1788391144.461792:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1788391144.461805:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32901:x1875263094093056:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391144.462213:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32901:x1875263094093056:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 409us (827us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788391144.462220:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00010000:00010000:0.0:1788391144.463148:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463165:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463174:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463181:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391144.463186:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463217:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463238:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2b00) 00010000:00010000:0.0:1788391144.463241:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788391144.463246:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.463252:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd366dc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.464670:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.464951:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093312 00000100:00100000:3.0:1788391144.465044:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093312 00000100:00100000:3.0:1788391144.465122:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788391144.465132:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32901:x1875263094093312:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391144.465159:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.465180:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd366e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc82 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465265:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465278:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465288:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465298:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465303:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465307:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.465423:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788391144.465533:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465539:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465544:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465547:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.465551:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465557:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465566:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:3.0:1788391144.465568:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.465570:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465576:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd366ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465590:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465596:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465602:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465618:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.465621:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465626:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465635:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d686a70c00) 00010000:00010000:3.0:1788391144.465637:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.465640:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465647:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd366f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465691:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd366e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc82 expref: 15 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465702:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:3.0:1788391144.465705:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391144.465708:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd366e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc82 expref: 15 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.465717:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391144.465803:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32901:x1875263094093312:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 672us (1145us total) trans 30064771078 rc 301/301 00000100:00100000:3.0:1788391144.465812:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1788391144.468512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.468623:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093440 00000100:00100000:2.0:1788391144.468636:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093440 00000100:00100000:2.0:1788391144.468731:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391144.468755:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32901:x1875263094093440:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391144.468796:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.468825:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd366ff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc89 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.468933:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.468955:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.469010:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.469041:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391144.469046:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391144.469069:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.469101:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd366ff lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc89 expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.469119:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc89 expref: 15 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.469128:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391144.469131:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391144.469134:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ee00, rc 0) 00000100:00100000:2.0:1788391144.469195:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32901:x1875263094093440:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 445us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.469202:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788391144.474367:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.474459:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093568 00000100:00100000:2.0:1788391144.474472:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093568 00000100:00100000:2.0:1788391144.474561:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1788391144.474570:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32901:x1875263094093568:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:2.0:1788391144.478879:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32901:x1875263094093568:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 4291us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.478896:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1788391144.482071:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.482157:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093824 00000100:00100000:1.0:1788391144.482171:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093824 00000100:00100000:1.0:1788391144.482258:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788391144.482268:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32901:x1875263094093824:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391144.482531:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32901:x1875263094093824:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 265us (474us total) trans 30064771079 rc 0/0 00000100:00100000:1.0:1788391144.482537:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788391144.497957:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391144.498142:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094093952 00000100:00100000:0.0:1788391144.498155:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094093952 00000100:00100000:0.0:1788391144.498222:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391144.498235:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32902:x1875263094093952:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391144.498320:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391144.498346:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3670d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc90 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498418:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498431:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498441:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498452:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498472:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.498476:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499062:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499072:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499078:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391144.499113:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391144.499116:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391144.499157:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499169:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499174:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499180:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499184:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391144.499187:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499198:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499211:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:0.0:1788391144.499212:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391144.499217:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499221:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499235:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499239:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499245:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499250:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391144.499253:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499259:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499338:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391144.499340:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391144.499343:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499359:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3671b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499399:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd3670d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc90 expref: 18 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499414:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc90 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.499421:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:0.0:1788391144.499424:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788391144.499426:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391144.499586:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32902:x1875263094093952:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1342us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391144.499595:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391144.504380:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391144.504528:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.504619:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094094336 00000100:00100000:1.0:1788391144.504633:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094094336 00000100:00100000:1.0:1788391144.504722:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1788391144.504735:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094094336:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391144.504753:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391144.504787:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36722 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc90 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.504808:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:1.0:1788391144.504814:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391144.504896:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094094336:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391144.504905:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1788391144.505720:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094094208 00000100:00100000:3.0:1788391144.505731:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094094208 00000100:00100000:3.0:1788391144.505842:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1788391144.505858:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32902:x1875263094094208:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391144.505884:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.505888:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391144.505911:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36706 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc89 expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.505929:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:3.0:1788391144.505952:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391144.506000:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36729 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc97 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506175:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506191:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506203:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506216:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506223:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.506232:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.507791:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3673e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.507808:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3673e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.507820:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3673e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.509002:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788391144.509068:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509079:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509087:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509093:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.509099:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509108:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509125:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391144.509128:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.509134:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509159:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36730 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391144.509177:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017a61a56 reply state 00000000a9996f5e transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.509187:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391144.509231:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36729 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc97 expref: 18 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509249:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3673e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc97 expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.509255:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391144.509256:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788391144.509258:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:3.0:1788391144.509342:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32902:x1875263094094208:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 3485us (4977us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788391144.509352:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00010000:00010000:2.0:1788391144.514348:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514375:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514383:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514387:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.514391:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514397:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514415:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff95d686a70700) 00010000:00010000:2.0:1788391144.514417:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.514421:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.514425:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36737 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.524387:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.524506:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094094592 00000100:00100000:2.0:1788391144.524518:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094094592 00000100:00100000:2.0:1788391144.524586:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1788391144.524597:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32902:x1875263094094592:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391144.525082:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32902:x1875263094094592:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 486us (709us total) trans 30064771081 rc 0/0 00000100:00100000:2.0:1788391144.525107:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1788391144.535770:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.535842:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094094720 00000100:00100000:3.0:1788391144.535868:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094094720 00000100:00100000:3.0:1788391144.536011:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788391144.536027:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32902:x1875263094094720:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391144.536061:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.536088:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3674c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffc9e expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536206:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536238:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536255:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536275:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536283:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536290:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536422:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536430:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536436:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.536471:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391144.536476:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391144.536500:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536524:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536531:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536538:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536544:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.536549:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536557:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536570:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:3.0:1788391144.536585:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.536590:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536596:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536610:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536623:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536629:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536640:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.536644:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536651:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536660:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d686a70c00) 00010000:00010000:3.0:1788391144.536663:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.536666:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536672:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3675a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536709:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd3674c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc9e expref: 20 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536729:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc9e expref: 19 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.536738:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391144.536740:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788391144.536743:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:0.0:1788391144.536882:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094094720:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 857us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391144.536892:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391144.540065:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.540175:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094094848 00000100:00100000:2.0:1788391144.540190:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094094848 00000100:00100000:2.0:1788391144.540265:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788391144.540278:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094094848:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391144.540307:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.540333:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36768 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffca5 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540420:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540438:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540452:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540469:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540477:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540484:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540567:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540597:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540604:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540611:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.540615:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540623:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540637:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.540641:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.540645:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540660:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3676f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540677:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540683:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540690:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540695:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.540703:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540710:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540718:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff95d6830d2e00) 00010000:00010000:2.0:1788391144.540721:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.540724:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540730:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36776 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540768:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36768 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffca5 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540779:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.540781:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.540785:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36768 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffca5 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.540795:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391144.540865:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094094848:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 590us (814us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391144.540873:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788391144.554136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391144.556081:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094095104 00000100:00100000:0.0:1788391144.556105:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094095104 00000100:00100000:0.0:1788391144.556210:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391144.556223:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094095104:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391144.556377:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391144.556406:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3677d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcac expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556825:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556854:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556868:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556886:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556894:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.556901:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.560431:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36792 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.560461:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36792 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.560477:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36792 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391144.560493:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3:0x0]: returning size 0 00010000:00010000:0.0:1788391144.560555:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.560564:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.561781:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.561800:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391144.561806:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.561817:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.561840:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391144.561843:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391144.561848:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.561855:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36784 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391144.561881:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c6bfae1 reply state 000000005b14cb8c transno 30064771082 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.561891:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391144.562122:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79aa00/0x9aafc5f04cd3677d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcac expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.562143:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36792 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcac expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.562169:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391144.562172:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788391144.562175:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788391144.562442:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094095104:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 6219us (8320us total) trans 30064771082 rc 0/0 00000100:00100000:0.0:1788391144.562454:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00010000:00010000:3.0:1788391144.573811:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573829:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573852:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573857:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79ba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.573861:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573868:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573884:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391144.573886:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.573890:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.573896:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79ba00/0x9aafc5f04cd3678b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.579682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.579765:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094095360 00000100:00100000:3.0:1788391144.579775:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094095360 00000100:00100000:3.0:1788391144.579843:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391144.579860:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094095360:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788391144.580195:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.580212:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.580224:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391144.580280:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771083 00000004:00010000:3.0:1788391144.580301:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebc1e17d reply state 00000000c51c696b transno 30064771084 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.580309:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391144.580398:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094095360:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 539us (724us total) trans 30064771084 rc 0/0 00000100:00100000:3.0:1788391144.580406:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000020:00080000:3.0:1788391144.580411:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391144.585625:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585652:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585680:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585686:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.585692:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585701:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585722:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:2.0:1788391144.585726:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.585731:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.585738:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd367a0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.586021:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.586112:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094095616 00000100:00100000:2.0:1788391144.586127:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094095616 00000100:00100000:2.0:1788391144.586197:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391144.586211:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094095616:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391144.586510:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094095616:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 301us (495us total) trans 30064771085 rc 0/0 00000100:00100000:2.0:1788391144.586519:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000040:00080000:3.0:1788391144.590227:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788391144.590238:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391144.590275:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1788391144.590284:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788391144.593653:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.594004:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094095872 00000100:00100000:2.0:1788391144.594017:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094095872 00000100:00100000:2.0:1788391144.594096:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1788391144.594109:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094095872:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788391144.594198:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391144.594232:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36792 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcac expref: 24 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594257:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:2.0:1788391144.594271:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391144.594298:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594315:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594327:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594343:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594350:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594357:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594473:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594481:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.594487:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595361:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595383:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595394:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595404:0:42645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595411:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595417:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595464:0:42645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391144.595488:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595494:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595501:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595507:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.595511:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595518:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595531:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:3.0:1788391144.595534:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788391144.595539:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595546:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd367b5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595566:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595572:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595588:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595594:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.595597:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.595603:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.596002:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391144.596006:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.596010:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.596016:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd367a7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391144.596029:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b898ffb3 reply state 00000000c620b987 transno 30064771086 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.596038:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391144.596140:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094095872:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 2029us (2497us total) trans 30064771086 rc 0/0 00000100:00100000:3.0:1788391144.596149:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00010000:00010000:1.0:1788391144.596647:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391144.596654:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.596661:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391144.596664:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.596671:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.596683:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:1.0:1788391144.596685:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391144.596688:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.596694:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd367bc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.596711:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391144.596713:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391144.596715:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391144.599415:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599430:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599453:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599458:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.599462:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599469:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599483:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff95d6830d2e00) 00010000:00010000:3.0:1788391144.599486:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.599490:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.599495:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd367ae lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.605036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.605131:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094096000 00000100:00100000:3.0:1788391144.605141:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094096000 00000100:00100000:3.0:1788391144.605210:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788391144.605220:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094096000:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391144.605248:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.605269:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367c3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcb3 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605334:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605367:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605379:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605396:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605404:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605410:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605467:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605475:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605482:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605488:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.605493:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605500:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605512:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391144.605520:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.605525:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605531:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd367ca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605546:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605552:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605557:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605562:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.605565:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605570:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605577:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff95d686a70c00) 00010000:00010000:3.0:1788391144.605579:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.605582:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605587:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd367d1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605618:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367c3 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcb3 expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605634:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391144.605636:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.605640:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367c3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcb3 expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.605648:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391144.605700:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094096000:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 481us (674us total) trans 0 rc 301/301 00000100:00100000:3.0:1788391144.605707:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391144.616242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.616323:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094096256 00000100:00100000:2.0:1788391144.616331:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094096256 00000100:00100000:2.0:1788391144.616399:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788391144.616407:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094096256:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391144.616425:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.616441:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd367d8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcba expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616541:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616556:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616568:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616583:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616590:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.616597:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617252:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd367ed lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617260:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd367ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617271:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd367ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.617278:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788391144.617298:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617303:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617308:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617311:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.617314:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617318:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617326:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.617328:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.617331:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617334:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd367df lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391144.617343:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e44e3473 reply state 00000000541a4b51 transno 30064771087 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.617355:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788391144.617376:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd367d8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcba expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617385:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd367ed lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcba expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.617390:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391144.617391:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788391144.617393:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e600, rc 0) 00000100:00100000:2.0:1788391144.617511:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32902:x1875263094096256:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1104us (1276us total) trans 30064771087 rc 0/0 00000100:00100000:2.0:1788391144.617519:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00010000:00010000:2.0:1788391144.619867:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619886:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619892:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619896:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.619899:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619903:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619930:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff95d6830d2b00) 00010000:00010000:2.0:1788391144.619933:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.619936:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.619950:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd367e6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.623473:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.623590:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094096512 00000100:00100000:3.0:1788391144.623601:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094096512 00000100:00100000:3.0:1788391144.623651:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788391144.623662:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094096512:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788391144.624121:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.624139:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.624151:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391144.624203:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771088 00000004:00010000:3.0:1788391144.624227:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fe1b086 reply state 00000000b51935f6 transno 30064771089 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.624235:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391144.624407:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32902:x1875263094096512:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 746us (944us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1788391144.624415:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000020:00080000:3.0:1788391144.624419:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788391144.625699:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625712:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625718:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625723:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.625728:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625735:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625751:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:3.0:1788391144.625754:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.625758:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.625763:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd367fb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.626666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.626746:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094096768 00000100:00100000:1.0:1788391144.626757:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094096768 00000100:00100000:1.0:1788391144.626806:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391144.626817:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32902:x1875263094096768:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788391144.627802:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32902:x1875263094096768:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 975us (1128us total) trans 30064771090 rc 0/0 00000100:00100000:1.0:1788391144.627829:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391144.633785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.634111:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094097024 00000100:00100000:3.0:1788391144.634121:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094097024 00000100:00100000:3.0:1788391144.634179:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788391144.634189:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32902:x1875263094097024:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391144.634225:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391144.634246:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36802 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcc1 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.634467:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36809 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.634481:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36809 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.634493:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36809 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391144.634505:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788391144.634757:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36802 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcc1 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.634774:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36809 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcc1 expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.634783:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:3.0:1788391144.634785:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788391144.634788:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391144.635079:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094097024:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 889us (1303us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1788391144.635088:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788391144.640315:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.640554:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094097280 00000100:00100000:2.0:1788391144.640565:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094097280 00000100:00100000:2.0:1788391144.640626:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1788391144.640638:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094097280:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391144.640869:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094097280:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 232us (561us total) trans 30064771092 rc 0/0 00000100:00100000:2.0:1788391144.640877:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391144.644280:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.644434:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094097536 00000100:00100000:1.0:1788391144.644444:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094097536 00000100:00100000:1.0:1788391144.644505:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788391144.644515:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094097536:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788391144.644568:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391144.644606:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36809 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcc1 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644628:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd367ed lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcba expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644640:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:1.0:1788391144.644650:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391144.644670:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644682:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644691:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644717:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644724:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644744:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644855:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644862:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.644869:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645577:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645588:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645609:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645620:0:42644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645626:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645631:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645651:0:42644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391144.645670:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645683:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645689:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645699:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.645714:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645722:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645731:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391144.645734:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788391144.645737:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645742:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36825 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645756:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645763:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645768:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645773:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.645782:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.645788:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645830:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391144.645836:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645843:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391144.645846:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645852:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645860:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:2.0:1788391144.645863:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391144.645872:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645878:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd3682c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.645892:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391144.645894:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391144.645896:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391144.646268:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391144.646272:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.646275:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.646292:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd36817 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391144.646302:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e22a8817 reply state 00000000f7a7d60e transno 30064771093 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.646310:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391144.646396:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094097536:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1880us (2122us total) trans 30064771093 rc 0/0 00000100:00100000:1.0:1788391144.646405:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788391144.653189:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.653265:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094097664 00000100:00100000:2.0:1788391144.653275:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094097664 00010000:00010000:1.0:1788391144.653297:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.653308:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.653316:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.653322:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.653326:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.653329:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391144.653338:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094097664:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391144.653346:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653361:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391144.653361:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff95d6a0d29f00) 00010000:00010000:1.0:1788391144.653364:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.653368:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.653373:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd3681e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653378:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36833 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcc8 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653437:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653449:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653459:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653473:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653480:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653497:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653548:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653556:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653561:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653566:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.653569:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653575:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653583:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.653586:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.653589:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653594:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3683a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653605:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653611:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653622:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653627:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.653631:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653637:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653645:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff95d6830d2b00) 00010000:00010000:2.0:1788391144.653648:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.653650:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653656:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36841 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653688:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36833 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcc8 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653699:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.653701:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.653705:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36833 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcc8 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.653713:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788391144.653774:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094097664:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 437us (595us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391144.653790:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391144.657082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.657159:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094097920 00000100:00100000:1.0:1788391144.657169:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094097920 00000100:00100000:1.0:1788391144.657228:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391144.657238:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094097920:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391144.657260:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391144.657281:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd36848 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffccf expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657404:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657419:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657431:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657444:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657463:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.657470:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658141:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658152:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658161:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391144.658170:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 0 00010000:00010000:1.0:1788391144.658196:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658203:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658209:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658215:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdda00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.658220:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658227:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658247:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391144.658249:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.658253:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658257:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd3684f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391144.658267:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9946ba4 reply state 000000001572ad80 transno 30064771094 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391144.658273:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391144.658301:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd36848 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658315:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 33 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.658323:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:1.0:1788391144.658325:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788391144.658328:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:1.0:1788391144.658386:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32902:x1875263094097920:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1149us (1312us total) trans 30064771094 rc 0/0 00000100:00100000:1.0:1788391144.658394:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:2.0:1788391144.662638:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391144.662722:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094098176 00000100:00100000:0.0:1788391144.662732:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094098176 00000100:00100000:0.0:1788391144.662820:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788391144.662831:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32902:x1875263094098176:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788391144.663126:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.663144:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391144.663154:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663171:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663198:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391144.663201:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771095 00010000:00010000:3.0:1788391144.663205:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663211:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391144.663216:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391144.663222:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e30344e reply state 00000000394f4655 transno 30064771096 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663223:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663237:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff95d6a0d29c00) 00000100:00100000:0.0:1788391144.663239:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391144.663240:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391144.663245:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.663250:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36856 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.665849:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32902:x1875263094098176:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 3010us (3209us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1788391144.665862:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000020:00080000:0.0:1788391144.665869:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391144.668113:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668128:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668152:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668159:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.668164:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668172:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668190:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:1.0:1788391144.668193:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.668197:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.668204:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3686b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.669908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.669989:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094098304 00000100:00100000:3.0:1788391144.669999:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094098304 00000100:00100000:1.0:1788391144.670073:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1788391144.670085:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:32903:x1875263094098304:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391144.670106:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391144.670126:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd36872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcd6 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670189:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670203:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670228:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391144.670261:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391144.670265:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391144.670285:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670309:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd36872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcd6 expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670326:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcd6 expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.670335:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:1.0:1788391144.670337:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391144.670340:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:1.0:1788391144.670400:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32903:x1875263094098304:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 317us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391144.670410:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788391144.674207:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.674263:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094098432 00000100:00100000:2.0:1788391144.674273:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094098432 00000100:00100000:2.0:1788391144.674328:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1788391144.674339:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32903:x1875263094098432:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391144.674357:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391144.674375:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcdd expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674455:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674467:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674477:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674489:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674496:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674501:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674583:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674590:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674596:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391144.674620:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391144.674623:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391144.674639:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674650:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674656:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674663:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674668:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.674672:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674679:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674690:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:2.0:1788391144.674698:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.674703:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674708:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674721:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674727:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674731:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674735:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391144.674736:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674740:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674744:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d6830d2b00) 00010000:00010000:2.0:1788391144.674746:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391144.674747:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674750:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f000/0x9aafc5f04cd3688e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674771:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcdd expref: 8 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674789:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcdd expref: 7 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.674797:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391144.674799:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391144.674801:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391144.674859:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32903:x1875263094098432:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 522us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.674866:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788391144.680280:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.680329:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094098688 00000100:00100000:1.0:1788391144.680339:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094098688 00000100:00100000:1.0:1788391144.680397:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788391144.680408:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32903:x1875263094098688:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391144.680428:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391144.680447:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd3689c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffce4 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680537:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680551:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680561:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680575:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680581:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680587:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680695:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd368b1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680704:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd368b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680710:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd368b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391144.680720:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:1.0:1788391144.680812:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680829:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680836:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680842:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdcc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.680846:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680854:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680867:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391144.680870:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.680875:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680881:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdcc00/0x9aafc5f04cd368a3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680894:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680900:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680905:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680910:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391144.680919:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680925:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680933:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff95d6a0d29f00) 00010000:00010000:1.0:1788391144.680935:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391144.680948:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.680955:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd000/0x9aafc5f04cd368aa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.681034:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd3689c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffce4 expref: 10 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.681047:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd368b1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffce4 expref: 9 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.681054:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:1.0:1788391144.681056:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391144.681058:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:1.0:1788391144.681115:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32903:x1875263094098688:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 709us (844us total) trans 30064771097 rc 0/0 00000100:00100000:1.0:1788391144.681122:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788391144.685600:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.685700:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094098944 00000100:00100000:3.0:1788391144.685709:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094098944 00000100:00100000:3.0:1788391144.685774:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1788391144.685785:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32903:x1875263094098944:12345-192.168.202.1@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788391144.685914:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391144.686011:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd368b1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffce4 expref: 9 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.686031:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391144.686035:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391144.686094:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094098944:12345-192.168.202.1@tcp:103:mmap_sanity.0 Request processed in 310us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.686101:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1788391144.690518:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391144.690607:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099072 00000100:00100000:3.0:1788391144.690617:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099072 00000100:00100000:3.0:1788391144.690669:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788391144.690677:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094099072:12345-192.168.202.1@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1788391144.690902:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.690919:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.690928:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.691021:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.691035:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 34 pid: 42644 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391144.691049:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103449728:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391144.691179:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4eadc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391144.695211:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103449728:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391144.695238:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391144.700715:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391144.700776:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099200 00000100:00100000:2.0:1788391144.700785:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099200 00010000:00010000:2.0:1788391144.700829:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 35 pid: 42644 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391144.700873:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391144.700882:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094099200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391144.700898:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391144.700905:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 35 pid: 42644 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.700919:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 35 pid: 42644 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.700950:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd3685d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffccf expref: 35 pid: 42644 timeout: 1061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.701027:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:2.0:1788391144.701033:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.701042:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.701049:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391144.701074:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391144.701121:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2356:x1875263094099200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 240us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391144.701135:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00010000:00010000:3.0:1788391144.701254:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391144.701263:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391144.701997:0:42645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788391144.702086:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:3.0:1788391144.702154:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].1, 136 off8328 00000100:00100000:3.0:1788391144.702245:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094099072:12345-192.168.202.1@tcp:58:mmap_sanity.0 Request processed in 11566us (11734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391144.702254:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788391144.704223:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391144.704313:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099328 00000100:00100000:1.0:1788391144.704322:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099328 00000100:00100000:1.0:1788391144.704413:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788391144.704423:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094099328:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391144.704452:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391144.704471:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffceb expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704523:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704533:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 9 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704550:0:42644:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704561:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 9 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704573:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:1.0:1788391144.704576:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391144.704580:0:42644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 9 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391144.704587:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc000, rc 0) 00000100:00100000:1.0:1788391144.704634:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32903:x1875263094099328:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 214us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391144.704640:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391145.078302:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391145.078355:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391145.078395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391145.078429:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391145.078454:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.078528:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099584 00000100:00100000:3.0:1788391145.078541:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099584 00000100:00100000:3.0:1788391145.078626:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099840 00000100:00100000:3.0:1788391145.078630:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099840 00000100:00100000:3.0:1788391145.078647:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099712 00000100:00100000:3.0:1788391145.078649:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099712 00000100:00100000:3.0:1788391145.078675:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099968 00000100:00100000:3.0:1788391145.078678:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099968 00000100:00100000:3.0:1788391145.078696:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788391145.078707:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094099584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391145.078798:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094099456 00000100:00100000:1.0:1788391145.078804:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094099456 00000100:00100000:3.0:1788391145.078806:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094099584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 99us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.078839:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788391145.078848:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788391145.078865:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391145.078869:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:2357:x1875263094099456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391145.078878:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094099840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391145.078920:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:2357:x1875263094099456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.078921:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094099840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.078951:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1788391145.078951:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788391145.079015:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1788391145.079025:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094099712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391145.079042:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1788391145.079053:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094099968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391145.079059:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094099712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.079067:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788391145.079092:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094099968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.079100:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:0.0:1788391145.079182:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391145.079187:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788391145.165129:0:42641:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788391145.165140:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6b4edc800 from 10 10000000:01000000:1.0:1788391145.165147:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788391145.165217:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.165230:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.165245:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391145.165292:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103449856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788391145.165393:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391145.165492:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.165598:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449856 00000100:00100000:0.0:1788391145.165607:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449856 00000100:00100000:0.0:1788391145.165675:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788391145.165688:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+16:42641:x1875263103449856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788391145.165704:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391145.165721:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd368d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd368cd expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.165750:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd368d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd368cd expref: 17 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.165786:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6bc79a200/0x9aafc5f04cd368d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd368cd expref: 17 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.165796:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a200, rc 0) 00000100:00100000:0.0:1788391145.165853:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103449856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391145.165859:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788391145.166104:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103449856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391145.166122:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368d4 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.166131:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd368d4 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.166203:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103449984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.166236:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391145.166309:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391145.168896:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103449984 00000100:00100000:3.0:1788391145.169019:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103449984 00000100:00100000:3.0:1788391145.169241:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788391145.169266:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103449984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391145.169822:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103449984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 569us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.169831:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788391145.170008:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103449984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.170089:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.170154:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391145.170550:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.170704:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450112 00000100:00100000:0.0:1788391145.170713:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450112 00000100:00100000:0.0:1788391145.170757:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788391145.170766:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103450112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.171484:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103450112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 714us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391145.171495:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788391145.171688:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788391145.173180:0:44765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788391145.173503:0:42641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788391145.173532:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788391145.173546:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368d4 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.173558:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d684cdd000/0x9aafc5f04cd368cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368d4 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391145.173582:0:42641:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788391145.173586:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d6bbf78800 from 10 10000000:01000000:0.0:1788391145.173589:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788391145.173639:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.173669:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.173682:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.173717:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.173801:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.173855:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391145.174185:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450240 00000100:00100000:2.0:1788391145.174195:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450240 00000100:00100000:2.0:1788391145.174247:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788391145.174334:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+17:42641:x1875263103450240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788391145.174353:0:42637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391145.174370:0:42637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd368e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd368db expref: -99 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.174402:0:42637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd368e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd368db expref: 18 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.174414:0:42637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d6b4c1f000/0x9aafc5f04cd368e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd368db expref: 18 pid: 42637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.174425:0:42637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f000, rc 0) 00000100:00100000:2.0:1788391145.174474:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.174482:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788391145.174757:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788391145.174774:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368e2 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.174783:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd368e2 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.174848:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.174878:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.174922:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391145.175183:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450368 00000100:00100000:2.0:1788391145.175190:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450368 00000100:00100000:2.0:1788391145.175229:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788391145.175238:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.176921:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1664us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.176954:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788391145.177513:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.177663:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.177736:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.177783:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298900 going to sleep for 11 seconds 00000100:00100000:3.0:1788391145.177844:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450496 00000100:00100000:3.0:1788391145.177852:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450496 00000100:00100000:3.0:1788391145.177917:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788391145.177928:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788391145.178194:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.178212:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788391145.180734:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788391145.183144:0:44766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788391145.183554:0:42641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788391145.183659:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788391145.183674:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368e2 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.183688:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79ba00/0x9aafc5f04cd368db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368e2 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788391145.183701:0:42641:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788391145.183705:0:42641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95d586c62000 from 10 10000000:01000000:0.0:1788391145.183708:0:42641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788391145.183756:0:42641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.183764:0:42641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.183778:0:42641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.183806:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.183889:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.184190:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391145.184239:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450624 00000100:00100000:1.0:1788391145.184249:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450624 00000100:00100000:1.0:1788391145.184410:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788391145.184423:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+18:42641:x1875263103450624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391145.184451:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391145.184468:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd368f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9aafc5f04cd368e9 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.184498:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd368f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9aafc5f04cd368e9 expref: 19 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.184510:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdcc00/0x9aafc5f04cd368f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9aafc5f04cd368e9 expref: 19 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.184520:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdcc00, rc 0) 00000100:00100000:1.0:1788391145.184682:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103450624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.184689:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788391145.184779:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788391145.184796:0:42641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368f0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.184807:0:42641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9aafc5f04cd368f0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.184871:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.184918:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.184950:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788391145.185159:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450752 00000100:00100000:2.0:1788391145.185165:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450752 00000100:00100000:2.0:1788391145.185203:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788391145.185212:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103450752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.186030:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103450752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 748us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.186041:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788391145.186169:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.186214:0:42641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788391145.186345:0:42641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391145.186419:0:42641:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391145.186510:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103450880 00000100:00100000:1.0:1788391145.186517:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103450880 00000100:00100000:1.0:1788391145.186563:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788391145.186581:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103450880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788391145.186774:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:42641:x1875263103450880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.186782:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788391145.186952:0:42641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2d257ec-6d90-4f1c-863a-372d5df14bf2:42641:1875263103450880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788391145.188102:0:44767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788391145.188491:0:42641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788391145.188517:0:42641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788391145.188529:0:42641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368f0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.188543:0:42641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff95d6bc79aa00/0x9aafc5f04cd368e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9aafc5f04cd368f0 expref: -99 pid: 42641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.269607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.269759:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100096 00000100:00100000:1.0:1788391145.269770:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100096 00000100:00100000:1.0:1788391145.269828:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:1.0:1788391145.269837:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+11:32290:x1875263094100096:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391145.269856:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391145.269875:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd368f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcf2 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.269909:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd368f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcf2 expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.269922:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdd400/0x9aafc5f04cd368f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcf2 expref: 12 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.269944:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd400, rc 0) 00000100:00100000:1.0:1788391145.270040:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100096:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 204us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.270046:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:0.0:1788391145.275530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.275649:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100224 00000100:00100000:3.0:1788391145.275661:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100224 00000100:00100000:3.0:1788391145.275734:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:3.0:1788391145.275747:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100224:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391145.276184:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100224:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 438us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.276192:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:0.0:1788391145.283673:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.283843:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100352 00000100:00100000:2.0:1788391145.283857:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100352 00000100:00100000:2.0:1788391145.283944:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1788391145.283957:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100352:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.284301:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100352:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 346us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.284310:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788391145.295287:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.295385:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100480 00000100:00100000:1.0:1788391145.295399:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100480 00000100:00100000:1.0:1788391145.295474:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:1.0:1788391145.295488:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+12:32290:x1875263094100480:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788391145.295511:0:42639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391145.295537:0:42639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd368fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffcf9 expref: -99 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.295616:0:42639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd368fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcf9 expref: 13 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.295630:0:42639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95d684cdca00/0x9aafc5f04cd368fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcf9 expref: 13 pid: 42639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.295641:0:42639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdca00, rc 0) 00000100:00100000:1.0:1788391145.295721:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:32290:x1875263094100480:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 236us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.295728:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788391145.302228:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.302368:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100608 00000100:00100000:3.0:1788391145.302437:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100608 00000100:00100000:3.0:1788391145.302560:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1788391145.302582:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32290:x1875263094100608:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788391145.303049:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:32290:x1875263094100608:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 469us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.303056:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788391145.308586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.308779:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100736 00000100:00100000:2.0:1788391145.308793:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100736 00000100:00100000:2.0:1788391145.308876:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788391145.308889:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32290:x1875263094100736:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788391145.309199:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:32290:x1875263094100736:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 312us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.309206:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00010000:00010000:1.0:1788391145.423721:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391145.613488:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788391145.613511:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391145.613579:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1788391145.613599:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391145.613602:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391145.613631:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:3.0:1788391145.613635:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:3.0:1788391145.613773:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103451008:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391145.613895:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.619112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.619198:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103451008:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788391145.620053:0:42655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100864 00000100:00100000:2.0:1788391145.620067:0:42655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100864 00000100:00100000:2.0:1788391145.620146:0:42655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391145.620178:0:42655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094100864:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788391145.620304:0:42655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094100864:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 129us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.620313:0:42655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1788391145.622061:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.622174:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094100992 00000100:00100000:2.0:1788391145.622185:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094100992 00000100:00100000:2.0:1788391145.622252:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788391145.622263:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094100992:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391145.622303:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391145.622422:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094100992:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 161us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.622427:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788391145.625219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.625494:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094101120 00000100:00100000:2.0:1788391145.625507:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094101120 00000100:00100000:2.0:1788391145.625582:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1788391145.625596:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094101120:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.625697:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.625720:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.625735:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.625753:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626559:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626575:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626615:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626624:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626631:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391145.626685:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:2.0:1788391145.626691:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391145.626707:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626720:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626728:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626735:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626741:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391145.626747:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.626766:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627411:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:2.0:1788391145.627419:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391145.627429:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627437:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36905 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627459:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627464:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627470:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627475:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391145.627479:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627486:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627496:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9ebbb977 (ffff95d6830d2b00) 00010000:00010000:2.0:1788391145.627499:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391145.627501:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627521:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3690c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627541:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627548:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627554:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627559:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391145.627562:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627569:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627578:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:2.0:1788391145.627580:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391145.627583:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.627587:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36913 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.627699:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094101120:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 2100us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.627710:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788391145.632767:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.633671:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094101376 00000100:00100000:3.0:1788391145.633691:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094101376 00000100:00100000:3.0:1788391145.633829:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1788391145.633853:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32906:x1875263094101376:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.633881:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391145.633917:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3691a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd00 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634101:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634115:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634126:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391145.634136:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:3.0:1788391145.634269:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634279:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634287:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634294:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.634298:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634325:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634341:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391145.634344:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391145.634350:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634357:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36921 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634408:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3691a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd00 expref: 36 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634420:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391145.634421:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391145.634425:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3691a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd00 expref: 36 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.634434:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391145.634515:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32906:x1875263094101376:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 666us (1764us total) trans 30064771098 rc 301/301 00000100:00100000:3.0:1788391145.634523:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788391145.638467:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.638575:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094101504 00000100:00100000:2.0:1788391145.638588:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094101504 00000100:00100000:2.0:1788391145.638696:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1788391145.638711:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32906:x1875263094101504:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391145.638765:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391145.638940:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32906:x1875263094101504:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 224us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.638949:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788391145.644269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.644489:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094101760 00000100:00100000:2.0:1788391145.644503:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094101760 00000100:00100000:2.0:1788391145.644577:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1788391145.644589:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32906:x1875263094101760:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.644618:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391145.644646:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3692f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd07 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391145.645582:0:43348:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0xa4:0x0], count =30 00000004:00080000:2.0:1788391145.645592:0:43348:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0xa4:0x0]+30 in llog 00000004:00080000:2.0:1788391145.645653:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc2:0x0], index 0: 0 00010000:00010000:2.0:1788391145.646861:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd36936 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.646891:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd36936 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.646908:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd36936 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.647057:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3692f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd07 expref: 38 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.647097:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd36936 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd07 expref: 37 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.647108:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d6830d2b00) 00010000:00010000:2.0:1788391145.647112:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391145.647115:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ec00, rc 0) 00000100:00100000:2.0:1788391145.647219:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32906:x1875263094101760:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2631us (2965us total) trans 30064771099 rc 0/0 00000100:00100000:2.0:1788391145.647229:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1788391145.650615:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.650705:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102016 00000100:00100000:3.0:1788391145.650720:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102016 00000100:00100000:3.0:1788391145.650801:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788391145.650813:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32906:x1875263094102016:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.650928:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391145.651002:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd36936 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd07 expref: 37 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651026:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d6830d2b00) 00010000:00010000:3.0:1788391145.651039:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391145.651068:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651084:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651094:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651106:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651110:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651114:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651187:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651192:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651196:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651206:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.651211:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651216:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651221:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391145.651223:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391145.651226:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651230:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36944 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651236:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651239:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651243:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651246:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.651248:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651251:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651261:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xf88e6ec3 (ffff95d686a70c00) 00010000:00010000:3.0:1788391145.651263:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391145.651264:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.651268:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3694b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xf88e6ec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.651343:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32906:x1875263094102016:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 533us (744us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788391145.651348:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788391145.654551:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.654644:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102144 00000100:00100000:3.0:1788391145.654658:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102144 00000100:00100000:3.0:1788391145.654731:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788391145.654744:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32906:x1875263094102144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.654770:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391145.654807:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36952 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd0e expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.654864:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.654882:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.654905:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.655085:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36952 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.655118:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 37 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.655128:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.655132:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391145.655136:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391145.655202:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32906:x1875263094102144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 461us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.655211:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788391145.659642:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.660017:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102400 00000100:00100000:2.0:1788391145.660032:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102400 00000100:00100000:2.0:1788391145.660152:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1788391145.660166:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32906:x1875263094102400:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.660304:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.660327:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.660341:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391145.661055:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].2, 88 off8344 00000004:00080000:2.0:1788391145.661072:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 962768110269ns, next at 963768106917ns, rc = 0 00000004:00010000:2.0:1788391145.661196:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044056bb0 reply state 00000000ccb3d012 transno 30064771100 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.661232:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391145.661378:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:32906:x1875263094102400:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1212us (1749us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1788391145.661388:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:3.0:1788391145.665342:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665364:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665373:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665379:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.665385:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665394:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665415:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.665418:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788391145.665424:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.665453:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd36960 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.666403:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.666502:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102528 00000100:00100000:2.0:1788391145.666515:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102528 00000100:00100000:2.0:1788391145.666591:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788391145.666604:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:32906:x1875263094102528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.666637:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391145.666663:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd15 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.666741:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 39 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.666756:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 39 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.666777:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:2.0:1788391145.666780:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391145.666790:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391145.666867:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:32906:x1875263094102528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 264us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.666875:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1788391145.669801:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.670170:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102656 00000100:00100000:3.0:1788391145.670181:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102656 00000100:00100000:3.0:1788391145.670242:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391145.670250:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094102656:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391145.670676:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094102656:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 426us (886us total) trans 30064771074 rc 0/0 00000100:00100000:3.0:1788391145.670682:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788391145.675316:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.676710:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094102912 00000100:00100000:2.0:1788391145.676729:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094102912 00000100:00100000:2.0:1788391145.677048:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788391145.677065:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:32906:x1875263094102912:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391145.677389:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:32906:x1875263094102912:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 328us (2089us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1788391145.677397:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1788391145.681228:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.681357:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103168 00000100:00100000:3.0:1788391145.681370:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103168 00000100:00100000:3.0:1788391145.681451:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1788391145.681464:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:32906:x1875263094103168:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391145.681623:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:32906:x1875263094103168:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 162us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.681632:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1788391145.683640:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.683768:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103296 00000100:00100000:2.0:1788391145.683779:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103296 00000100:00100000:2.0:1788391145.683847:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788391145.683860:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:32906:x1875263094103296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.683884:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391145.683912:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd3696e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd1c expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684050:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684067:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684082:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391145.684128:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391145.684152:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684183:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd3696e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd1c expref: 42 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684220:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd1c expref: 41 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.684227:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:2.0:1788391145.684229:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788391145.684232:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f400, rc 0) 00000100:00100000:2.0:1788391145.684283:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:32906:x1875263094103296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 427us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.684287:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1788391145.687369:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.687816:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103424 00000100:00100000:1.0:1788391145.687830:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103424 00000100:00100000:1.0:1788391145.689460:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788391145.689487:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094103424:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391145.689512:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391145.689655:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd23 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391145.689694:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aee9, blocks: 0x1 00010000:00010000:1.0:1788391145.689730:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=962s v=(0 0) 00010000:00010000:1.0:1788391145.689735:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391145.689749:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 7 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.689951:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 7 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.689991:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cddc00, rc 0) 00000100:00100000:1.0:1788391145.690083:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094103424:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 609us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.690092:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391145.693213:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.693431:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103680 00000100:00100000:3.0:1788391145.693444:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103680 00000100:00100000:3.0:1788391145.693516:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391145.693528:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:32906:x1875263094103680:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391145.693713:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:32906:x1875263094103680:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 186us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.693722:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1788391145.700791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.700912:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103808 00000100:00100000:3.0:1788391145.700953:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103808 00000100:00100000:3.0:1788391145.701059:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788391145.701082:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32906:x1875263094103808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.701107:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391145.701132:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd2a expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.701172:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 8 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.701181:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391145.701187:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391145.701192:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.701237:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 8 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.701252:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 8 pid: 43328 timeout: 1062 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.701268:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103451136:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391145.701368:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.706277:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.706378:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094103936 00000100:00100000:1.0:1788391145.706391:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094103936 00010000:00010000:1.0:1788391145.706444:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 9 pid: 43328 timeout: 1062 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391145.706496:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1788391145.706508:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094103936:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391145.706524:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391145.706561:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 9 pid: 43328 timeout: 1062 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.706577:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 9 pid: 43328 timeout: 1062 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.706610:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391145.706616:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391145.706626:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 9 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.706657:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 9 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.706912:0:42630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 9 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391145.706940:0:42630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:42630:1875263103451264:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391145.707072:0:42630:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684690900 going to sleep for 11 seconds 00010000:00010000:3.0:1788391145.709561:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fe5c9af/0x9aafc5f04cd3697c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd23 expref: 9 pid: 43328 timeout: 1062 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.709617:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103451136:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391145.709659:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.709677:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1000, rc 0) 00000100:00100000:3.0:1788391145.710212:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:32906:x1875263094103808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 9129us (9433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.710222:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391145.714574:0:42630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:42630:1875263103451264:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391145.714611:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391145.714690:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094103936:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8184us (8429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.714703:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788391145.718850:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.719210:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104064 00000100:00100000:2.0:1788391145.719223:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104064 00002000:00100000:2.0:1788391145.719287:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff95d685dc5880 x1875263094104064/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788391145.719299:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5880 with x1875263094104064 ext(0->409599) 00002000:00010000:2.0:1788391145.719306:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5880 00000100:00100000:2.0:1788391145.719412:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391145.719424:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094104064:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391145.744473:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094104064:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 25034us (25621us total) trans 30064771075 rc 0/0 00000100:00100000:1.0:1788391145.744497:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:1.0:1788391145.744513:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff95d685dc5880 x1875263094104064/t30064771075(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:6/0 lens 488/448 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788391145.744525:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5880 with x1875263094104064 ext(0->409599) 00002000:00010000:1.0:1788391145.744542:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5880 00000100:00100000:2.0:1788391145.749806:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391145.750012:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104192 00000100:00100000:0.0:1788391145.750028:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104192 00000100:00100000:0.0:1788391145.750106:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1788391145.750118:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:32906:x1875263094104192:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788391145.798236:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771096 is committed 00000001:00080000:3.0:1788391145.798265:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771097 is committed 00000001:00080000:3.0:1788391145.798281:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00000004:00080000:3.0:1788391145.798291:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788391145.798632:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103451392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391145.798729:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391145.798998:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103451392 00000100:00100000:2.0:1788391145.799008:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103451392 00000100:00100000:2.0:1788391145.799098:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788391145.799110:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103451392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788391145.799312:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1788391145.799316:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788391145 00002000:00010000:2.0:1788391145.799327:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391145.799329:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1788391145 -> 1788391145 00002000:00010000:2.0:1788391145.799332:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391145.799389:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103451392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (659us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788391145.799397:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788391145.799452:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68f55e680/2, rc 0, transno 30064771076 00000100:00100000:2.0:1788391145.799459:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103451392:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788391145.799567:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391145.804283:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32906:x1875263094104192:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 54151us (54485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391145.804301:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1788391145.809248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.809353:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104320 00000100:00100000:2.0:1788391145.809366:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104320 00000100:00100000:2.0:1788391145.809431:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391145.809442:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094104320:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788391145.838569:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771075 is committed 00000001:00080000:0.0:1788391145.838598:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771076 is committed 00000100:00100000:2.0:1788391145.838849:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094104320:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 29392us (29598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.838864:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391145.841236:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.841430:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104576 00000100:00100000:3.0:1788391145.841444:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104576 00000100:00100000:3.0:1788391145.841561:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788391145.841574:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32906:x1875263094104576:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.841649:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391145.841685:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36975 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd1c expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.841722:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.841728:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391145.841772:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.841811:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.841823:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391145.842148:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4d3c49e reply state 00000000058fd05d transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.842160:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391145.842276:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32906:x1875263094104576:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 704us (1054us total) trans 30064771102 rc 0/0 00000100:00100000:3.0:1788391145.842283:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:3.0:1788391145.845203:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845228:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845236:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845242:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.845247:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845255:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845277:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.845298:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391145.845304:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.845310:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3698a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.847270:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.847399:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104704 00000100:00100000:3.0:1788391145.847411:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104704 00000100:00100000:3.0:1788391145.847484:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788391145.847496:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094104704:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788391145.847820:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:3.0:1788391145.847826:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1788391145 -> 1788391144 00002000:00010000:3.0:1788391145.847829:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1788391144 00002000:00010000:3.0:1788391145.847832:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1788391145 -> 1788391144 00002000:00010000:3.0:1788391145.847834:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:3.0:1788391145.847918:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094104704:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 423us (660us total) trans 30064771077 rc 0/0 00000100:00100000:3.0:1788391145.847925:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391145.862308:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.862443:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094104960 00000100:00100000:3.0:1788391145.862457:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094104960 00000100:00100000:3.0:1788391145.862544:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788391145.862559:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32906:x1875263094104960:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.862654:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.862674:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 13 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.862709:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.862755:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 13 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.862773:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 13 pid: 42645 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.862791:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103451520:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391145.863159:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.873037:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.873184:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105088 00000100:00100000:2.0:1788391145.873196:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105088 00010000:00010000:2.0:1788391145.873257:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 14 pid: 42645 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.873310:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1788391145.873322:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094105088:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391145.873342:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391145.873352:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 14 pid: 42645 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.873384:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 14 pid: 42645 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.873412:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:2.0:1788391145.873419:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.873431:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.873439:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.873465:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391145.873644:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094105088:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 323us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.873654:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00010000:00010000:3.0:1788391145.874055:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36959 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd0e expref: 13 pid: 42645 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.874076:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103451520:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391145.874108:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874119:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874125:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874162:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874169:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874197:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874202:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.874207:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874215:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874227:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.874231:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788391145.874234:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.874240:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd36991 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.874302:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32906:x1875263094104960:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 11747us (12008us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788391145.874310:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1788391145.881505:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.881594:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105216 00000100:00100000:3.0:1788391145.881609:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105216 00000100:00100000:3.0:1788391145.881676:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391145.881688:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094105216:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788391145.881734:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.881756:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.881778:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391145.882647:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391145.882653:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.883215:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.883242:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 7 pid: 43698 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.883265:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103451648:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391145.883399:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.885580:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103451648:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391145.885621:0:43698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391145.889387:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.889484:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105344 00000100:00100000:1.0:1788391145.889500:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105344 00010000:00010000:1.0:1788391145.889546:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391145.889591:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788391145.889599:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2358:x1875263094105344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391145.889611:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391145.889631:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.889650:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.889673:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd36983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd2a expref: 8 pid: 43698 timeout: 1062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.889690:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391145.889694:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391145.889701:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.889712:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391145.889770:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391145.889838:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2358:x1875263094105344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 239us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.889847:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:2.0:1788391145.890149:0:43698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890166:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890190:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890198:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890206:0:43698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890213:0:43698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391145.890218:0:43698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890227:0:43698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890237:0:43698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.890242:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c12bd40/0x9aafc5f04cd36998 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.890302:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094105216:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 8618us (8812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391145.890307:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788391145.892722:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.892798:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105600 00000100:00100000:2.0:1788391145.892812:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105600 00000100:00100000:2.0:1788391145.892882:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391145.892893:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32906:x1875263094105600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391145.893018:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893037:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893049:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893336:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893348:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893356:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.893390:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.894080:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 13 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.894099:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103451776:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391145.894246:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391145.898656:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.898770:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105728 00000100:00100000:3.0:1788391145.898785:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105728 00010000:00010000:3.0:1788391145.898832:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 14 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.898938:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788391145.898949:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094105728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391145.899001:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391145.899009:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 14 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.899024:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 14 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.899052:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.899057:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.899066:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.899074:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.899107:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391145.899165:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094105728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 217us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391145.899173:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:2.0:1788391145.904208:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36967 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd15 expref: 13 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391145.904247:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103451776:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391145.904283:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.904310:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.904316:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391145.904588:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771103 00000001:00080000:2.0:1788391145.904756:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771104 00000001:00080000:2.0:1788391145.904814:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771105 00000100:00100000:2.0:1788391145.904923:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103451904:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788391145.905343:0:42644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391145.905395:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391145.905484:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103451904 00000100:00100000:1.0:1788391145.905494:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103451904 00000100:00100000:1.0:1788391145.905564:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788391145.905577:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103451904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788391145.905702:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103451904:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.905711:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788391145.906092:0:42644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:2.0:1788391145.906098:0:42644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68f55e680, transno 30064771076 00000100:00100000:2.0:1788391145.906116:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103451904:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788391145.907796:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771106 00000100:00100000:2.0:1788391145.907899:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103452032:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788391145.908736:0:42644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391145.908779:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6875df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391145.908815:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103452032 00000100:00100000:1.0:1788391145.908823:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103452032 00000100:00100000:1.0:1788391145.908888:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788391145.908898:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103452032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788391145.909153:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42644:x1875263103452032:12345-0@lo:1000:mdt00_000.0 Request processed in 256us (418us total) trans 30064771078 rc 0/0 00000100:00100000:1.0:1788391145.909162:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788391145.909376:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103452032:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788391145.909417:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909429:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909437:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909444:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.909448:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909456:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909472:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391145.909475:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391145.909480:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909487:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd369a6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909524:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909540:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909546:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909619:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.909623:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909630:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909640:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391145.909643:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391145.909651:0:42644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909662:0:42644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909672:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.909733:0:42644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391145.909745:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103452160:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788391145.909825:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391145.913694:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103452160:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391145.913724:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913735:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd368bf lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913766:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913787:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913798:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913809:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913815:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913822:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913828:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.913832:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913849:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913876:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391145.913880:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391145.913884:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913889:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd369ad lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913899:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913905:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913911:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913917:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391145.913920:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913926:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913945:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391145.913948:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391145.913951:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391145.913957:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3699f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391145.915150:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1788391145.915156:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391145.915210:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:1.0:1788391145.915225:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391145.915228:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391145.915246:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:1.0:1788391145.915249:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:3.0:1788391145.917748:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32906:x1875263094105600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 24844us (25038us total) trans 30064771107 rc 0/0 00000100:00100000:3.0:1788391145.917763:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000020:00080000:3.0:1788391145.917771:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788391145.918078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.918350:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094105856 00000100:00100000:1.0:1788391145.918370:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094105856 00000100:00100000:1.0:1788391145.918420:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391145.918429:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094105856:12345-192.168.202.1@tcp:49:mmap_sanity.0 00000100:00100000:1.0:1788391145.918544:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094105856:12345-192.168.202.1@tcp:49:mmap_sanity.0 Request processed in 116us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391145.919000:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391145.922514:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.922819:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106112 00000100:00100000:3.0:1788391145.922844:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106112 00000100:00100000:3.0:1788391145.922919:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1788391145.922944:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32906:x1875263094106112:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788391145.923688:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788391145.923795:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00010000:00010000:0.0:1788391145.923835:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923850:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923861:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923869:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923875:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923881:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.923904:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788391145.924029:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32906:x1875263094106112:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1097us (1519us total) trans 30064771109 rc 0/0 00000100:00100000:0.0:1788391145.924038:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000020:00080000:0.0:1788391145.924043:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391145.924179:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391145.924186:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.924193:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391145.924205:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.924213:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.924226:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391145.924229:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391145.924233:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.924240:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369b4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391145.924256:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391145.924258:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391145.924259:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391145.927709:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.927797:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106240 00000100:00100000:3.0:1788391145.927815:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106240 00000100:00100000:3.0:1788391145.927909:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391145.927924:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:32903:x1875263094106240:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391145.928025:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391145.928055:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd31 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391145.928158:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a98aee8, atime: 0x6a98aee8, ctime: 0x6a98aee8, blocks: 0x403 00010000:00010000:0.0:1788391145.928191:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=963s v=(0 0) 00010000:00010000:0.0:1788391145.928196:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391145.928227:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.928275:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391145.928290:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1400, rc 0) 00000100:00100000:0.0:1788391145.928354:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32903:x1875263094106240:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 434us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391145.928363:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391145.936121:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.936214:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106368 00000100:00100000:2.0:1788391145.936232:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106368 00002000:00100000:2.0:1788391145.936283:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff95d6c1d19880 x1875263094106368/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391145.936312:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d19880 with x1875263094106368 ext(0->4095) 00002000:00010000:2.0:1788391145.936319:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6c1d19880 00000100:00100000:2.0:1788391145.936357:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788391145.936368:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094106368:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391145.945161:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094106368:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 8784us (9045us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788391145.945176:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:3.0:1788391145.945188:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff95d6c1d19880 x1875263094106368/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/4536 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.945337:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d19880 with x1875263094106368 ext(0->4095) 00002000:00010000:3.0:1788391145.945345:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6c1d19880 00000100:00100000:2.0:1788391145.953048:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.953186:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106496 00000100:00100000:1.0:1788391145.953203:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106496 00002000:00100000:1.0:1788391145.953277:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff95d68f55d500 x1875263094106496/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391145.953292:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d500 with x1875263094106496 ext(4096->8191) 00002000:00010000:1.0:1788391145.953299:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55d500 00000100:00100000:1.0:1788391145.953339:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1788391145.953352:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106496:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391145.953626:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106496:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 276us (589us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788391145.953634:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:1.0:1788391145.953642:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff95d68f55d500 x1875263094106496/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/4536 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391145.953651:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d500 with x1875263094106496 ext(4096->8191) 00002000:00010000:1.0:1788391145.953655:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55d500 00000100:00100000:0.0:1788391145.957320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.957441:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106624 00000100:00100000:3.0:1788391145.957473:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106624 00002000:00100000:3.0:1788391145.957629:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff95d691831f80 x1875263094106624/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.957643:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831f80 with x1875263094106624 ext(8192->12287) 00002000:00010000:3.0:1788391145.957650:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691831f80 00000100:00100000:3.0:1788391145.957742:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1788391145.957756:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106624:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391145.958238:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106624:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 484us (931us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788391145.958247:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:3.0:1788391145.958254:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff95d691831f80 x1875263094106624/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/4536 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.958263:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831f80 with x1875263094106624 ext(8192->12287) 00002000:00010000:3.0:1788391145.958266:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691831f80 00000100:00100000:0.0:1788391145.962613:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391145.962729:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106752 00000100:00100000:1.0:1788391145.962742:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106752 00002000:00100000:1.0:1788391145.962920:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff95d691832a00 x1875263094106752/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391145.962985:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832a00 with x1875263094106752 ext(12288->69631) 00002000:00010000:1.0:1788391145.962994:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832a00 00000100:00100000:1.0:1788391145.963045:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1788391145.963059:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094106752:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:2.0:1788391145.970490:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094106752:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 7421us (7878us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1788391145.970507:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00100000:2.0:1788391145.970522:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff95d691832a00 x1875263094106752/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/440 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391145.970534:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832a00 with x1875263094106752 ext(12288->69631) 00002000:00010000:2.0:1788391145.970541:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832a00 00000100:00100000:1.0:1788391145.975886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.976041:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094106880 00000100:00100000:3.0:1788391145.976051:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094106880 00002000:00100000:3.0:1788391145.976102:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff95d6c1d18000 x1875263094106880/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.976114:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d18000 with x1875263094106880 ext(69632->106495) 00002000:00010000:3.0:1788391145.976120:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6c1d18000 00000100:00100000:3.0:1788391145.976152:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788391145.976162:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106880:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391145.981322:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094106880:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5143us (5426us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788391145.981361:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00100000:3.0:1788391145.981381:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff95d6c1d18000 x1875263094106880/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/440 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.981394:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d18000 with x1875263094106880 ext(69632->106495) 00002000:00010000:3.0:1788391145.981403:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6c1d18000 00000100:00100000:0.0:1788391145.987598:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391145.987816:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107008 00000100:00100000:2.0:1788391145.987830:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107008 00002000:00100000:2.0:1788391145.987906:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff95d691832680 x1875263094107008/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391145.987919:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832680 with x1875263094107008 ext(106496->143359) 00002000:00010000:2.0:1788391145.987936:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832680 00000100:00100000:2.0:1788391145.988042:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1788391145.988054:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107008:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391145.992703:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107008:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 4632us (5102us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391145.992721:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:1.0:1788391145.992738:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff95d691832680 x1875263094107008/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/440 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391145.992749:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832680 with x1875263094107008 ext(106496->143359) 00002000:00010000:1.0:1788391145.992756:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832680 00000100:00100000:0.0:1788391145.998854:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391145.998998:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107136 00000100:00100000:3.0:1788391145.999014:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107136 00002000:00100000:3.0:1788391145.999090:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff95d691830e00 x1875263094107136/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/0 e 0 to 0 dl 1788391156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391145.999104:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691830e00 with x1875263094107136 ext(143360->180223) 00002000:00010000:3.0:1788391145.999112:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691830e00 00000100:00100000:3.0:1788391145.999158:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1788391145.999170:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107136:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391146.003093:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107136:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 3909us (4246us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788391146.003112:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00002000:00100000:3.0:1788391146.003129:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff95d691830e00 x1875263094107136/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:6/0 lens 488/440 e 0 to 0 dl 1788391156 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391146.003141:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691830e00 with x1875263094107136 ext(143360->180223) 00002000:00010000:3.0:1788391146.003151:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691830e00 00000100:00100000:2.0:1788391146.011130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.011245:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107264 00000100:00100000:1.0:1788391146.011258:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107264 00002000:00100000:1.0:1788391146.011328:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff95d68f55d880 x1875263094107264/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.011340:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d880 with x1875263094107264 ext(180224->217087) 00002000:00010000:1.0:1788391146.011347:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55d880 00000100:00100000:1.0:1788391146.011389:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788391146.011401:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094107264:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.014198:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094107264:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2787us (3072us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391146.014225:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00002000:00100000:1.0:1788391146.014238:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff95d68f55d880 x1875263094107264/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.014246:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55d880 with x1875263094107264 ext(180224->217087) 00002000:00010000:1.0:1788391146.014252:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55d880 00000100:00100000:2.0:1788391146.019448:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.021093:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107392 00000100:00100000:3.0:1788391146.021113:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107392 00002000:00100000:2.0:1788391146.021316:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff95d68f55e680 x1875263094107392/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391146.021328:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55e680 with x1875263094107392 ext(217088->253951) 00002000:00010000:2.0:1788391146.021335:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55e680 00000100:00100000:2.0:1788391146.021418:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788391146.021429:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094107392:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391146.026712:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094107392:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5267us (7261us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391146.026736:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00002000:00100000:0.0:1788391146.026753:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff95d68f55e680 x1875263094107392/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391146.026765:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55e680 with x1875263094107392 ext(217088->253951) 00002000:00010000:0.0:1788391146.026773:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55e680 00000100:00100000:0.0:1788391146.032064:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.032215:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107520 00000100:00100000:1.0:1788391146.032228:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107520 00002000:00100000:1.0:1788391146.032297:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff95d691833480 x1875263094107520/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.032310:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691833480 with x1875263094107520 ext(253952->290815) 00002000:00010000:1.0:1788391146.032316:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691833480 00000100:00100000:1.0:1788391146.032357:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391146.032368:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2358:x1875263094107520:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.037003:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2358:x1875263094107520:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 4579us (4896us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391146.037023:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00002000:00100000:1.0:1788391146.037040:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff95d691833480 x1875263094107520/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.037052:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691833480 with x1875263094107520 ext(253952->290815) 00002000:00010000:1.0:1788391146.037060:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691833480 00000100:00100000:2.0:1788391146.043119:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.043242:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107648 00000100:00100000:0.0:1788391146.043256:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107648 00002000:00100000:0.0:1788391146.043328:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff95d68f55df80 x1875263094107648/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391146.043341:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55df80 with x1875263094107648 ext(290816->327679) 00002000:00010000:0.0:1788391146.043366:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55df80 00000100:00100000:0.0:1788391146.043410:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788391146.043423:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107648:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.049149:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094107648:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5711us (6026us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391146.049167:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00002000:00100000:1.0:1788391146.049200:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff95d68f55df80 x1875263094107648/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.049212:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55df80 with x1875263094107648 ext(290816->327679) 00002000:00010000:1.0:1788391146.049220:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55df80 00000100:00100000:0.0:1788391146.054244:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.054410:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107776 00000100:00100000:1.0:1788391146.054424:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107776 00002000:00100000:1.0:1788391146.054491:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff95d691832d80 x1875263094107776/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.054503:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832d80 with x1875263094107776 ext(327680->364543) 00002000:00010000:1.0:1788391146.054509:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832d80 00000100:00100000:1.0:1788391146.054588:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391146.054600:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094107776:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.060057:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094107776:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5438us (5810us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391146.060074:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00002000:00100000:1.0:1788391146.060091:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff95d691832d80 x1875263094107776/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.060102:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832d80 with x1875263094107776 ext(327680->364543) 00002000:00010000:1.0:1788391146.060110:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691832d80 00000100:00100000:0.0:1788391146.064746:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.064830:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094107904 00000100:00100000:1.0:1788391146.064845:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094107904 00002000:00100000:1.0:1788391146.064920:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff95d691831180 x1875263094107904/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.064943:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831180 with x1875263094107904 ext(364544->401407) 00002000:00010000:1.0:1788391146.065005:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691831180 00000100:00100000:1.0:1788391146.065040:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1788391146.065052:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094107904:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.067263:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094107904:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2200us (2520us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788391146.067276:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00002000:00100000:1.0:1788391146.067287:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff95d691831180 x1875263094107904/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/440 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.067296:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831180 with x1875263094107904 ext(364544->401407) 00002000:00010000:1.0:1788391146.067302:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691831180 00000100:00100000:2.0:1788391146.072678:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.072800:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094108032 00000100:00100000:1.0:1788391146.072920:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094108032 00002000:00100000:1.0:1788391146.073025:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff95d68f55c380 x1875263094108032/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/0 e 0 to 0 dl 1788391157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.073038:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55c380 with x1875263094108032 ext(401408->409599) 00002000:00010000:1.0:1788391146.073046:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55c380 00000100:00100000:1.0:1788391146.073084:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391146.073096:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094108032:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391146.073753:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094108032:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 653us (1086us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1788391146.073764:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00002000:00100000:1.0:1788391146.073772:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff95d68f55c380 x1875263094108032/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:7/0 lens 488/8632 e 0 to 0 dl 1788391157 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391146.073913:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55c380 with x1875263094108032 ext(401408->409599) 00002000:00010000:1.0:1788391146.073919:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f55c380 00000100:00100000:2.0:1788391146.077502:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.077857:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094108288 00000100:00100000:1.0:1788391146.077871:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094108288 00000100:00100000:1.0:1788391146.078013:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1788391146.078028:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32903:x1875263094108288:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00080000:0.0:1788391146.078041:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788391146.078413:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:1.0:1788391146.079459:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32903:x1875263094108288:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 1424us (1960us total) trans 30064771111 rc 0/0 00000100:00100000:1.0:1788391146.079471:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000020:00080000:1.0:1788391146.079478:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391146.445292:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391146.678132:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391146.678451:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094108544 00000100:00100000:2.0:1788391146.678465:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094108544 00000100:00100000:2.0:1788391146.678563:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1788391146.678575:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32902:x1875263094108544:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391146.678934:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094108544:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 360us (814us total) trans 30064771112 rc 0/0 00000100:00100000:2.0:1788391146.678943:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:0.0:1788391146.679493:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391146.682740:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.682864:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094108672 00000100:00100000:0.0:1788391146.682878:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094108672 00000100:00100000:0.0:1788391146.682999:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1788391146.683012:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094108672:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391146.683043:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391146.683069:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd369c2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd38 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683156:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683174:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683188:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683207:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683214:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683239:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683557:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683567:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683575:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391146.683616:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:0.0:1788391146.683620:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391146.683642:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683656:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683665:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683672:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683679:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683686:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.683691:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683705:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683720:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391146.683723:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.683729:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683735:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd369c9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683749:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683756:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683761:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683766:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.683768:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683774:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683781:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff95d6a0d59500) 00010000:00010000:0.0:1788391146.683783:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.683786:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683800:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd369d0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683838:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd369c2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd38 expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683852:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd38 expref: 20 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.683860:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:0.0:1788391146.683862:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391146.683864:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391146.683958:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094108672:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 948us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391146.684018:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788391146.690903:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.691030:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094108928 00000100:00100000:3.0:1788391146.691059:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094108928 00000100:00100000:3.0:1788391146.691142:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788391146.691155:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094108928:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788391146.691229:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391146.691267:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd369d7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd38 expref: 20 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691293:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391146.691299:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391146.691344:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691361:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691373:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691388:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691396:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691403:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691732:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691743:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.691756:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391146.692702:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].3, 64 off8408 00000004:00080000:3.0:1788391146.692712:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 963799751135ns, next at 964799748671ns, rc = 0 00010000:00010000:3.0:1788391146.692785:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692797:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692805:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692811:0:42646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692816:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692820:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692841:0:42646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391146.692863:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692866:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692870:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692879:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.692883:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692889:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692901:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:3.0:1788391146.692904:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788391146.692908:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692913:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd369ec lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692946:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692953:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.692958:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693366:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391146.693375:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693388:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391146.693392:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693399:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693419:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:2.0:1788391146.693422:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391146.693426:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693431:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd369f3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.693444:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391146.693446:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391146.693448:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391146.693700:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.693703:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.693709:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.693728:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.693731:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.693734:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.693740:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd369de lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391146.693752:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002719e6a1 reply state 0000000019334616 transno 30064771113 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391146.693762:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391146.693880:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094108928:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 2724us (2990us total) trans 30064771113 rc 0/0 00000100:00100000:3.0:1788391146.693888:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788391146.698187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.698280:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094109056 00000100:00100000:0.0:1788391146.698293:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094109056 00010000:00010000:3.0:1788391146.698329:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.698346:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.698355:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.698363:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.698368:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.698377:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391146.698387:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1788391146.698403:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094109056:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391146.698421:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff95d686a70100) 00010000:00010000:3.0:1788391146.698427:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.698432:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698436:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391146.698443:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd369e5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698470:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd369fa lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd3f expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698553:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698569:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698590:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698607:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698615:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698621:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698689:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698696:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698702:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698708:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.698711:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698717:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698725:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391146.698728:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.698731:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698744:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a01 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698757:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698764:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698769:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698775:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.698778:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698784:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698792:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff95d6a0d59500) 00010000:00010000:0.0:1788391146.698794:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.698797:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698803:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a08 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698842:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd369fa lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd3f expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698865:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391146.698867:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.698871:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd369fa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd3f expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.698881:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391146.699002:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094109056:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 602us (829us total) trans 0 rc 301/301 00000100:00100000:0.0:1788391146.699010:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391146.701123:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.701208:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094109184 00000100:00100000:3.0:1788391146.701222:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094109184 00000100:00100000:3.0:1788391146.701289:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1788391146.701301:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094109184:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391146.701334:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391146.701357:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a0f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd46 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701433:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701449:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701472:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701491:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701498:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701521:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701586:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701595:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701602:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701608:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.701613:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701621:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701634:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.701638:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.701643:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701649:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36a16 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701663:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701670:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701682:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701688:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.701691:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701698:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701706:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff95d686a70800) 00010000:00010000:3.0:1788391146.701708:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.701711:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701717:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36a1d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701754:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a0f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd46 expref: 21 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701764:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.701767:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.701771:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a0f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd46 expref: 21 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.701782:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:3.0:1788391146.701858:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094109184:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 558us (748us total) trans 0 rc 301/301 00000100:00100000:3.0:1788391146.701875:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1788391146.708196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.708255:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094109440 00000100:00100000:3.0:1788391146.708271:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094109440 00000100:00100000:3.0:1788391146.708358:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391146.708372:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094109440:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391146.708400:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391146.708428:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36a24 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd4d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708597:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708618:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708632:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708648:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708656:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.708663:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709587:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709615:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709626:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391146.709641:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788391146.709675:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709682:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709690:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709696:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.709702:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709711:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709726:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.709730:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.709735:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.709742:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36a2b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391146.709757:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000772e0bcf reply state 00000000b33b7847 transno 30064771114 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391146.709775:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391146.709815:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36a24 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 23 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.710284:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 22 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.710294:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391146.710297:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788391146.710300:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391146.710395:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094109440:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 2025us (2210us total) trans 30064771114 rc 0/0 00000100:00100000:3.0:1788391146.710405:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00010000:00010000:3.0:1788391146.712214:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712234:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712242:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712248:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.712254:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712378:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712423:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff95d686a70100) 00010000:00010000:3.0:1788391146.712427:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.712432:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.712439:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36a32 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391146.715204:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.715289:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094109696 00000100:00100000:3.0:1788391146.715304:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094109696 00000100:00100000:3.0:1788391146.715383:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788391146.715397:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094109696:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788391146.715838:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.715859:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.715873:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391146.715939:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771115 00000004:00010000:3.0:1788391146.715995:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006fb46a4 reply state 000000006d1576d4 transno 30064771116 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391146.716006:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391146.716121:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094109696:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 726us (932us total) trans 30064771116 rc 0/0 00000100:00100000:3.0:1788391146.716130:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000020:00080000:3.0:1788391146.716143:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788391146.718261:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718282:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718291:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718298:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.718304:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718313:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718335:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391146.718339:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.718344:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.718351:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a47 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391146.726767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.727059:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094109952 00000100:00100000:0.0:1788391146.727074:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094109952 00000100:00100000:0.0:1788391146.727153:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1788391146.727166:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094109952:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391146.727201:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391146.727231:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36a4e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd54 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727392:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727409:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727421:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727438:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727463:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.727470:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728316:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728331:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728340:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391146.728354:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 0 00010000:00010000:0.0:1788391146.728388:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728396:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728403:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728409:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.728414:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728423:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728452:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391146.728455:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.728461:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728467:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a55 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391146.728484:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090b60b5a reply state 000000006072094d transno 30064771117 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391146.728494:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391146.728534:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36a4e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728548:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.728555:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391146.728557:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788391146.728560:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391146.728658:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32902:x1875263094109952:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1494us (1904us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1788391146.728667:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00010000:00010000:3.0:1788391146.730782:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730802:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730810:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730842:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.730848:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730856:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730877:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff95d6a0d59500) 00010000:00010000:3.0:1788391146.730879:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.730883:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.730890:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a5c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391146.733685:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.733789:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094110208 00000100:00100000:3.0:1788391146.733803:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094110208 00000100:00100000:3.0:1788391146.733884:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788391146.733897:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094110208:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788391146.734610:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.734633:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.734645:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391146.734705:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771118 00000004:00010000:3.0:1788391146.734752:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071dc3c4e reply state 000000004d32bee3 transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391146.734762:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391146.734879:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32902:x1875263094110208:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 982us (1208us total) trans 30064771119 rc 0/0 00000100:00100000:3.0:1788391146.734887:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000020:00080000:3.0:1788391146.734894:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788391146.736542:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736558:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736566:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736572:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.736577:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736584:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736603:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391146.736606:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.736611:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.736617:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a71 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391146.740288:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.740581:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094110464 00000100:00100000:0.0:1788391146.740594:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094110464 00000100:00100000:0.0:1788391146.740670:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788391146.740682:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094110464:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391146.740730:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391146.740755:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36a78 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd5b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740849:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740866:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740879:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740895:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740902:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.740908:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741099:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a8d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741109:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a8d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741116:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a8d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391146.741127:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:0.0:1788391146.741266:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741275:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741282:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741289:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.741294:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741303:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741319:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391146.741322:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.741328:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741335:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36a7f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741352:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741359:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741366:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741382:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391146.741386:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741392:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741400:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391146.741403:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391146.741405:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741411:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36a86 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741460:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36a78 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd5b expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741475:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a8d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd5b expref: 12 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.741483:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391146.741486:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391146.741489:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788391146.741650:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+12:32907:x1875263094110464:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 969us (1375us total) trans 30064771120 rc 0/0 00000100:00100000:0.0:1788391146.741745:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788391146.747663:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.747764:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094110720 00000100:00100000:3.0:1788391146.747783:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094110720 00000100:00100000:3.0:1788391146.747928:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788391146.747943:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+12:32907:x1875263094110720:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391146.748023:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391146.748052:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a9b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd62 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748159:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748176:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748191:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748209:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748226:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748234:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748385:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ab0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748394:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ab0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748402:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ab0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391146.748422:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:3.0:1788391146.748559:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748567:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748575:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748581:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.748586:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748595:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748610:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.748614:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.748619:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748626:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36aa2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748641:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748648:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748666:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748671:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.748675:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748681:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748689:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff95d686a70100) 00010000:00010000:3.0:1788391146.748692:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.748695:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748702:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36aa9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748758:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36a9b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd62 expref: 15 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748773:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ab0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd62 expref: 14 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.748780:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391146.748783:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391146.748785:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:3.0:1788391146.748870:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+14:32907:x1875263094110720:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 931us (1221us total) trans 30064771121 rc 0/0 00000100:00100000:3.0:1788391146.748888:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1788391146.752045:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391146.752141:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094110976 00000100:00100000:0.0:1788391146.752155:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094110976 00000100:00100000:0.0:1788391146.752238:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788391146.752251:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+14:32907:x1875263094110976:12345-192.168.202.1@tcp:103:mmap_sanity.0 00010000:00010000:0.0:1788391146.752272:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391146.752303:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36a8d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd5b expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391146.752327:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391146.752332:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391146.752407:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32907:x1875263094110976:12345-192.168.202.1@tcp:103:mmap_sanity.0 Request processed in 158us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391146.752415:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788391146.754717:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391146.754904:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111104 00000100:00100000:2.0:1788391146.754916:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111104 00000100:00100000:2.0:1788391146.755141:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788391146.755155:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32907:x1875263094111104:12345-192.168.202.1@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788391146.755291:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.755311:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.755321:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.755367:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.755404:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 27 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391146.755423:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103452288:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391146.755536:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391146.758552:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103452288:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391146.758597:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391146.759367:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.760095:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111232 00000100:00100000:3.0:1788391146.760111:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111232 00010000:00010000:2.0:1788391146.760291:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 28 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391146.760379:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391146.760392:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2357:x1875263094111232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391146.760411:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391146.760420:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 28 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760434:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 28 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760461:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36a63 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd54 expref: 28 pid: 43348 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760483:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391146.760490:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760501:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760527:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391146.760571:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391146.760648:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094111232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 258us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391146.760656:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:1.0:1788391146.761210:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.761221:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391146.761659:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].2, 136 off8464 00000100:00100000:1.0:1788391146.761781:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32907:x1875263094111104:12345-192.168.202.1@tcp:58:mmap_sanity.0 Request processed in 6618us (7076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391146.761791:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788391146.763512:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.763693:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111360 00000100:00100000:1.0:1788391146.763714:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111360 00000100:00100000:1.0:1788391146.763792:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788391146.763805:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32907:x1875263094111360:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391146.763838:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391146.763865:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd69 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.763948:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.763997:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.764021:0:42646:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.764038:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.764054:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391146.764057:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391146.764061:0:42646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.764071:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdde00, rc 0) 00000100:00100000:1.0:1788391146.764133:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+14:32907:x1875263094111360:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 331us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391146.764141:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000040:00080000:1.0:1788391146.957680:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1788391146.957694:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391146.957741:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:1.0:1788391146.957761:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391146.957764:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391146.957801:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:1.0:1788391146.957805:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:1.0:1788391146.958518:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103452416:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788391146.958738:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391146.965129:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103452416:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788391146.967065:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.967369:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111488 00000100:00100000:3.0:1788391146.967383:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111488 00000100:00100000:3.0:1788391146.967497:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391146.967510:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32908:x1875263094111488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391146.967559:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391146.967716:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32908:x1875263094111488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 209us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391146.967724:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391146.970720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.971106:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111616 00000100:00100000:1.0:1788391146.971120:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111616 00000100:00100000:1.0:1788391146.971462:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1788391146.971476:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32908:x1875263094111616:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788391146.971576:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971599:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971615:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971635:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971643:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971671:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971701:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971766:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971783:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391146.971837:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:1.0:1788391146.971843:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391146.971864:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971880:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971887:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971895:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971901:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391146.971906:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971915:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971945:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:1.0:1788391146.971949:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391146.971955:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.971989:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd36acc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972007:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972014:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972020:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972026:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391146.972029:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972036:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972044:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x20b1fb9b (ffff95d6a0d29800) 00010000:00010000:1.0:1788391146.972046:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391146.972050:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972055:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd36ad3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972083:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972089:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972094:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972098:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391146.972101:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972107:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972114:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391146.972117:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391146.972119:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.972124:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd36ada lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391146.972235:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32908:x1875263094111616:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 759us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391146.972244:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391146.974877:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.975052:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094111872 00000100:00100000:1.0:1788391146.975065:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094111872 00000100:00100000:1.0:1788391146.975138:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788391146.975168:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32908:x1875263094111872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391146.975197:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391146.975222:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36ae1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd70 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975350:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975369:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975383:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391146.975395:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:1.0:1788391146.975521:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975530:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975538:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975545:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391146.975549:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975558:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975573:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391146.975585:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391146.975590:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975598:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36ae8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975648:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36ae1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd70 expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975660:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:1.0:1788391146.975662:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391146.975667:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd36ae1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd70 expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.975676:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd800, rc 0) 00000100:00100000:1.0:1788391146.975760:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32908:x1875263094111872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 594us (897us total) trans 30064771122 rc 301/301 00000100:00100000:1.0:1788391146.975768:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391146.979199:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.979338:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094112000 00000100:00100000:3.0:1788391146.979351:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094112000 00000100:00100000:3.0:1788391146.979426:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788391146.979439:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32908:x1875263094112000:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391146.979489:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391146.979625:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32908:x1875263094112000:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391146.979635:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788391146.984835:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.985095:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094112256 00000100:00100000:1.0:1788391146.985108:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094112256 00000100:00100000:1.0:1788391146.985181:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788391146.985195:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32908:x1875263094112256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391146.985222:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391146.985248:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36af6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd77 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391146.985881:0:43348:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xa5:0x0], count =29 00000004:00080000:1.0:1788391146.985904:0:43348:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xa5:0x0]+29 in llog 00000004:00080000:1.0:1788391146.986007:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc2:0x0], index 1: 0 00010000:00010000:1.0:1788391146.986257:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36afd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.986275:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36afd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.986290:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36afd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.986363:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36af6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd77 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.986386:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36afd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd77 expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.986396:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391146.986399:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391146.986403:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391146.986482:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32908:x1875263094112256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1289us (1665us total) trans 30064771123 rc 0/0 00000100:00100000:1.0:1788391146.986491:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1788391146.994230:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391146.994321:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094112512 00000100:00100000:3.0:1788391146.994334:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094112512 00000100:00100000:3.0:1788391146.994405:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788391146.994416:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32908:x1875263094112512:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391146.994513:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391146.994546:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36afd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd77 expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994570:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:3.0:1788391146.994582:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391146.994612:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994628:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994638:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994652:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994659:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994665:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994751:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994758:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994764:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994784:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.994790:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994798:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.994807:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391146.994810:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.994813:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995131:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36b0b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995146:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995153:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995159:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995164:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391146.995167:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995173:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995192:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x992c2132 (ffff95d686a70f00) 00010000:00010000:3.0:1788391146.995194:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391146.995197:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391146.995203:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b12 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x992c2132 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391146.995693:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32908:x1875263094112512:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1270us (1470us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391146.995709:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1788391146.998063:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391146.998301:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094112640 00000100:00100000:1.0:1788391146.998314:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094112640 00000100:00100000:1.0:1788391146.998379:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788391146.998389:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32908:x1875263094112640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391146.998412:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391146.998438:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36b19 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd7e expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998498:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998513:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998526:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998635:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36b19 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998654:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391146.998664:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391146.998667:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391146.998670:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:1.0:1788391146.998749:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32908:x1875263094112640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 360us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391146.998756:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391147.002193:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.002323:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094112896 00000100:00100000:1.0:1788391147.002336:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094112896 00000100:00100000:1.0:1788391147.002413:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1788391147.002427:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32908:x1875263094112896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391147.002540:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.002586:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.002601:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391147.003270:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].2, 88 off8344 00000004:00080000:1.0:1788391147.003285:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 964110323708ns, next at 965110320869ns, rc = 0 00000004:00010000:1.0:1788391147.003390:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2625c30 reply state 00000000bd7e4430 transno 30064771124 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.003401:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391147.003543:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32908:x1875263094112896:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1116us (1363us total) trans 30064771124 rc 0/0 00000100:00100000:1.0:1788391147.003552:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00010000:00010000:3.0:1788391147.007181:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007205:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007214:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007220:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.007227:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007236:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007257:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391147.007260:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788391147.007265:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.007271:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36b27 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391147.008206:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391147.008318:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113024 00000100:00100000:0.0:1788391147.008332:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113024 00000100:00100000:0.0:1788391147.008408:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1788391147.008422:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32908:x1875263094113024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391147.008457:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391147.008485:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd85 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.008593:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.008612:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.008634:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391147.008638:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391147.008641:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788391147.008723:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32908:x1875263094113024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 304us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391147.008731:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391147.011788:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.012001:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113152 00000100:00100000:1.0:1788391147.012015:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113152 00000100:00100000:1.0:1788391147.012094:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391147.012109:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094113152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788391147.012548:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094113152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 442us (783us total) trans 30064771074 rc 0/0 00000100:00100000:1.0:1788391147.012557:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:0.0:1788391147.012650:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391147.015537:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.015696:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113408 00000100:00100000:1.0:1788391147.015708:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113408 00000100:00100000:1.0:1788391147.015782:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391147.015794:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32908:x1875263094113408:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391147.016358:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32908:x1875263094113408:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 561us (831us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1788391147.016386:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391147.019118:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.019236:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113664 00000100:00100000:1.0:1788391147.019250:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113664 00000100:00100000:1.0:1788391147.019357:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788391147.019369:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32908:x1875263094113664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391147.019511:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32908:x1875263094113664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 144us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.019521:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788391147.021622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.022362:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113792 00000100:00100000:2.0:1788391147.022377:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113792 00000100:00100000:2.0:1788391147.022446:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:2.0:1788391147.022458:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32908:x1875263094113792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391147.022483:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391147.022510:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36b35 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd8c expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.022631:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.022654:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.022667:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391147.023144:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391147.023169:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.023208:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36b35 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd8c expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.023230:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd8c expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.023239:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391147.023243:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788391147.023247:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391147.023428:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32908:x1875263094113792:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 970us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391147.023436:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788391147.026350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.026426:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094113920 00000100:00100000:1.0:1788391147.026439:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094113920 00000100:00100000:1.0:1788391147.026517:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391147.026529:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094113920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391147.026552:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391147.026583:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd93 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391147.026617:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aeeb, blocks: 0x1 00010000:00010000:1.0:1788391147.026641:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=964s v=(0 0) 00010000:00010000:1.0:1788391147.026646:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.026657:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 7 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.026682:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 7 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.026725:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7000, rc 0) 00000100:00100000:1.0:1788391147.027141:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094113920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 611us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.027149:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788391147.029906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391147.030142:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114176 00000100:00100000:3.0:1788391147.030155:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114176 00000100:00100000:3.0:1788391147.030230:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788391147.030243:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32908:x1875263094114176:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391147.030377:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32908:x1875263094114176:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 136us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391147.030386:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788391147.034636:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.034745:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114304 00000100:00100000:1.0:1788391147.034758:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114304 00000100:00100000:1.0:1788391147.034840:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788391147.034853:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32908:x1875263094114304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391147.034876:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391147.034901:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffd9a expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.034999:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.035011:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.035017:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.035022:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.035068:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.035084:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.035123:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103452544:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391147.035219:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391147.038231:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103452544:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391147.038284:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.038308:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7a00, rc 0) 00000100:00100000:1.0:1788391147.038389:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:32908:x1875263094114304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3537us (3767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.038400:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788391147.040910:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.041116:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114432 00000100:00100000:1.0:1788391147.041130:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114432 00010000:00010000:1.0:1788391147.041186:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.041239:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788391147.041251:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094114432:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391147.041270:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391147.041301:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.041319:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.041380:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd93 expref: 8 pid: 43328 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.041402:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.041407:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.041418:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.041428:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.041477:0:42630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.041495:0:42630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103452672:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391147.041608:0:42630:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391147.047888:0:42630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103452672:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391147.047927:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391147.048285:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094114432:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 7033us (7385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391147.048300:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1788391147.050622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.050955:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114560 00000100:00100000:1.0:1788391147.051054:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114560 00002000:00100000:0.0:1788391147.051188:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff95d682e96d80 x1875263094114560/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788391147.051199:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96d80 with x1875263094114560 ext(0->409599) 00002000:00010000:0.0:1788391147.051205:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d682e96d80 00000100:00100000:0.0:1788391147.051274:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391147.051286:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094114560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391147.060429:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094114560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9127us (9799us total) trans 30064771075 rc 0/0 00000100:00100000:1.0:1788391147.060447:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00002000:00100000:1.0:1788391147.060462:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff95d682e96d80 x1875263094114560/t30064771075(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:8/0 lens 488/448 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788391147.060487:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e96d80 with x1875263094114560 ext(0->409599) 00002000:00010000:1.0:1788391147.060495:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d682e96d80 00000100:00100000:0.0:1788391147.063849:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.063953:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114688 00000100:00100000:2.0:1788391147.064003:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114688 00000100:00100000:2.0:1788391147.064089:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788391147.064102:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32908:x1875263094114688:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788391147.089445:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771120 is committed 00000001:00080000:1.0:1788391147.089466:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771117 is committed 00000001:00080000:1.0:1788391147.089478:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771125 is committed 00000004:00080000:1.0:1788391147.089492:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788391147.089540:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d683065900 refcount 2 committed 0 result 0 batchid 25769803897 00000020:00080000:1.0:1788391147.089547:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6830653c0 00000020:00080000:1.0:1788391147.089552:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5810b9800 00000001:00080000:1.0:1788391147.089580:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771121 is committed 00000004:00080000:1.0:1788391147.089611:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788391147.089636:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803897 committed batchid 21474836520 00000100:00100000:0.0:1788391147.089710:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103452800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788391147.089822:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788391147.089865:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000100:00100000:0.0:1788391147.089896:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103452800 00000100:00100000:0.0:1788391147.089905:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103452800 00000100:00100000:1.0:1788391147.089986:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103452928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391147.090028:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391147.090181:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103452928 00000100:00100000:0.0:1788391147.090186:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103452928 00000100:00100000:0.0:1788391147.090225:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788391147.090234:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103452800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391147.090276:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32908:x1875263094114688:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 26172us (26452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391147.090288:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00002000:00010000:0.0:1788391147.090387:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:0.0:1788391147.090390:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788391147 00002000:00010000:0.0:1788391147.090392:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391147.090394:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788391147 -> 1788391147 00002000:00010000:0.0:1788391147.090396:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391147.090411:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788391147.090423:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103452928:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788391147.090436:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103452800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (615us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1788391147.090442:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00002000:00080000:1.0:1788391147.090445:0:43328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:194 count 1 00000100:00080000:0.0:1788391147.090460:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391147.090464:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391147.090475:0:43328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.090502:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 5 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.090512:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788391147.090537:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391147.090543:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.090575:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 5 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.090591:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 5 pid: 43327 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.090605:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103453056:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391147.090652:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391147.090746:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:3.0:1788391147.090767:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d691833100 x1875263103452800/t30064771076(30064771076) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788391163 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788391147.090780:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d691833100/2, rc 0, transno 30064771076 00000100:00100000:3.0:1788391147.090785:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103452800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391147.093458:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.093835:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103453056:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391147.093870:0:43328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391147.094008:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114816 00000100:00100000:2.0:1788391147.094037:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114816 00010000:00010000:2.0:1788391147.094092:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391147.094141:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788391147.094153:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2358:x1875263094114816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391147.094170:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391147.094177:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094191:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094223:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006148567/0x9aafc5f04cd369bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd31 expref: 6 pid: 43327 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094243:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391147.094249:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391147.094257:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094268:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094303:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391147.094309:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.094379:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094114816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 227us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391147.094397:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:2.0:1788391147.094464:0:43328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094474:0:43328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094485:0:43328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094493:0:43328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.094520:0:43328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391147.094540:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391147.094550:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.094561:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391147.094573:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.094584:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.094609:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.094617:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36b51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.094643:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391147.094645:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391147.094647:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391147.095284:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103452928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4860us (5252us total) trans 30064771079 rc 0/0 00000100:00100000:2.0:1788391147.095296:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788391147.095318:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094114944 00000004:00080000:3.0:1788391147.095324:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68a7e4700/2, rc 0, transno 30064771079 00000100:00100000:2.0:1788391147.095324:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094114944 00000100:00100000:3.0:1788391147.095334:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68a7e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103452928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788391147.095366:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788391147.095376:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094114944:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788391147.095763:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391147.116533:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094114944:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 21146us (22214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.116548:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000001:00080000:3.0:1788391147.116616:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771076 is committed 00000001:00080000:3.0:1788391147.116628:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771075 is committed 00000100:00100000:3.0:1788391147.118665:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391147.118787:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115200 00000100:00100000:0.0:1788391147.118798:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115200 00000100:00100000:0.0:1788391147.118859:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788391147.118871:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32908:x1875263094115200:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391147.118993:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391147.119024:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd36b3c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd8c expref: 14 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.119063:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391147.119067:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391147.119100:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.119112:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.119120:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391147.119321:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb24d4b6 reply state 00000000e40293c7 transno 30064771126 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391147.119329:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391147.119429:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32908:x1875263094115200:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 560us (774us total) trans 30064771126 rc 0/0 00000100:00100000:0.0:1788391147.119434:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00010000:00010000:3.0:1788391147.121045:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121061:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121066:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121087:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.121091:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121097:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121114:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391147.121116:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391147.121118:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.121122:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36b58 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391147.121601:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.121692:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115328 00000100:00100000:2.0:1788391147.122058:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115328 00000100:00100000:2.0:1788391147.122138:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1788391147.122150:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094115328:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788391147.122460:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1788391147.122464:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788391147 -> 1788391146 00002000:00010000:2.0:1788391147.122466:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1788391146 00002000:00010000:2.0:1788391147.122468:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788391147 -> 1788391146 00002000:00010000:2.0:1788391147.122469:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:2.0:1788391147.122532:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094115328:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 384us (937us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788391147.122540:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391147.125845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.125982:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115584 00000100:00100000:1.0:1788391147.125996:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115584 00000100:00100000:1.0:1788391147.126063:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1788391147.126075:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32908:x1875263094115584:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788391147.126163:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.126203:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.126213:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.126258:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.126269:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 14 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.126283:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103453184:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391147.126374:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391147.128064:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103453184:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391147.128103:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391147.128669:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391147.128785:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115712 00000100:00100000:0.0:1788391147.128794:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115712 00010000:00010000:0.0:1788391147.128851:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391147.128900:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788391147.128912:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094115712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391147.128942:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391147.128950:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129017:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129045:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36b20 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd7e expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129065:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391147.129070:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129081:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129090:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.129126:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391147.129198:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094115712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 287us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391147.129208:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:1.0:1788391147.129375:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129384:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129419:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129426:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129442:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129448:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391147.129453:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129462:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129471:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391147.129475:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788391147.129478:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.129484:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b5f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.129528:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32908:x1875263094115584:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3455us (3697us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788391147.129537:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788391147.133580:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391147.134089:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115840 00000100:00100000:0.0:1788391147.134102:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115840 00000100:00100000:0.0:1788391147.134169:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788391147.134182:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094115840:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788391147.134246:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.134301:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.134310:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391147.134314:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391147.134320:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.134367:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391147.134385:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 7 pid: 43326 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391147.134404:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103453312:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391147.134565:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391147.138135:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.138536:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103453312:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391147.138574:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.139058:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094115968 00000100:00100000:1.0:1788391147.139069:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094115968 00010000:00010000:1.0:1788391147.139121:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.139224:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391147.139235:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094115968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391147.139280:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391147.139316:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.139330:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.139360:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009987e6e8/0x9aafc5f04cd36b4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd9a expref: 8 pid: 43326 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.139378:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391147.139383:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391147.139390:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.139402:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.139436:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391147.139500:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094115968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 266us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.139508:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:2.0:1788391147.139566:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139577:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139604:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139614:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139622:0:43327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139636:0:43327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391147.139641:0:43327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139651:0:43327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139663:0:43327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.139670:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd36b66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391147.139722:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094115840:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5543us (6155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391147.139729:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788391147.146744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.146933:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116224 00000100:00100000:1.0:1788391147.146946:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116224 00000100:00100000:1.0:1788391147.147195:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788391147.147209:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32908:x1875263094116224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788391147.147341:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.147364:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.147378:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.148148:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.148168:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.148176:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.148222:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.148238:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 14 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391147.148255:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103453440:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391147.148433:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391147.151170:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.151310:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103453440:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391147.151341:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391147.151530:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116352 00000100:00100000:2.0:1788391147.151538:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116352 00010000:00010000:2.0:1788391147.151581:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391147.151674:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391147.151687:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094116352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391147.151750:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391147.151765:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.151782:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.151804:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36b2e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd85 expref: 15 pid: 43348 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.151895:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391147.151900:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.151909:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.151925:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.152033:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391147.152102:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094116352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 413us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391147.152110:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:1.0:1788391147.152155:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.152163:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391147.152394:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771127 00000001:00080000:1.0:1788391147.152521:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771128 00000001:00080000:1.0:1788391147.152554:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771129 00000100:00100000:1.0:1788391147.152637:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103453568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788391147.155032:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391147.155366:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391147.155494:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103453568 00000100:00100000:2.0:1788391147.155506:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103453568 00000100:00100000:2.0:1788391147.155630:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788391147.155644:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103453568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391147.156088:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103453568:12345-0@lo:1000:mdt00_002.0 Request processed in 446us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391147.156109:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788391147.156261:0:42646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:3.0:1788391147.156270:0:42646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d691833100, transno 30064771076 00000100:00100000:3.0:1788391147.156329:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103453568:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788391147.166200:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771130 00000100:00100000:3.0:1788391147.166335:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103453696:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788391147.166425:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391147.166473:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788391147.166737:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103453696 00000100:00100000:0.0:1788391147.166747:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103453696 00000100:00100000:0.0:1788391147.166909:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788391147.166934:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103453696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391147.167220:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42646:x1875263103453696:12345-0@lo:1000:mdt00_002.0 Request processed in 290us (794us total) trans 30064771078 rc 0/0 00000100:00100000:3.0:1788391147.167363:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103453696:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788391147.167423:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167435:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167443:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167448:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.167454:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167462:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167483:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391147.167486:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391147.167491:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167498:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36b74 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167536:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167542:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167548:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167564:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.167568:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167574:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167583:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391147.167586:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391147.167595:0:42646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167609:0:42646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167619:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.167651:0:42646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391147.167664:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103453824:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788391147.167750:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788391147.169719:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103453824:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391147.169757:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.169936:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd36abe lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170000:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170017:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170031:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170043:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170050:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170056:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170061:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.170064:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170072:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170084:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391147.170087:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391147.170090:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170106:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36b7b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170117:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170124:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170129:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170134:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391147.170137:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170142:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170149:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391147.170151:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391147.170154:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391147.170159:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36b6d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391147.170450:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32908:x1875263094116224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 23242us (23718us total) trans 30064771131 rc 0/0 00000100:00100000:3.0:1788391147.170463:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000020:00080000:3.0:1788391147.170478:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788391147.170620:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788391147.170625:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391147.170664:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1788391147.170680:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391147.170683:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391147.170703:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:3.0:1788391147.170707:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:0.0:1788391147.171124:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788391147.172489:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391147.172554:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116480 00000100:00100000:3.0:1788391147.172565:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116480 00000100:00100000:3.0:1788391147.172628:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1788391147.172642:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094116480:12345-192.168.202.1@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1788391147.173866:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094116480:12345-192.168.202.1@tcp:49:mmap_sanity.0 Request processed in 1212us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391147.173880:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391147.174645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.174709:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116736 00000100:00100000:1.0:1788391147.174720:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116736 00000100:00100000:1.0:1788391147.174782:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788391147.174794:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32908:x1875263094116736:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788391147.175640:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788391147.175765:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771132 00010000:00010000:1.0:1788391147.175820:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175841:0:42648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175855:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175864:0:42648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175887:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175893:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.175928:0:42648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391147.176083:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32908:x1875263094116736:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1287us (1438us total) trans 30064771133 rc 0/0 00000100:00100000:1.0:1788391147.176092:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000020:00080000:1.0:1788391147.176098:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391147.176583:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391147.176592:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.176601:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391147.176606:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.176614:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.176631:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:2.0:1788391147.176635:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391147.176640:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.176647:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36b82 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391147.176669:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391147.176671:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391147.176673:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391147.177613:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.177703:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116864 00000100:00100000:1.0:1788391147.177716:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116864 00000100:00100000:1.0:1788391147.177995:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1788391147.178007:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:32907:x1875263094116864:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391147.178028:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391147.178050:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffda1 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391147.178083:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a98aeea, atime: 0x6a98aeea, ctime: 0x6a98aeea, blocks: 0x403 00010000:00010000:1.0:1788391147.178108:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=964s v=(0 0) 00010000:00010000:1.0:1788391147.178114:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391147.178124:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 6 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.178140:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 6 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391147.178168:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6400, rc 0) 00000100:00100000:1.0:1788391147.178230:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32907:x1875263094116864:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 226us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391147.178238:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00080000:0.0:1788391147.178616:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391147.180060:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.180231:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094116992 00000100:00100000:1.0:1788391147.180241:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094116992 00002000:00100000:1.0:1788391147.180298:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff95d691833b80 x1875263094116992/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.180311:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691833b80 with x1875263094116992 ext(0->4095) 00002000:00010000:1.0:1788391147.180318:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691833b80 00000100:00100000:1.0:1788391147.180349:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788391147.180357:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094116992:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391147.180597:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094116992:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 240us (547us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788391147.180605:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00002000:00100000:1.0:1788391147.180611:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff95d691833b80 x1875263094116992/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/4536 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.180620:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691833b80 with x1875263094116992 ext(0->4095) 00002000:00010000:1.0:1788391147.180623:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691833b80 00000100:00100000:3.0:1788391147.186223:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.186353:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117120 00000100:00100000:1.0:1788391147.186365:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117120 00002000:00100000:1.0:1788391147.186435:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff95d6bbcf2a00 x1875263094117120/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.186470:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf2a00 with x1875263094117120 ext(4096->8191) 00002000:00010000:1.0:1788391147.186476:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf2a00 00000100:00100000:1.0:1788391147.186557:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391147.186566:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117120:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391147.186822:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117120:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 256us (613us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788391147.186831:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00002000:00100000:1.0:1788391147.186838:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff95d6bbcf2a00 x1875263094117120/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/4536 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.186847:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf2a00 with x1875263094117120 ext(4096->8191) 00002000:00010000:1.0:1788391147.186851:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf2a00 00000100:00100000:0.0:1788391147.190547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391147.190688:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117248 00000100:00100000:3.0:1788391147.190702:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117248 00002000:00100000:3.0:1788391147.190769:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff95d691832300 x1875263094117248/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391147.190782:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832300 with x1875263094117248 ext(8192->12287) 00002000:00010000:3.0:1788391147.190790:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691832300 00000100:00100000:3.0:1788391147.190867:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391147.190877:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117248:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:2.0:1788391147.191269:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117248:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 382us (723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788391147.191286:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00002000:00100000:2.0:1788391147.191293:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff95d691832300 x1875263094117248/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/4536 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391147.191326:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691832300 with x1875263094117248 ext(8192->12287) 00002000:00010000:2.0:1788391147.191330:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691832300 00000100:00100000:0.0:1788391147.196417:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.196507:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117376 00000100:00100000:1.0:1788391147.196518:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117376 00002000:00100000:1.0:1788391147.196574:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff95d685278000 x1875263094117376/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.196584:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278000 with x1875263094117376 ext(12288->69631) 00002000:00010000:1.0:1788391147.196590:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685278000 00000100:00100000:1.0:1788391147.196633:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1788391147.196646:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117376:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:1.0:1788391147.200273:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117376:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 3604us (3846us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1788391147.200516:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00002000:00100000:1.0:1788391147.200574:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff95d685278000 x1875263094117376/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/440 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.200587:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278000 with x1875263094117376 ext(12288->69631) 00002000:00010000:1.0:1788391147.200606:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685278000 00000100:00100000:0.0:1788391147.207143:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.207314:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117504 00000100:00100000:2.0:1788391147.207329:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117504 00002000:00100000:2.0:1788391147.207400:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff95d68527b100 x1875263094117504/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391147.207415:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527b100 with x1875263094117504 ext(69632->106495) 00002000:00010000:2.0:1788391147.207422:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527b100 00000100:00100000:2.0:1788391147.207470:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391147.207482:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117504:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:2.0:1788391147.212555:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094117504:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5057us (5412us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788391147.212572:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00002000:00100000:2.0:1788391147.212590:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff95d68527b100 x1875263094117504/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/440 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391147.212603:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527b100 with x1875263094117504 ext(69632->106495) 00002000:00010000:2.0:1788391147.212611:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527b100 00000100:00100000:3.0:1788391147.219021:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391147.219108:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117632 00000100:00100000:1.0:1788391147.219126:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117632 00002000:00100000:1.0:1788391147.219282:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff95d6bbcf1880 x1875263094117632/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788391147.219296:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf1880 with x1875263094117632 ext(106496->143359) 00002000:00010000:1.0:1788391147.219303:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf1880 00000100:00100000:2.0:1788391147.219444:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391147.219460:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094117632:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391147.222180:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094117632:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2712us (3159us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391147.222195:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00002000:00100000:0.0:1788391147.222208:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff95d6bbcf1880 x1875263094117632/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/440 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391147.222218:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf1880 with x1875263094117632 ext(106496->143359) 00002000:00010000:0.0:1788391147.222224:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bbcf1880 00000100:00100000:1.0:1788391147.231003:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391147.231148:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117760 00000100:00100000:2.0:1788391147.231162:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117760 00002000:00100000:2.0:1788391147.231299:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff95d5866a3b80 x1875263094117760/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391147.231338:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5866a3b80 with x1875263094117760 ext(143360->180223) 00002000:00010000:2.0:1788391147.231346:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5866a3b80 00000100:00100000:2.0:1788391147.231388:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788391147.231399:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094117760:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:2.0:1788391147.239628:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094117760:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 8218us (8669us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788391147.239642:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00002000:00100000:2.0:1788391147.239655:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff95d5866a3b80 x1875263094117760/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/440 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391147.239666:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5866a3b80 with x1875263094117760 ext(143360->180223) 00002000:00010000:2.0:1788391147.239673:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5866a3b80 00000100:00100000:1.0:1788391147.247858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391147.248013:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094117888 00000100:00100000:0.0:1788391147.248029:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094117888 00002000:00100000:0.0:1788391147.248086:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff95d68f55ce00 x1875263094117888/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/0 e 0 to 0 dl 1788391158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391147.248106:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55ce00 with x1875263094117888 ext(180224->217087) 00002000:00010000:0.0:1788391147.248112:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55ce00 00000100:00100000:0.0:1788391147.248150:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788391147.248160:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094117888:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391147.250744:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094117888:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2576us (2891us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391147.250758:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00002000:00100000:0.0:1788391147.250769:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff95d68f55ce00 x1875263094117888/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:8/0 lens 488/440 e 0 to 0 dl 1788391158 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391147.250803:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55ce00 with x1875263094117888 ext(180224->217087) 00002000:00010000:0.0:1788391147.250809:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55ce00 00010000:00010000:1.0:1788391147.469570:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391148.493155:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391148.493422:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103453952:0@lo:400:kworker.0 00000100:00100000:0.0:1788391148.493541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391148.493557:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788391148.493639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391148.493697:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103454464:0@lo:400:kworker.0 00000100:00100000:0.0:1788391148.493748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391148.493768:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103454336:0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.493831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391148.493843:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454080 00000100:00100000:0.0:1788391148.493854:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454080 00000100:00100000:3.0:1788391148.493882:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103454208:0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.493930:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391148.494006:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454208 00000100:00100000:0.0:1788391148.494012:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454208 00000100:00100000:3.0:1788391148.494040:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454464 00000100:00100000:3.0:1788391148.494049:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454464 00000100:00100000:0.0:1788391148.494056:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788391148.494071:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.494118:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454336 00000100:00100000:3.0:1788391148.494124:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454336 00000100:00100000:0.0:1788391148.494151:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103454080:12345-0@lo:400:kworker.0 Request processed in 82us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391148.494163:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788391148.494176:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788391148.494182:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103454464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391148.494213:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788391148.494223:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.494260:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103454464:12345-0@lo:400:kworker.0 Request processed in 84us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391148.494273:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788391148.494281:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103454208:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391148.494292:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391148.494302:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788391148.494313:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.494385:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103454336:12345-0@lo:400:kworker.0 Request processed in 74us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391148.494393:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788391148.494505:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103454720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391148.494513:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103454464:0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.494548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391148.494598:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103454208:0@lo:400:kworker.0 00000100:00100000:0.0:1788391148.494605:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454720 00000100:00100000:0.0:1788391148.494612:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454720 00000100:00080000:3.0:1788391148.494638:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391148.494656:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788391148.494668:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103454720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391148.494672:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103454336:0@lo:400:kworker.0 00002000:00000024:0.0:1788391148.494705:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788391148.494761:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103454720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391148.494770:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788391148.494792:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103454720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391148.495732:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103453952 00000100:00100000:1.0:1788391148.495744:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103453952 00000100:00100000:1.0:1788391148.495808:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788391148.495818:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103453952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391148.495911:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103453952:12345-0@lo:400:kworker.0 Request processed in 80us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391148.495920:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788391148.496136:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103453952:0@lo:400:kworker.0 00000100:00100000:2.0:1788391148.500357:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788391148.500377:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103454592:0@lo:400:kworker.0 00000100:00100000:2.0:1788391148.500471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391148.501183:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103454592 00000100:00100000:3.0:1788391148.501200:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103454592 00000100:00100000:3.0:1788391148.501314:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788391148.501326:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103454592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391148.501414:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103454592:12345-0@lo:400:kworker.0 Request processed in 91us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391148.501420:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788391148.501609:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103454592:0@lo:400:kworker.0 00000100:00080000:0.0:1788391148.502293:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391148.744453:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391148.744628:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118016 00000100:00100000:0.0:1788391148.744641:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118016 00000100:00100000:0.0:1788391148.744863:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1788391148.744877:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094118016:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391148.744936:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391148.744998:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36b90 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffda8 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.745092:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36b90 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda8 expref: 20 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.745109:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36b90 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda8 expref: 20 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.745133:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391148.745136:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391148.745153:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b800, rc 0) 00000100:00100000:0.0:1788391148.745235:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094118016:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 362us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391148.745242:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00080000:1.0:1788391148.745853:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391148.749760:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391148.750158:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118144 00000100:00100000:0.0:1788391148.750167:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118144 00000100:00100000:0.0:1788391148.750240:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391148.750250:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32902:x1875263094118144:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391148.750268:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391148.750284:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdaf expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.750309:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 5 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.750315:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788391148.750319:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391148.750322:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.750348:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 5 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.750358:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 5 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391148.750368:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103454848:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391148.750442:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4eada80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391148.758501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391148.758620:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118272 00000100:00100000:2.0:1788391148.758639:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118272 00002000:00100000:2.0:1788391148.758727:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff95d6bbcf0380 x1875263094118272/t0(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:9/0 lens 488/0 e 0 to 0 dl 1788391159 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391148.758770:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0380 with x1875263094118272 ext(0->204799) 00010000:00010000:2.0:1788391148.758783:0:43332:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 6 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391148.758883:0:43332:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 6 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391148.758892:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbcf0380 00000100:00100000:2.0:1788391148.758952:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1788391148.759012:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094118272:12345-192.168.202.1@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1788391148.760714:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103454848:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391148.760751:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.760796:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391148.763368:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32902:x1875263094118144:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 13108us (13606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391148.763381:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391148.769209:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094118272:12345-192.168.202.1@tcp:4:ldlm_bl.0 Request processed in 10237us (10709us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1788391148.769221:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:0.0:1788391148.769234:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff95d6bbcf0380 x1875263094118272/t30064771079(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:9/0 lens 488/448 e 0 to 0 dl 1788391159 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391148.769245:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0380 with x1875263094118272 ext(0->204799) 00010000:00010000:0.0:1788391148.769256:0:43332:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391148.769274:0:43332:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391148.769283:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bbcf0380 00000100:00100000:3.0:1788391148.774702:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391148.774790:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118400 00000100:00100000:1.0:1788391148.774800:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118400 00010000:00010000:1.0:1788391148.774915:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391148.775024:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391148.775064:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2358:x1875263094118400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391148.775081:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788391148.775099:0:42631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788391146 -> 1788391147 00002000:00010000:1.0:1788391148.775103:0:42631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788391146 -> 1788391147 00010000:00010000:1.0:1788391148.775109:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391148.775124:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391148.775146:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba7b650/0x9aafc5f04cd36b89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda1 expref: 8 pid: 43326 timeout: 1065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391148.775163:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391148.775167:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391148.775175:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391148.775184:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391148.775220:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391148.775233:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103454976:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391148.775536:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391148.783695:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103454976:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391148.783738:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391148.783795:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2358:x1875263094118400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8733us (9099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391148.783819:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391149.258589:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391149.259101:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118528 00000100:00100000:3.0:1788391149.259112:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118528 00000100:00100000:3.0:1788391149.259236:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391149.259249:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32907:x1875263094118528:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391149.259268:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391149.259288:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdb6 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.259322:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.259330:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788391149.259334:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1788391149.259339:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.259393:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.259408:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 6 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391149.259423:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103455104:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391149.259527:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c540 going to sleep for 11 seconds 00000100:00080000:1.0:1788391149.260057:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391149.265420:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103455104:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391149.265458:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.265480:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391149.265544:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32907:x1875263094118528:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 6299us (6966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391149.265554:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391149.268216:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391149.268331:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118656 00000100:00100000:2.0:1788391149.268352:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118656 00002000:00100000:2.0:1788391149.268418:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff95d68527b800 x1875263094118656/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788391149.268430:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527b800 with x1875263094118656 ext(0->409599) 00010000:00010000:2.0:1788391149.268438:0:43331:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 7 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.268456:0:43331:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 7 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391149.268463:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d68527b800 00000100:00100000:2.0:1788391149.268491:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1788391149.268508:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094118656:12345-192.168.202.1@tcp:4:mmap_sanity.0 00000100:00080000:1.0:1788391149.269304:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391149.276118:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094118656:12345-192.168.202.1@tcp:4:mmap_sanity.0 Request processed in 7601us (7900us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788391149.276131:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:3.0:1788391149.276145:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff95d68527b800 x1875263094118656/t30064771080(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:10/0 lens 488/448 e 0 to 0 dl 1788391160 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788391149.276155:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527b800 with x1875263094118656 ext(0->409599) 00010000:00010000:3.0:1788391149.276166:0:43331:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.276195:0:43331:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391149.276204:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d68527b800 00000100:00100000:2.0:1788391149.287314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.287658:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118784 00000100:00100000:0.0:1788391149.287668:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118784 00010000:00010000:0.0:1788391149.287716:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391149.287818:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788391149.287829:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2358:x1875263094118784:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391149.287843:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788391149.287863:0:42629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788391147 -> 1788391149 00002000:00010000:0.0:1788391149.287866:0:42629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788391147 -> 1788391149 00010000:00010000:0.0:1788391149.287871:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.287884:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.287921:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c8b58db/0x9aafc5f04cd36b97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdaf expref: 9 pid: 43328 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.287938:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788391149.287943:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788391149.287952:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.288005:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.288064:0:42629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391149.288079:0:42629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:42629:1875263103455232:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391149.288165:0:42629:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391149.290566:0:42629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:42629:1875263103455232:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391149.290592:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391149.290656:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2358:x1875263094118784:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2828us (3349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391149.290668:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1788391149.293274:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.293375:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094118912 00000100:00100000:0.0:1788391149.293385:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094118912 00002000:00100000:0.0:1788391149.293437:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff95d68f321c00 x1875263094118912/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.293450:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321c00 with x1875263094118912 ext(176128->241663) 00002000:00010000:0.0:1788391149.293456:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321c00 00000100:00100000:0.0:1788391149.293489:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391149.293930:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094118912:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.297929:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094118912:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 4417us (4652us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1788391149.297944:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00002000:00100000:0.0:1788391149.297957:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff95d68f321c00 x1875263094118912/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.297995:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321c00 with x1875263094118912 ext(176128->241663) 00002000:00010000:0.0:1788391149.298002:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321c00 00000100:00100000:3.0:1788391149.309545:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391149.309701:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119040 00000100:00100000:2.0:1788391149.309711:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119040 00002000:00100000:2.0:1788391149.309776:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff95d584a0c380 x1875263094119040/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391149.309787:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0c380 with x1875263094119040 ext(241664->278527) 00002000:00010000:2.0:1788391149.309791:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0c380 00000100:00100000:2.0:1788391149.309891:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788391149.309909:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094119040:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.311993:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094119040:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2084us (2448us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391149.312015:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00002000:00100000:0.0:1788391149.312028:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff95d584a0c380 x1875263094119040/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.312039:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0c380 with x1875263094119040 ext(241664->278527) 00002000:00010000:0.0:1788391149.312045:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0c380 00000100:00100000:3.0:1788391149.326669:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.326788:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119168 00000100:00100000:0.0:1788391149.326799:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119168 00002000:00100000:0.0:1788391149.326863:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff95d584a0c000 x1875263094119168/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.326874:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0c000 with x1875263094119168 ext(278528->315391) 00002000:00010000:0.0:1788391149.326880:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0c000 00000100:00100000:0.0:1788391149.326955:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391149.326992:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2358:x1875263094119168:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.329713:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2358:x1875263094119168:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2713us (3042us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391149.329726:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00002000:00100000:0.0:1788391149.329739:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff95d584a0c000 x1875263094119168/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.329750:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0c000 with x1875263094119168 ext(278528->315391) 00002000:00010000:0.0:1788391149.329756:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0c000 00000100:00100000:2.0:1788391149.340405:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.340474:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119296 00000100:00100000:0.0:1788391149.340482:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119296 00002000:00100000:0.0:1788391149.340531:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff95d68f320a80 x1875263094119296/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.340553:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320a80 with x1875263094119296 ext(315392->352255) 00002000:00010000:0.0:1788391149.340558:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320a80 00000100:00100000:0.0:1788391149.340587:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788391149.340595:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094119296:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.343122:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094119296:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2516us (2714us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391149.343134:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00002000:00100000:0.0:1788391149.343146:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff95d68f320a80 x1875263094119296/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.343157:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320a80 with x1875263094119296 ext(315392->352255) 00002000:00010000:0.0:1788391149.343164:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320a80 00000100:00100000:3.0:1788391149.349734:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.350297:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119424 00000100:00100000:0.0:1788391149.350307:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119424 00002000:00100000:0.0:1788391149.350362:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff95d584a0f480 x1875263094119424/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.350375:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f480 with x1875263094119424 ext(352256->389119) 00002000:00010000:0.0:1788391149.350380:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f480 00000100:00100000:0.0:1788391149.350418:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391149.350429:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2358:x1875263094119424:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.356026:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2358:x1875263094119424:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5588us (6296us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391149.356037:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00002000:00100000:0.0:1788391149.356059:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff95d584a0f480 x1875263094119424/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.356067:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f480 with x1875263094119424 ext(352256->389119) 00002000:00010000:0.0:1788391149.356072:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f480 00000100:00100000:3.0:1788391149.363637:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.363772:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119552 00000100:00100000:0.0:1788391149.363782:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119552 00002000:00100000:0.0:1788391149.363829:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff95d584a0f800 x1875263094119552/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/0 e 0 to 0 dl 1788391160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.363840:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f800 with x1875263094119552 ext(389120->409599) 00002000:00010000:0.0:1788391149.363846:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f800 00000100:00100000:0.0:1788391149.363928:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391149.363939:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094119552:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391149.366868:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094119552:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2924us (3234us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1788391149.366878:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00002000:00100000:0.0:1788391149.366889:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff95d584a0f800 x1875263094119552/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:10/0 lens 488/440 e 0 to 0 dl 1788391160 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391149.366913:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f800 with x1875263094119552 ext(389120->409599) 00002000:00010000:0.0:1788391149.366919:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f800 00000100:00100000:2.0:1788391149.372313:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.372553:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119808 00000100:00100000:0.0:1788391149.372563:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119808 00000100:00100000:0.0:1788391149.372691:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1788391149.372702:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094119808:12345-192.168.202.1@tcp:103:mmap_sanity.0 00010000:00010000:0.0:1788391149.372718:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391149.372760:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ab0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd62 expref: 10 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.372779:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391149.372784:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391149.372856:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32907:x1875263094119808:12345-192.168.202.1@tcp:103:mmap_sanity.0 Request processed in 155us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391149.372864:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00080000:1.0:1788391149.372945:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391149.376310:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391149.377991:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094119936 00000100:00100000:3.0:1788391149.378007:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094119936 00000100:00100000:2.0:1788391149.378140:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:2.0:1788391149.378152:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32907:x1875263094119936:12345-192.168.202.1@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788391149.378249:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.378263:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 19 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.378286:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.378313:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 19 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.378321:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 19 pid: 42645 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391149.378332:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103455360:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391149.378414:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405840 going to sleep for 11 seconds 00000100:00100000:3.0:1788391149.383176:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103455360:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391149.383212:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391149.391507:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391149.391626:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120064 00000100:00100000:2.0:1788391149.391636:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120064 00010000:00010000:2.0:1788391149.391675:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 20 pid: 42645 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391149.391749:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391149.391760:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2356:x1875263094120064:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391149.391777:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391149.391784:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 20 pid: 42645 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391799:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 20 pid: 42645 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391822:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36a39 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd4d expref: 20 pid: 42645 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391865:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788391149.391871:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391879:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391884:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391149.391923:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391149.392028:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391149.392035:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391149.392190:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094120064:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 432us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391149.392196:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000040:00080000:3.0:1788391149.392614:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].3, 136 off8600 00000100:00100000:3.0:1788391149.392672:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32907:x1875263094119936:12345-192.168.202.1@tcp:58:mmap_sanity.0 Request processed in 14523us (16369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391149.392678:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788391149.394491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391149.395091:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120192 00000100:00100000:0.0:1788391149.395100:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120192 00000100:00100000:0.0:1788391149.395155:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788391149.395165:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32907:x1875263094120192:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391149.395187:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391149.395209:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdbd expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395272:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395283:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 10 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395304:0:42645:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395317:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 10 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395331:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391149.395347:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391149.395352:0:42645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 10 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391149.395361:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391149.395459:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094120192:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 294us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391149.395467:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00010000:00010000:3.0:1788391149.517200:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391149.517211:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391149.517233:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103455488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391149.517313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391149.517360:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103455488 00000100:00100000:3.0:1788391149.517369:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103455488 00000100:00080000:1.0:1788391149.517422:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391149.517446:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391149.517459:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103455488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391149.517500:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788391149.517578:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103455488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391149.517585:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788391149.517978:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103455488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391150.198359:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.198407:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.198435:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.198516:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.198534:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.198585:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120576 00000100:00100000:0.0:1788391150.198594:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120576 00000100:00100000:0.0:1788391150.198656:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121088 00000100:00100000:0.0:1788391150.198659:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121088 00000100:00100000:0.0:1788391150.198683:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788391150.198693:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094120576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391150.198765:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094120576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.198772:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788391150.198789:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391150.198809:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094121088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391150.198835:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2359:x1875263094121088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.198841:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:0.0:1788391150.198872:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391150.199127:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120320 00000100:00100000:1.0:1788391150.199132:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120320 00000100:00100000:1.0:1788391150.199183:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:1.0:1788391150.199191:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094120320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391150.199230:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094120320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.199237:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1788391150.201559:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120832 00000100:00100000:0.0:1788391150.201572:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120448 00000100:00100000:3.0:1788391150.201576:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120832 00000100:00100000:0.0:1788391150.201579:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120448 00000100:00080000:1.0:1788391150.201671:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391150.201724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.201724:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1788391150.201739:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:2359:x1875263094120832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391150.201761:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.201781:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120704 00000100:00100000:2.0:1788391150.201786:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120704 00000100:00100000:2.0:1788391150.201818:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094120960 00000100:00100000:2.0:1788391150.201821:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094120960 00000100:00100000:2.0:1788391150.201855:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391150.201863:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2359:x1875263094120704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391150.201928:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2359:x1875263094120704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391150.201935:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1788391150.201949:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391150.201981:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094120960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391150.202004:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094120960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391150.202010:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391150.202031:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391150.202038:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2359:x1875263094120448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391150.202063:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:2359:x1875263094120832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 326us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391150.202068:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2359:x1875263094120448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.202077:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:0.0:1788391150.202622:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391150.202716:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000040:00080000:3.0:1788391150.221467:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788391150.221476:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391150.221534:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1788391150.221555:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391150.221558:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391150.221588:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:3.0:1788391150.221592:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:3.0:1788391150.221711:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103455616:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391150.221860:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391150.225684:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103455616:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391150.227781:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.228217:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121216 00000100:00100000:3.0:1788391150.228227:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121216 00000100:00100000:3.0:1788391150.228298:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391150.228310:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094121216:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391150.228341:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391150.228470:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094121216:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 161us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.228478:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788391150.235482:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.235699:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121344 00000100:00100000:0.0:1788391150.235709:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121344 00000100:00100000:0.0:1788391150.235773:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788391150.235784:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094121344:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.235861:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235878:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235905:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235923:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235930:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235937:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.235982:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236013:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236020:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391150.236068:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:0.0:1788391150.236073:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391150.236085:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236097:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236103:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236109:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236115:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.236118:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236126:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236138:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:0.0:1788391150.236142:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.236146:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236163:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36bb3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236177:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236184:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236190:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236196:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.236199:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236205:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236212:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb6096ffe (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391150.236215:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.236217:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236223:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236237:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236243:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236255:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236260:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.236264:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236270:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236278:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391150.236280:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.236283:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.236289:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bc1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.236533:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094121344:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 749us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.236542:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788391150.241444:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.241636:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121600 00000100:00100000:3.0:1788391150.241661:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121600 00000100:00100000:3.0:1788391150.241721:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788391150.241732:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094121600:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391150.241753:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391150.241774:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36bc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdc4 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.241879:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.241906:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.241918:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391150.241930:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:3.0:1788391150.242119:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242125:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242130:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242133:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.242137:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242141:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242157:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391150.242159:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391150.242162:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242166:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36bcf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242198:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36bc8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdc4 expref: 21 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242204:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391150.242205:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391150.242208:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36bc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdc4 expref: 21 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.242214:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391150.242267:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32911:x1875263094121600:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 539us (834us total) trans 30064771134 rc 301/301 00000100:00100000:3.0:1788391150.242272:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:2.0:1788391150.246607:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.246701:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121728 00000100:00100000:0.0:1788391150.246711:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121728 00000100:00100000:0.0:1788391150.246769:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788391150.246781:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32911:x1875263094121728:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788391150.246853:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788391150.247001:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32911:x1875263094121728:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 221us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.247020:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391150.256874:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.257127:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094121984 00000100:00100000:3.0:1788391150.257137:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094121984 00000100:00100000:3.0:1788391150.257248:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788391150.257260:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32911:x1875263094121984:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391150.257282:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391150.257302:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36bdd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdcb expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391150.257845:0:42646:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc3:0x0], index 0: 0 00010000:00010000:3.0:1788391150.258086:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36be4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.258101:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36be4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.258112:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36be4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.258168:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36bdd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdcb expref: 23 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.258185:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36be4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdcb expref: 22 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.258193:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391150.258196:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391150.258200:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391150.258259:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32911:x1875263094121984:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1002us (1394us total) trans 30064771135 rc 0/0 00000100:00100000:3.0:1788391150.258267:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788391150.262733:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.262859:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094122240 00000100:00100000:0.0:1788391150.262869:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094122240 00000100:00100000:0.0:1788391150.262926:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788391150.262934:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32911:x1875263094122240:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.263162:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391150.263191:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36be4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdcb expref: 22 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263210:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d686a70800) 00010000:00010000:0.0:1788391150.263221:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391150.263243:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263255:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263263:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263276:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263282:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263287:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263652:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263659:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263663:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263666:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.263669:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263674:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263680:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391150.263682:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.263684:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263687:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36bf2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263694:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263697:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263701:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263710:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.263713:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263719:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263728:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x63363b51 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391150.263730:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.263733:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.263833:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36bf9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x63363b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.264510:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32911:x1875263094122240:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1573us (1784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788391150.264518:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788391150.270403:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.270599:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094122368 00000100:00100000:0.0:1788391150.270612:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094122368 00000100:00100000:0.0:1788391150.270731:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:0.0:1788391150.270744:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32911:x1875263094122368:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.270767:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391150.270792:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36c00 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdd2 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.270832:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.270862:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.270874:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.271024:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36c00 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 23 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.271055:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 22 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.271064:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391150.271067:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391150.271070:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788391150.271131:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32911:x1875263094122368:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 389us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.271138:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788391150.272901:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.273152:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094122624 00000100:00100000:1.0:1788391150.273162:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094122624 00000100:00100000:1.0:1788391150.273323:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:1.0:1788391150.273334:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32911:x1875263094122624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391150.273413:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.273428:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.273439:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391150.274152:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].4, 88 off8496 00000004:00080000:1.0:1788391150.274173:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 967381211686ns, next at 968381209456ns, rc = 0 00000004:00010000:1.0:1788391150.274492:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000202d8e83 reply state 000000007ef887ae transno 30064771136 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.274502:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391150.274657:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32911:x1875263094122624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1322us (1771us total) trans 30064771136 rc 0/0 00000100:00100000:1.0:1788391150.274666:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00010000:00010000:3.0:1788391150.277352:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.277369:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.277393:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.277398:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.277403:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.277410:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.277486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788391150.277509:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391150.277513:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788391150.277518:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.277525:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c0e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.277684:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094122752 00000100:00100000:1.0:1788391150.277694:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094122752 00000100:00100000:1.0:1788391150.277746:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1788391150.277756:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32911:x1875263094122752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391150.277780:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391150.277796:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdd9 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.277928:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.277942:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.278028:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391150.278032:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391150.278090:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391150.278149:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32911:x1875263094122752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 390us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.278156:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1788391150.280520:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.280586:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094122880 00000100:00100000:0.0:1788391150.280595:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094122880 00000100:00100000:0.0:1788391150.280640:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391150.280647:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094122880:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788391150.280939:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094122880:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 292us (425us total) trans 30064771080 rc 0/0 00000100:00100000:0.0:1788391150.280947:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788391150.282524:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.282881:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094123136 00000100:00100000:1.0:1788391150.282902:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094123136 00000100:00100000:1.0:1788391150.282951:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391150.282996:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32911:x1875263094123136:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391150.283201:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32911:x1875263094123136:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 240us (680us total) trans 30064771137 rc 0/0 00000100:00100000:1.0:1788391150.283208:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1788391150.285139:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.285202:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094123392 00000100:00100000:0.0:1788391150.285224:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094123392 00000100:00100000:0.0:1788391150.285273:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788391150.285283:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32911:x1875263094123392:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788391150.285384:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32911:x1875263094123392:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.285391:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:2.0:1788391150.288934:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.289002:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094123520 00000100:00100000:0.0:1788391150.289012:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094123520 00000100:00100000:0.0:1788391150.289073:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1788391150.289084:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32911:x1875263094123520:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.289103:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391150.289124:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36c1c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffde0 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289195:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289209:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289219:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391150.289253:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391150.289270:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289293:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36c1c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde0 expref: 27 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289330:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde0 expref: 26 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.289339:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391150.289342:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788391150.289347:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788391150.289406:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32911:x1875263094123520:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 325us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.289414:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788391150.300735:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.301816:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094123648 00000100:00100000:0.0:1788391150.301828:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094123648 00000100:00100000:0.0:1788391150.301906:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391150.301918:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094123648:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.301937:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391150.301958:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffde7 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391150.302028:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aeee, blocks: 0x1 00010000:00010000:0.0:1788391150.302050:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1788391150.302055:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391150.302065:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 8 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.302089:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 8 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.302127:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391150.302190:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094123648:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 275us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.302198:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788391150.304539:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.304582:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094123904 00000100:00100000:1.0:1788391150.304591:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094123904 00000100:00100000:1.0:1788391150.304642:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1788391150.304651:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32911:x1875263094123904:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391150.304746:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32911:x1875263094123904:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.304754:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788391150.309758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.309842:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124032 00000100:00100000:0.0:1788391150.309853:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124032 00000100:00100000:0.0:1788391150.309925:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788391150.309938:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:32911:x1875263094124032:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.309983:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391150.310001:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdee expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.310033:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 9 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.310042:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391150.310047:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391150.310052:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.310085:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 9 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.310098:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 9 pid: 43698 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.310132:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103455744:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391150.310236:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391150.314798:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103455744:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391150.314835:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.314855:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:3.0:1788391150.315202:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.315924:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124160 00000100:00100000:1.0:1788391150.315935:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124160 00010000:00010000:1.0:1788391150.316109:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 10 pid: 43698 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.316427:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1788391150.316440:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094124160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391150.316456:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391150.316479:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 10 pid: 43698 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.316513:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 10 pid: 43698 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.316535:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8b58db/0x9aafc5f04cd36c2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde7 expref: 10 pid: 43698 timeout: 1067 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.316551:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391150.316556:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391150.316570:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.316581:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.316618:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.316632:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103455872:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391150.316700:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788391150.317223:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:32911:x1875263094124032:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 7284us (7471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.317232:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788391150.321459:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103455872:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391150.321488:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391150.321543:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094124160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 5105us (6341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.321555:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788391150.333068:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.333185:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124288 00000100:00100000:0.0:1788391150.333196:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124288 00002000:00100000:0.0:1788391150.333248:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff95d6bc7cad80 x1875263094124288/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788391150.333257:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cad80 with x1875263094124288 ext(0->409599) 00002000:00010000:0.0:1788391150.333262:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7cad80 00000100:00100000:0.0:1788391150.333322:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391150.333329:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094124288:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391150.349697:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094124288:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 16356us (16627us total) trans 30064771081 rc 0/0 00000100:00100000:0.0:1788391150.349712:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00002000:00100000:0.0:1788391150.349727:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff95d6bc7cad80 x1875263094124288/t30064771081(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:11/0 lens 488/448 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788391150.349752:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cad80 with x1875263094124288 ext(0->409599) 00002000:00010000:0.0:1788391150.349758:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc7cad80 00000100:00100000:2.0:1788391150.352438:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.352544:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124416 00000100:00100000:0.0:1788391150.352555:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124416 00000100:00100000:0.0:1788391150.352667:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391150.352678:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32911:x1875263094124416:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788391150.374776:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771126 is committed 00000100:00100000:3.0:1788391150.374780:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32911:x1875263094124416:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 22096us (22345us total) trans 0 rc 0/0 00000001:00080000:0.0:1788391150.374788:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771137 is committed 00000004:00080000:0.0:1788391150.374793:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788391150.374815:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803897 batchid updated 00000020:00080000:0.0:1788391150.374838:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b6b3c840 refcount 2 committed 0 result 0 batchid 25769803898 00000020:00080000:0.0:1788391150.374843:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6d39c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b6b3ccc0 00000020:00080000:0.0:1788391150.374846:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6d39a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d586dad800 00000100:00100000:3.0:1788391150.374883:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000020:00080000:0.0:1788391150.374992:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803898 committed batchid 25769803897 00000100:00100000:3.0:1788391150.375046:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103456000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788391150.375099:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391150.375145:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103456000 00000100:00100000:3.0:1788391150.375152:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103456000 00000020:00080000:0.0:1788391150.375167:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000100:00100000:3.0:1788391150.375187:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788391150.375201:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103456000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788391150.375349:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1788391150.375353:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788391150 00002000:00010000:3.0:1788391150.375356:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391150.375358:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788391150 -> 1788391150 00002000:00010000:3.0:1788391150.375360:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391150.375453:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3287:x1875263103456000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (354us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1788391150.375460:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:0.0:1788391150.375497:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d68527a680/2, rc 0, transno 30064771082 00000100:00100000:0.0:1788391150.375503:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103456000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788391150.378303:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.378356:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124544 00000100:00100000:1.0:1788391150.378365:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124544 00000100:00100000:0.0:1788391150.378664:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788391150.378674:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094124544:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788391150.410441:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094124544:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 31759us (32134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.410454:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000001:00080000:1.0:1788391150.411088:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771081 is committed 00000001:00080000:1.0:1788391150.411106:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771078 is committed 00000001:00080000:1.0:1788391150.411111:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771079 is committed 00000001:00080000:1.0:1788391150.411120:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771082 is committed 00000100:00100000:2.0:1788391150.413811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.413876:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124800 00000100:00100000:0.0:1788391150.413895:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124800 00000100:00100000:0.0:1788391150.413949:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788391150.414126:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32911:x1875263094124800:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391150.414197:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391150.414225:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36c23 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffde0 expref: 14 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.414242:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391150.414247:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391150.414275:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.414289:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.414299:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391150.414484:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c3492aa reply state 000000006d054970 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.414494:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391150.414588:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:32911:x1875263094124800:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 629us (783us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1788391150.414595:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00010000:00010000:3.0:1788391150.418763:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418778:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418783:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418787:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.418790:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418795:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418809:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391150.418811:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391150.418827:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.418831:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36c38 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.428269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.428408:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094124928 00000100:00100000:0.0:1788391150.428427:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094124928 00000100:00100000:0.0:1788391150.428490:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788391150.428501:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094124928:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788391150.428762:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:0.0:1788391150.428767:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1788391150 -> 1788391146 00002000:00010000:0.0:1788391150.428769:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1788391146 00002000:00010000:0.0:1788391150.428783:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788391150 -> 1788391146 00002000:00010000:0.0:1788391150.428786:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:0.0:1788391150.428879:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094124928:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 379us (617us total) trans 30064771083 rc 0/0 00000100:00100000:0.0:1788391150.428897:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391150.437679:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.438245:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125184 00000100:00100000:1.0:1788391150.438254:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125184 00000100:00100000:1.0:1788391150.438330:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1788391150.438341:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32911:x1875263094125184:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788391150.438430:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.438448:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 14 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.438458:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.438497:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 14 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.438520:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 14 pid: 42644 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.438534:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103456128:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391150.438619:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391150.447651:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.447782:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103456128:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391150.447808:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.448644:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125312 00000100:00100000:0.0:1788391150.448652:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125312 00010000:00010000:1.0:1788391150.448831:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 15 pid: 42644 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.448937:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391150.448949:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094125312:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391150.448984:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391150.448993:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 15 pid: 42644 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449006:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 15 pid: 42644 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449028:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c07 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd2 expref: 15 pid: 42644 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449045:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391150.449050:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449060:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449067:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.449212:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391150.449275:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094125312:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 328us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.449294:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00010000:00010000:2.0:1788391150.449355:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449363:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449401:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449409:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449426:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449434:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.449438:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449445:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449462:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391150.449465:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391150.449469:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.449475:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36c3f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.449527:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32911:x1875263094125184:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 11187us (11858us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391150.449535:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1788391150.452849:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.453189:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125440 00000100:00100000:1.0:1788391150.453200:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125440 00000100:00100000:1.0:1788391150.453264:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391150.453276:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2358:x1875263094125440:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788391150.453322:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.453345:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.453354:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391150.453359:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391150.453584:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.453628:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.453644:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 7 pid: 43328 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.453660:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103456256:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391150.453860:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788391150.459603:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103456256:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391150.459646:0:43326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.461743:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.461951:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125568 00000100:00100000:1.0:1788391150.461986:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125568 00010000:00010000:1.0:1788391150.462028:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 8 pid: 43328 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.462064:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788391150.462073:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094125568:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391150.462088:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391150.462112:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 8 pid: 43328 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.462123:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 8 pid: 43328 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.462142:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd36c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdee expref: 8 pid: 43328 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.462155:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391150.462158:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391150.462162:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.462169:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.462203:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391150.462245:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094125568:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.462250:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00010000:00010000:0.0:1788391150.462305:0:43326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462312:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462331:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462336:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462341:0:43326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462345:0:43326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391150.462348:0:43326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462363:0:43326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462377:0:43326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.462382:0:43326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d31af6ba/0x9aafc5f04cd36c46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.462415:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2358:x1875263094125440:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 9143us (9578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.462420:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788391150.465184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.466145:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125824 00000100:00100000:1.0:1788391150.466156:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125824 00000100:00100000:1.0:1788391150.466257:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1788391150.466265:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32911:x1875263094125824:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788391150.466332:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.466347:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.467679:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.467955:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.467987:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.467997:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.468035:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.468063:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 14 pid: 42646 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.468077:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103456384:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391150.468225:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391150.473205:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.473310:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094125952 00000100:00100000:3.0:1788391150.473317:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094125952 00000100:00100000:1.0:1788391150.473326:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103456384:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391150.473351:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473354:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 15 pid: 42646 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.473429:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1788391150.473439:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094125952:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391150.473455:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391150.473461:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 15 pid: 42646 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473474:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 15 pid: 42646 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473496:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36c15 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdd9 expref: 15 pid: 42646 timeout: 1067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473512:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:3.0:1788391150.473517:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473526:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473550:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.473584:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391150.473647:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094125952:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 208us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.473655:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00010000:00010000:1.0:1788391150.473716:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.473724:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391150.474660:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771139 00000001:00080000:1.0:1788391150.475066:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771140 00000001:00080000:1.0:1788391150.475114:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771141 00000100:00100000:1.0:1788391150.475204:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103456512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788391150.475263:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391150.475290:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a347e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391150.475363:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103456512 00000100:00100000:2.0:1788391150.475370:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103456512 00000100:00100000:2.0:1788391150.475422:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788391150.475432:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103456512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391150.475504:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103456512:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391150.475511:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788391150.475545:0:42645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771082 gen 2 00000004:00080000:2.0:1788391150.475550:0:42645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771082 00000004:00080000:2.0:1788391150.475568:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68a7e4700, transno 30064771079 00000004:00080000:2.0:1788391150.475577:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d68527a680, transno 30064771082 00000100:00100000:2.0:1788391150.475583:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103456512:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788391150.476407:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771142 00000100:00100000:2.0:1788391150.476478:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103456640:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391150.476517:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391150.476539:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788391150.477688:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103456640 00000100:00100000:2.0:1788391150.477697:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103456640 00000100:00100000:2.0:1788391150.477732:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788391150.478080:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103456640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391150.478297:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42645:x1875263103456640:12345-0@lo:1000:mdt00_001.0 Request processed in 556us (1779us total) trans 30064771084 rc 0/0 00000100:00100000:2.0:1788391150.478305:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788391150.478555:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103456640:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788391150.478593:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478604:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478610:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478616:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.478620:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478628:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478659:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391150.478662:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391150.478667:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478674:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36c54 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478704:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478712:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478717:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478722:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.478725:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478730:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478863:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391150.478867:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391150.478874:0:42645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478896:0:42645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478913:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.478946:0:42645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.481446:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685279180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103456768:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391150.481560:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391150.484529:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.484592:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126080 00000100:00100000:3.0:1788391150.484600:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126080 00000100:00100000:3.0:1788391150.484653:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1788391150.484661:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094126080:12345-192.168.202.1@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1788391150.484796:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094126080:12345-192.168.202.1@tcp:49:mmap_sanity.0 Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.484804:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1788391150.485141:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685279180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103456768:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391150.485166:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485175:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd36ba5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485206:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485220:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485230:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485239:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485246:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485265:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485271:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.485275:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485282:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485292:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391150.485295:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.485298:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485304:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36c5b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485314:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485320:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485325:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485331:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.485333:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485347:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485355:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:0.0:1788391150.485357:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391150.485360:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.485365:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36c4d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.485573:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32911:x1875263094125824:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 19307us (20395us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1788391150.485582:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000020:00080000:0.0:1788391150.485585:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788391150.485863:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788391150.485868:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391150.485909:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1788391150.485925:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391150.485927:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391150.485944:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:3.0:1788391150.485948:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1788391150.490609:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.490684:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126336 00000100:00100000:3.0:1788391150.490692:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126336 00000100:00100000:3.0:1788391150.490756:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1788391150.490766:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:32911:x1875263094126336:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788391150.491373:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788391150.491464:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771144 00010000:00010000:3.0:1788391150.491504:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491521:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491533:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491541:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491548:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491554:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.491567:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391150.491639:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32911:x1875263094126336:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 873us (1038us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1788391150.491646:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000020:00080000:3.0:1788391150.491650:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391150.491725:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391150.491732:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.491740:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391150.491744:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.491752:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.491764:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff95d686a70d00) 00010000:00010000:2.0:1788391150.491767:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391150.491770:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.491776:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36c62 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.491801:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.491803:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.491805:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391150.495684:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.495766:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126464 00000100:00100000:3.0:1788391150.495776:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126464 00000100:00100000:3.0:1788391150.495836:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788391150.495845:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:32907:x1875263094126464:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391150.495862:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391150.495880:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006099a09e/0x9aafc5f04cd36c69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdf5 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391150.495934:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a98aeea, atime: 0x6a98aeea, ctime: 0x6a98aeea, blocks: 0x403 00010000:00010000:3.0:1788391150.495993:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=967s v=(0 0) 00010000:00010000:3.0:1788391150.495998:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391150.496008:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006099a09e/0x9aafc5f04cd36c69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdf5 expref: 6 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.496024:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006099a09e/0x9aafc5f04cd36c69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdf5 expref: 6 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.496035:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:3.0:1788391150.496086:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32907:x1875263094126464:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 243us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.496094:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788391150.499640:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.499735:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126592 00000100:00100000:2.0:1788391150.499744:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126592 00002000:00100000:2.0:1788391150.499806:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff95d685279180 x1875263094126592/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391150.499819:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279180 with x1875263094126592 ext(0->65535) 00002000:00010000:2.0:1788391150.499824:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685279180 00000100:00100000:2.0:1788391150.499859:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1788391150.499869:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126592:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:2.0:1788391150.505701:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126592:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 5822us (6059us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1788391150.505715:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00002000:00100000:2.0:1788391150.505726:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff95d685279180 x1875263094126592/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/440 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391150.505737:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279180 with x1875263094126592 ext(0->65535) 00002000:00010000:2.0:1788391150.505743:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685279180 00000100:00100000:2.0:1788391150.509997:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.510106:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126720 00000100:00100000:0.0:1788391150.510115:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126720 00002000:00100000:0.0:1788391150.510159:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff95d6bc7cb480 x1875263094126720/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391150.510170:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cb480 with x1875263094126720 ext(65536->102399) 00002000:00010000:0.0:1788391150.510176:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7cb480 00000100:00100000:0.0:1788391150.510206:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391150.510215:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126720:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391150.513627:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126720:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 3405us (3666us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788391150.513652:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00002000:00100000:0.0:1788391150.513662:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff95d6bc7cb480 x1875263094126720/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/440 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391150.513669:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cb480 with x1875263094126720 ext(65536->102399) 00002000:00010000:0.0:1788391150.513674:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7cb480 00000100:00100000:0.0:1788391150.516690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.516816:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126848 00000100:00100000:2.0:1788391150.516826:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126848 00002000:00100000:2.0:1788391150.516869:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff95d685278e00 x1875263094126848/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788391150.516909:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278e00 with x1875263094126848 ext(102400->139263) 00002000:00010000:2.0:1788391150.516914:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685278e00 00000100:00100000:3.0:1788391150.517079:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788391150.517091:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2357:x1875263094126848:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391150.519445:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2357:x1875263094126848:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2350us (2756us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788391150.519454:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00002000:00100000:3.0:1788391150.519461:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff95d685278e00 x1875263094126848/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/440 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391150.519469:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278e00 with x1875263094126848 ext(102400->139263) 00002000:00010000:3.0:1788391150.519473:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685278e00 00000100:00100000:2.0:1788391150.522492:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.522582:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094126976 00000100:00100000:0.0:1788391150.522591:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094126976 00002000:00100000:0.0:1788391150.522630:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff95d6bc7c8380 x1875263094126976/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391150.522638:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8380 with x1875263094126976 ext(139264->176127) 00002000:00010000:0.0:1788391150.522643:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8380 00000100:00100000:0.0:1788391150.522667:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788391150.522673:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126976:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391150.524783:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094126976:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 2056us (2246us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788391150.524811:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00002000:00100000:3.0:1788391150.524821:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff95d6bc7c8380 x1875263094126976/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/440 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391150.524828:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8380 with x1875263094126976 ext(139264->176127) 00002000:00010000:3.0:1788391150.524832:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8380 00000100:00100000:2.0:1788391150.529504:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.529634:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094127232 00000100:00100000:3.0:1788391150.529644:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094127232 00000100:00100000:3.0:1788391150.529731:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1788391150.529780:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32907:x1875263094127232:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000001:00080000:2.0:1788391150.530228:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771146 00000100:00100000:2.0:1788391150.530321:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+12:32907:x1875263094127232:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 581us (823us total) trans 30064771147 rc 0/0 00000100:00100000:2.0:1788391150.530329:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000020:00080000:2.0:1788391150.530334:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391150.531771:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.531832:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094127488 00000100:00100000:1.0:1788391150.531841:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094127488 00000100:00100000:1.0:1788391150.531902:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391150.531912:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+12:32907:x1875263094127488:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000001:00080000:1.0:1788391150.532161:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771148 00000001:00080000:1.0:1788391150.532213:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771149 00000100:00100000:1.0:1788391150.532290:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+15:32907:x1875263094127488:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 378us (525us total) trans 30064771150 rc 0/0 00000100:00100000:1.0:1788391150.532298:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000020:00080000:1.0:1788391150.532302:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788391150.541225:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391150.791141:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.791851:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094127744 00000100:00100000:1.0:1788391150.791863:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094127744 00000100:00100000:1.0:1788391150.791991:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1788391150.792002:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094127744:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788391150.792263:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094127744:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 262us (1129us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788391150.792272:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788391150.798641:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.798791:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128000 00000100:00100000:1.0:1788391150.798801:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128000 00000100:00100000:1.0:1788391150.798913:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788391150.798924:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094128000:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788391150.799270:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094128000:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 343us (635us total) trans 30064771152 rc 0/0 00000100:00100000:1.0:1788391150.799278:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1788391150.801898:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.802036:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128128 00000100:00100000:3.0:1788391150.802045:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128128 00000100:00100000:2.0:1788391150.802335:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788391150.802348:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094128128:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391150.802372:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391150.802391:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36c70 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffdfc expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802459:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802486:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802497:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802512:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802519:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802542:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802769:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802778:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802791:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391150.802823:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:2.0:1788391150.802827:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391150.802846:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802858:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802867:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802873:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802879:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802899:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.802904:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802919:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802932:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391150.802935:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.802939:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.802945:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36c77 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803158:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803168:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803174:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803179:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.803183:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803190:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803198:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff95d6830d2d00) 00010000:00010000:2.0:1788391150.803200:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.803203:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803219:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36c7e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803252:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36c70 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdfc expref: 23 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803267:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdfc expref: 22 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.803274:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391150.803277:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391150.803279:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e400, rc 0) 00000100:00100000:2.0:1788391150.803332:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128128:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 987us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391150.803341:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1788391150.807776:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.808135:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128384 00000100:00100000:1.0:1788391150.808145:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128384 00000100:00100000:1.0:1788391150.808234:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:1.0:1788391150.808246:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128384:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788391150.808298:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391150.808325:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd36c85 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdfc expref: 22 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808368:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36b90 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffda8 expref: 21 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808381:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391150.808386:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391150.808411:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808424:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808433:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808447:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808454:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808461:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808690:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808700:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.808707:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391150.809577:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].3, 64 off8408 00000004:00080000:1.0:1788391150.809588:0:43348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 967916626278ns, next at 968916623623ns, rc = 0 00010000:00010000:1.0:1788391150.809648:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809658:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809667:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809675:0:43348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809681:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809688:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809932:0:43348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391150.809953:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809979:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809986:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.809992:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.810003:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810010:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810021:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391150.810024:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788391150.810028:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810034:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36c9a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810050:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810055:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810059:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810064:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.810066:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810071:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810076:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391150.810079:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.810088:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.810094:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36c8c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391150.810103:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ed6af83 reply state 00000000e85f885b transno 30064771153 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.810112:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391150.810203:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128384:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1957us (2434us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1788391150.810212:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00010000:00010000:2.0:1788391150.810863:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391150.810939:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.810947:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391150.810950:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.810957:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.810982:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391150.810985:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391150.810998:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.811003:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36ca1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.811016:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.811019:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.811020:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391150.811856:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.811941:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.811948:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.811953:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.811956:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.811993:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.812016:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff95d6a0d29700) 00010000:00010000:3.0:1788391150.812018:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391150.812022:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.812028:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36c93 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.812653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.812934:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128512 00000100:00100000:3.0:1788391150.812945:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128512 00000100:00100000:3.0:1788391150.813150:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788391150.813161:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094128512:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391150.813186:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391150.813203:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36ca8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe03 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813265:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813278:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813290:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813303:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813309:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813328:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813411:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813420:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813427:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391150.813458:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:3.0:1788391150.813462:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391150.813481:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813493:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813500:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813506:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813512:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813517:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.813520:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813534:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813545:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391150.813548:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391150.813552:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813557:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36caf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813568:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813574:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813580:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813584:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.813587:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813592:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813598:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff95d686a70f00) 00010000:00010000:3.0:1788391150.813600:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391150.813603:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813619:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36cb6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813650:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd36ca8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe03 expref: 23 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813663:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe03 expref: 22 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.813669:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391150.813671:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391150.813674:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391150.814035:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128512:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 874us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.814043:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:0.0:1788391150.821706:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.824615:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128768 00000100:00100000:2.0:1788391150.824632:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128768 00000100:00100000:2.0:1788391150.824899:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1788391150.824911:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128768:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788391150.824990:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391150.825017:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd36cbd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe03 expref: 22 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825036:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788391150.825041:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391150.825063:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825075:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825084:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825097:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825103:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825125:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825219:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825228:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.825235:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391150.826179:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].5, 64 off8560 00010000:00010000:2.0:1788391150.826250:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826262:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826272:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826279:0:42645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826285:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826292:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826316:0:42645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391150.826352:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826358:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826365:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826370:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.826374:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826381:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826391:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788391150.826393:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391150.826397:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826402:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36cd2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826419:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826423:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826428:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826441:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.826443:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826448:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826455:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391150.826457:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.826460:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.826464:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36cc4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391150.826472:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdfed472 reply state 0000000021b6872f transno 30064771154 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.826479:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391150.826567:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094128768:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1656us (4868us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1788391150.826575:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00010000:00010000:3.0:1788391150.826642:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391150.826649:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.826654:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391150.826657:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.826663:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.826671:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391150.826673:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391150.826682:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.826687:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36cd9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.826696:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391150.826698:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391150.826699:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391150.830269:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830288:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830297:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830303:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.830308:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830315:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830333:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff95d6830d2d00) 00010000:00010000:1.0:1788391150.830336:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.830342:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.830369:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36ccb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.831099:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.831437:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094128896 00000100:00100000:1.0:1788391150.831448:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094128896 00000100:00100000:1.0:1788391150.831500:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:1.0:1788391150.831510:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128896:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391150.831536:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391150.831553:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36ce0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe0a expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831616:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831629:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831638:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831651:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831656:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831662:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831715:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831732:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831738:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831744:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.831748:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831754:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831764:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391150.831766:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.831770:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831775:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36ce7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831798:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831805:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831810:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831815:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.831824:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831831:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831839:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391150.831842:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.831845:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831850:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36cee lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831905:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36ce0 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe0a expref: 23 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831915:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391150.831918:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.831922:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36ce0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe0a expref: 23 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.831931:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391150.832016:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094128896:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 507us (921us total) trans 0 rc 301/301 00000100:00100000:1.0:1788391150.832025:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788391150.835218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.835288:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094129152 00000100:00100000:1.0:1788391150.835296:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094129152 00000100:00100000:1.0:1788391150.835357:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:1.0:1788391150.835367:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094129152:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391150.835403:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391150.835424:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36cf5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe11 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835532:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835547:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835560:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835577:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835584:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.835591:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836632:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36d0a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836644:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36d0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836652:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36d0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391150.836663:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788391150.836733:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836742:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836748:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836754:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.836759:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836766:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836778:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391150.836781:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.836786:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836804:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36cfc lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391150.836817:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c8c3b3b reply state 0000000055c67be7 transno 30064771155 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.836825:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391150.836852:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36cf5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe11 expref: 25 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836877:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36d0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe11 expref: 24 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.836901:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391150.836903:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788391150.836906:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391150.837004:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094129152:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1637us (1795us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1788391150.837013:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00010000:00010000:1.0:1788391150.842350:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842369:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842376:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842382:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.842387:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842394:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842411:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff95d6a0d29400) 00010000:00010000:1.0:1788391150.842414:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.842419:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.842426:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36d03 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.847164:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.850814:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094129408 00000100:00100000:0.0:1788391150.850829:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094129408 00000100:00100000:0.0:1788391150.850905:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788391150.850916:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:32902:x1875263094129408:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788391150.851454:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.851472:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.851482:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391150.851533:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771156 00000004:00010000:0.0:1788391150.851556:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb3dc421 reply state 0000000059137960 transno 30064771157 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.851565:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391150.851720:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32902:x1875263094129408:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 805us (4566us total) trans 30064771157 rc 0/0 00000100:00100000:0.0:1788391150.851728:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000020:00080000:0.0:1788391150.851733:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391150.853722:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853737:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853743:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853747:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.853750:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853755:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853769:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391150.853771:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.853774:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.853778:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d18 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.868334:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.868417:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.868549:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094129664 00000100:00100000:2.0:1788391150.868559:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094129664 00000100:00100000:2.0:1788391150.868618:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788391150.868628:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094129664:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788391150.868682:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391150.868707:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36d0a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe11 expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868740:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:2.0:1788391150.868753:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391150.868773:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868787:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868795:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868809:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868815:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868821:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868929:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868937:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.868944:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391150.869293:0:42646:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0xb:0x0] is inserted into orphan list, open count = 1 00000100:00100000:3.0:1788391150.869428:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094129792 00000100:00100000:3.0:1788391150.869433:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094129792 00002000:00100000:3.0:1788391150.869470:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff95d685279500 x1875263094129792/t0(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788391150.869480:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279500 with x1875263094129792 ext(0->409599) 00002000:00010000:3.0:1788391150.869484:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685279500 00000100:00100000:3.0:1788391150.869510:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1788391150.869517:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094129792:12345-192.168.202.1@tcp:4:mmap_sanity.0 00010000:00010000:2.0:1788391150.870228:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870246:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870252:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870257:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.870261:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870268:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870279:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff95d6830d2800) 00010000:00010000:2.0:1788391150.870282:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391150.870286:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870291:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d2d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870310:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870492:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870499:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870504:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.870513:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870520:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870528:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391150.870531:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.870534:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.870540:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d1f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391150.870551:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de833a4 reply state 0000000070f2fdb8 transno 30064771158 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391150.870559:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391150.870622:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32902:x1875263094129664:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1992us (2303us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1788391150.870630:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00010000:00010000:1.0:1788391150.878538:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878556:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878564:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878578:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.878583:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878590:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878607:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391150.878610:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.878614:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.878621:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d26 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.880849:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2357:x1875263094129792:12345-192.168.202.1@tcp:4:mmap_sanity.0 Request processed in 11322us (12420us total) trans 30064771085 rc 0/0 00000100:00100000:1.0:1788391150.880865:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00002000:00100000:1.0:1788391150.880876:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff95d685279500 x1875263094129792/t30064771085(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/448 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788391150.880897:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279500 with x1875263094129792 ext(0->409599) 00002000:00010000:1.0:1788391150.880903:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685279500 00000100:00100000:3.0:1788391150.881142:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.881251:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094129920 00000100:00100000:0.0:1788391150.881260:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094129920 00000100:00100000:0.0:1788391150.885461:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788391150.885495:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094129920:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391150.885521:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391150.885544:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d34 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe18 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885639:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885660:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885672:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885732:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885740:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885747:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885799:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885806:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885813:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885819:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.885823:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885830:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885841:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391150.885850:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.885855:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885861:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36d3b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885876:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885891:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885897:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885902:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391150.885905:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885911:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885919:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391150.885921:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.885925:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885930:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36d42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885979:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d34 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe18 expref: 27 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.885995:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391150.885998:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391150.886002:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36d34 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe18 expref: 27 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.886011:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391150.892319:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094129920:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 6829us (11165us total) trans 0 rc 301/301 00000100:00100000:0.0:1788391150.892335:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:2.0:1788391150.893265:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.893380:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094130048 00000100:00100000:3.0:1788391150.893391:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094130048 00000100:00100000:3.0:1788391150.893459:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788391150.893469:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32287:x1875263094130048:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391150.893484:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788391150.893503:0:42630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1788391146 -> 1788391150 00002000:00010000:3.0:1788391150.893507:0:42630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788391146 -> 1788391150 00010000:00010000:3.0:1788391150.893545:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006099a09e/0x9aafc5f04cd36c69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdf5 expref: 8 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.893573:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391150.893617:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32287:x1875263094130048:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.893625:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1788391150.896046:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.896199:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094130304 00000100:00100000:1.0:1788391150.896210:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094130304 00000100:00100000:1.0:1788391150.896274:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:1.0:1788391150.896285:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094130304:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391150.896380:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391150.896414:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36d49 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe1f expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896561:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896576:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896589:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896604:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896610:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.896616:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897731:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897745:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897754:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391150.897766:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 0 00010000:00010000:1.0:1788391150.897795:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897816:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897823:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.897992:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.897998:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.898006:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.898020:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391150.898023:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.898028:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.898034:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36d50 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391150.898048:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c0e028 reply state 0000000016feb7f4 transno 30064771159 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.898058:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391150.898094:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36d49 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.898109:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 28 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.898129:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391150.898132:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788391150.898134:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6a00, rc 0) 00000100:00100000:1.0:1788391150.898219:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32902:x1875263094130304:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 1935us (2182us total) trans 30064771159 rc 0/0 00000100:00100000:1.0:1788391150.898227:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:1.0:1788391150.899185:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.899405:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094130432 00000100:00100000:3.0:1788391150.899416:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094130432 00002000:00100000:3.0:1788391150.899460:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff95d687863800 x1875263094130432/t0(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/0 e 0 to 0 dl 1788391161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391150.899471:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687863800 with x1875263094130432 ext(204800->409599) 00002000:00010000:3.0:1788391150.899476:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687863800 00000100:00100000:3.0:1788391150.899506:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788391150.899517:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094130432:12345-192.168.202.1@tcp:4:ldlm_bl.0 00010000:00010000:3.0:1788391150.903450:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903468:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903477:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903483:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391150.903488:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903509:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903526:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff95d6a0d29400) 00010000:00010000:3.0:1788391150.903529:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391150.903533:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.903540:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36d57 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.904232:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+10:2356:x1875263094130432:12345-192.168.202.1@tcp:4:ldlm_bl.0 Request processed in 4710us (5044us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788391150.904246:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00002000:00100000:3.0:1788391150.904260:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff95d687863800 x1875263094130432/t30064771081(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:11/0 lens 488/448 e 0 to 0 dl 1788391161 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391150.904271:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687863800 with x1875263094130432 ext(204800->409599) 00002000:00010000:3.0:1788391150.904276:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687863800 00000100:00100000:0.0:1788391150.909198:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.909241:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.909322:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094130816 00000100:00100000:3.0:1788391150.909334:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094130816 00000100:00100000:3.0:1788391150.909394:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1788391150.909402:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+10:32288:x1875263094130816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391150.909415:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391150.909449:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e68aac6c/0x9aafc5f04cd36b9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdb6 expref: 10 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.909482:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391150.909522:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+9:32288:x1875263094130816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.909527:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391150.909737:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094130688 00000100:00100000:1.0:1788391150.909740:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094130688 00000100:00100000:1.0:1788391150.909770:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788391150.909775:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32902:x1875263094130688:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788391150.910034:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.910046:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.910053:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391150.910091:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771160 00000004:00010000:1.0:1788391150.910112:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051a1336c reply state 0000000063c4c1f6 transno 30064771161 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391150.910119:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391150.910177:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094130688:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 401us (987us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1788391150.910190:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000020:00080000:1.0:1788391150.910193:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391150.912811:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912837:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912845:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912852:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391150.912856:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912871:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912896:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391150.912899:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391150.912903:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.912908:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36d6c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.914126:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.914233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391150.914307:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131072 00000100:00100000:2.0:1788391150.914315:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131072 00000100:00100000:2.0:1788391150.914369:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391150.914379:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+15:32902:x1875263094131072:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391150.914400:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391150.914415:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d73 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe26 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914485:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914496:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914504:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914513:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914517:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914521:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914604:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d88 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914610:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d88 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914613:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d88 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391150.914620:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788391150.914689:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914701:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914705:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914708:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.914711:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914716:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914723:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391150.914725:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.914727:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914731:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36d7a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914739:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914743:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914746:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914749:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391150.914754:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914757:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914761:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff95d6830d2800) 00010000:00010000:2.0:1788391150.914763:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391150.914764:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914767:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36d81 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914796:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36d73 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe26 expref: 18 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914803:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d88 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe26 expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.914807:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:2.0:1788391150.914808:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391150.914810:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f400, rc 0) 00000100:00100000:2.0:1788391150.914867:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+17:32902:x1875263094131072:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 490us (1082us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1788391150.914874:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788391150.915351:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131328 00000100:00100000:0.0:1788391150.915357:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131328 00000100:00100000:0.0:1788391150.915426:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1788391150.915434:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32912:x1875263094131328:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000004:00080000:0.0:1788391150.915578:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1788391150.915653:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915663:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915673:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915680:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915699:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915705:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.915731:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788391150.915793:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32912:x1875263094131328:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 360us (1560us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1788391150.915800:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00010000:00010000:2.0:1788391150.915855:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391150.915863:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.915889:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391150.915894:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.915901:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.915912:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:2.0:1788391150.915915:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391150.915919:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.915925:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36d96 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391150.915940:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.915942:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391150.915944:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391150.919392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391150.919754:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131584 00000100:00100000:3.0:1788391150.919764:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131584 00000100:00100000:3.0:1788391150.919834:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788391150.919845:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+17:32902:x1875263094131584:12345-192.168.202.1@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788391150.919862:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391150.919900:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36d88 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe26 expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391150.919920:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:3.0:1788391150.919925:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391150.920048:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+16:32902:x1875263094131584:12345-192.168.202.1@tcp:103:mmap_sanity.0 Request processed in 204us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391150.920056:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1788391150.922476:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.922720:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131712 00000100:00100000:0.0:1788391150.922730:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131712 00000100:00100000:0.0:1788391150.922841:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788391150.922852:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+16:32902:x1875263094131712:12345-192.168.202.1@tcp:58:mmap_sanity.0 00010000:00010000:0.0:1788391150.922997:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.923584:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.923597:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.923635:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.923649:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 30 pid: 43348 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.923685:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103456896:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391150.923854:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065900 going to sleep for 11 seconds 00000100:00100000:0.0:1788391150.926817:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103456896:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391150.926847:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391150.929224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391150.929554:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131840 00000100:00100000:0.0:1788391150.929565:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131840 00010000:00010000:0.0:1788391150.929603:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 31 pid: 43348 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.929652:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391150.929664:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094131840:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391150.929679:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391150.929687:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 31 pid: 43348 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929700:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 31 pid: 43348 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929723:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36d5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe1f expref: 31 pid: 43348 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929749:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391150.929755:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929781:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929795:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391150.929820:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391150.929865:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.929875:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2357:x1875263094131840:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 212us (661us total) trans 0 rc 0/0 00010000:00010000:1.0:1788391150.929878:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391150.929896:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000040:00080000:0.0:1788391150.930287:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].4, 136 off8736 00000100:00100000:0.0:1788391150.930332:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+16:32902:x1875263094131712:12345-192.168.202.1@tcp:58:mmap_sanity.0 Request processed in 7482us (7865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391150.930338:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1788391150.934408:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391150.934492:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094131968 00000100:00100000:1.0:1788391150.934503:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094131968 00000100:00100000:1.0:1788391150.934567:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788391150.934577:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+16:32902:x1875263094131968:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391150.934597:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391150.934616:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe2d expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934675:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934685:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934703:0:42646:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934716:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934729:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391150.934732:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391150.934736:0:42646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391150.934743:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7a00, rc 0) 00000100:00100000:1.0:1788391150.934938:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+17:32902:x1875263094131968:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 361us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391150.934984:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000040:00080000:3.0:1788391151.501379:0:42679:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788391151.501389:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391151.501842:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 1 00000040:00080000:3.0:1788391151.501865:0:42679:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 6, last_idx 7 00000040:00080000:3.0:1788391151.501928:0:42679:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391151.502068:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391151.502071:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391151.502091:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1788391151.502094:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391151.506120:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103457024:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391151.506225:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391151.508872:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103457024:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391151.511186:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.511277:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094132096 00000100:00100000:2.0:1788391151.511286:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094132096 00000100:00100000:2.0:1788391151.511344:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1788391151.511352:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32914:x1875263094132096:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391151.511385:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391151.511471:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32914:x1875263094132096:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 121us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.511476:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1788391151.514856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.515361:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094132224 00000100:00100000:0.0:1788391151.515370:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094132224 00000100:00100000:0.0:1788391151.515472:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788391151.515483:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32914:x1875263094132224:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.515550:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515567:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515579:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515597:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515619:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515627:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515650:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515659:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515666:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391151.515700:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1788391151.515704:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391151.515715:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515725:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515731:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515738:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515744:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.515748:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515761:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515774:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:0.0:1788391151.515777:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.515782:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515787:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515801:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515806:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515811:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515816:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.515819:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515824:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515831:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadcadaa3 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391151.515834:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.515837:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515852:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36db2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515867:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515872:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515892:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515897:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.515900:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515909:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515916:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391151.515918:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.515920:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.515926:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36db9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.516259:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32914:x1875263094132224:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 777us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.516268:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788391151.519873:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.520027:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094132480 00000100:00100000:2.0:1788391151.520037:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094132480 00000100:00100000:2.0:1788391151.520105:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1788391151.520117:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32914:x1875263094132480:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391151.520136:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391151.520156:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36dc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe34 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520250:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520264:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520275:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391151.520286:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788391151.520398:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520407:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520414:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520420:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391151.520424:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520448:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520461:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:2.0:1788391151.520463:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391151.520469:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520475:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd36dc7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520513:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36dc0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe34 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520524:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:2.0:1788391151.520526:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391151.520530:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36dc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe34 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.520539:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391151.520599:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32914:x1875263094132480:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 484us (735us total) trans 30064771164 rc 301/301 00000100:00100000:2.0:1788391151.520606:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1788391151.522814:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.523064:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094132608 00000100:00100000:1.0:1788391151.523074:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094132608 00000100:00100000:1.0:1788391151.523319:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:1.0:1788391151.523331:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32914:x1875263094132608:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788391151.523367:0:42646:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788391151.523468:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32914:x1875263094132608:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 139us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.523475:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1788391151.525562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.525627:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094132864 00000100:00100000:0.0:1788391151.525634:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094132864 00000100:00100000:0.0:1788391151.525696:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1788391151.525706:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32914:x1875263094132864:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.525722:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.525742:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36dd5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe3b expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391151.526468:0:42645:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc3:0x0], index 1: 0 00010000:00010000:0.0:1788391151.526652:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36ddc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.526667:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.526678:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.526734:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36dd5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe3b expref: 34 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.526750:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36ddc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe3b expref: 33 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.526758:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391151.526761:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391151.526764:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b800, rc 0) 00000100:00100000:0.0:1788391151.526829:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32914:x1875263094132864:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1272us total) trans 30064771165 rc 0/0 00000100:00100000:0.0:1788391151.526855:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1788391151.529449:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.529514:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094133120 00000100:00100000:0.0:1788391151.529524:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094133120 00000100:00100000:0.0:1788391151.529573:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1788391151.529583:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32914:x1875263094133120:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.529635:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391151.529658:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36ddc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe3b expref: 33 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529674:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391151.529683:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391151.529702:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529715:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529723:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529737:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529744:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529751:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529823:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529831:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529838:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529844:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.529847:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529854:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529863:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391151.529866:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.529869:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529884:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36dea lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529893:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529897:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529903:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529914:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.529917:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529924:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529932:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x6b89fdec (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391151.529935:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.529937:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.529944:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36df1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x6b89fdec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.530133:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32914:x1875263094133120:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 550us (690us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788391151.530141:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788391151.532057:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.532112:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094133248 00000100:00100000:3.0:1788391151.532120:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094133248 00000100:00100000:3.0:1788391151.532158:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1788391151.532164:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32914:x1875263094133248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391151.532179:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391151.532194:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36df8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe42 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532218:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532229:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532241:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532340:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36df8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532370:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 33 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.532378:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:3.0:1788391151.532381:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391151.532384:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:3.0:1788391151.532436:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32914:x1875263094133248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 270us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391151.532443:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1788391151.535083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.535194:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094133504 00000100:00100000:3.0:1788391151.535207:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094133504 00000100:00100000:3.0:1788391151.535299:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1788391151.535315:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32914:x1875263094133504:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391151.535415:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.535433:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.535444:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391151.536873:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].4, 88 off8496 00000004:00010000:3.0:1788391151.537047:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000090f7fbb reply state 00000000bfa20d7e transno 30064771166 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.537088:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391151.537770:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32914:x1875263094133504:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 2449us (2694us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1788391151.537792:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00010000:00010000:3.0:1788391151.539546:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539563:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539570:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539577:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391151.539582:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539588:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539604:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:3.0:1788391151.539607:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788391151.539611:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.539617:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd36e06 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.540430:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.540517:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094133632 00000100:00100000:0.0:1788391151.540528:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094133632 00000100:00100000:0.0:1788391151.540628:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1788391151.540639:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:32914:x1875263094133632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.540663:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.540681:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe49 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.540750:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.540795:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.540815:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391151.540818:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391151.540821:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391151.540886:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32914:x1875263094133632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 240us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.540893:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:2.0:1788391151.544145:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.544215:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094133760 00000100:00100000:3.0:1788391151.544224:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094133760 00000100:00100000:3.0:1788391151.544288:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391151.544300:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094133760:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391151.544595:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094133760:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 296us (456us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1788391151.544603:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00080000:0.0:1788391151.544661:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391151.547865:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.548581:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134016 00000100:00100000:1.0:1788391151.548595:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134016 00000100:00100000:1.0:1788391151.548671:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391151.548681:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:32914:x1875263094134016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391151.549000:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32914:x1875263094134016:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 279us (1117us total) trans 30064771167 rc 0/0 00000100:00100000:1.0:1788391151.549009:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788391151.551601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.551674:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134272 00000100:00100000:0.0:1788391151.551684:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134272 00000100:00100000:0.0:1788391151.551741:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:0.0:1788391151.551751:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32914:x1875263094134272:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788391151.551851:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32914:x1875263094134272:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.551859:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1788391151.556415:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.556627:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134400 00000100:00100000:0.0:1788391151.556637:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134400 00000100:00100000:0.0:1788391151.556694:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1788391151.556705:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:32914:x1875263094134400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.556725:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.556745:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e14 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe50 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.556860:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.556888:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.556901:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391151.556936:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391151.556954:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.557046:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e14 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe50 expref: 38 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.557064:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe50 expref: 37 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.557073:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391151.557076:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788391151.557080:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:1.0:1788391151.557932:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32914:x1875263094134400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1224us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.557941:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1788391151.561310:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.563669:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134528 00000100:00100000:2.0:1788391151.563685:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134528 00000100:00100000:2.0:1788391151.563856:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1788391151.563867:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094134528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391151.563896:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391151.563916:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe57 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391151.563942:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aeef, blocks: 0x1 00010000:00010000:2.0:1788391151.563978:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=968s v=(0 0) 00010000:00010000:2.0:1788391151.563983:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391151.563993:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 10 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.564011:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 10 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.564148:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391151.564217:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094134528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 351us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.564223:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00010000:00010000:3.0:1788391151.571744:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391151.571870:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.571985:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134784 00000100:00100000:1.0:1788391151.571994:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134784 00000100:00100000:1.0:1788391151.572055:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:1.0:1788391151.572067:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32914:x1875263094134784:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391151.572191:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32914:x1875263094134784:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.572199:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:1.0:1788391151.576094:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.576188:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094134912 00000100:00100000:3.0:1788391151.576199:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094134912 00000100:00100000:3.0:1788391151.576255:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788391151.576265:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:32914:x1875263094134912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391151.576283:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391151.576300:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe5e expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.576328:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 11 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.576336:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391151.576340:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391151.576345:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 11 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.576376:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 11 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.576390:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 11 pid: 43327 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.576428:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103457152:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391151.576517:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391151.581695:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.581785:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135040 00000100:00100000:2.0:1788391151.581809:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135040 00010000:00010000:2.0:1788391151.581854:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 12 pid: 43327 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.581905:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391151.581915:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094135040:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391151.581934:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391151.581957:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 12 pid: 43327 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.581994:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 12 pid: 43327 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.582019:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391151.582024:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391151.582033:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 12 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.582043:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 12 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.582081:0:42630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 12 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.582097:0:42630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103457280:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391151.582192:0:42630:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e40c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788391151.583767:0:43328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008138fe28/0x9aafc5f04cd36e22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe57 expref: 12 pid: 43327 timeout: 1068 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.583790:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103457152:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391151.583820:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 11 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.583849:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1000, rc 0) 00000100:00100000:0.0:1788391151.583921:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:32914:x1875263094134912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 7656us (7836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.583929:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788391151.584280:0:42630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103457280:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391151.584295:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391151.584331:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094135040:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2418us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.584340:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391151.592707:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.592769:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135168 00000100:00100000:1.0:1788391151.592779:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135168 00002000:00100000:1.0:1788391151.592827:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac66680 x1875263094135168/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:12/0 lens 4584/0 e 0 to 0 dl 1788391162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788391151.592839:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac66680 with x1875263094135168 ext(0->4095) 00002000:00010000:1.0:1788391151.592845:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac66680 00000100:00100000:1.0:1788391151.592934:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391151.592945:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094135168:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391151.593399:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094135168:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 455us (701us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1788391151.593407:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00002000:00100000:1.0:1788391151.593414:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac66680 x1875263094135168/t30064771083(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:12/0 lens 4584/448 e 0 to 0 dl 1788391162 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788391151.593423:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac66680 with x1875263094135168 ext(0->4095) 00002000:00010000:1.0:1788391151.593427:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac66680 00000100:00100000:3.0:1788391151.595539:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.595608:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135296 00000100:00100000:0.0:1788391151.595617:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135296 00000100:00100000:0.0:1788391151.595675:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1788391151.595685:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:32914:x1875263094135296:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788391151.662489:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771165 is committed 00000100:00100000:1.0:1788391151.662518:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32914:x1875263094135296:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 66828us (66983us total) trans 0 rc 0/0 00000020:00080000:0.0:1788391151.662519:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803898 batchid updated 00000100:00100000:1.0:1788391151.662533:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000001:00080000:0.0:1788391151.662807:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771167 is committed 00000004:00080000:0.0:1788391151.662822:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788391151.662836:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771150 is committed 00000001:00080000:0.0:1788391151.662855:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771162 is committed 00000020:00080000:0.0:1788391151.662872:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6925900 refcount 2 committed 0 result 0 batchid 25769803899 00000020:00080000:0.0:1788391151.662888:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3cc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6925b40 00000020:00080000:0.0:1788391151.662893:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d685c3cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5810bb400 00000020:00080000:0.0:1788391151.662930:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803899 committed batchid 25769803898 00000100:00100000:3.0:1788391151.663064:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391151.663126:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103457408:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788391151.663152:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803898 00000100:00100000:3.0:1788391151.663180:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391151.663639:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103457408 00000100:00100000:0.0:1788391151.663647:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103457408 00000100:00080000:1.0:1788391151.663705:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391151.663755:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788391151.663766:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103457408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788391151.663799:0:43698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:194 count 1 00002000:00010000:0.0:1788391151.663830:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a98aeed, atime: 0x6a98aeea, ctime: 0x6a98aeed, blocks: 0x403 00010000:00010000:0.0:1788391151.663838:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.663853:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=968s v=(0 0) 00010000:00010000:0.0:1788391151.663857:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391151.663862:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.663885:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.663896:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.663904:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.663926:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391151.663958:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391151.663992:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.664002:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391151.664006:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.664017:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.664034:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.664042:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092685f10/0x9aafc5f04cd36e30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.664058:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391151.664060:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391151.664061:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391151.664428:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103457408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 661us (1246us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1788391151.664448:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1788391151.664520:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d687863480/2, rc 0, transno 30064771084 00000100:00100000:3.0:1788391151.664531:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103457408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788391151.665674:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.665981:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135424 00000100:00100000:1.0:1788391151.665989:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135424 00000100:00100000:0.0:1788391151.666274:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391151.666286:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094135424:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788391151.702778:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771084 is committed 00000001:00080000:3.0:1788391151.702795:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771079 is committed 00000100:00100000:2.0:1788391151.702987:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094135424:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 36679us (37291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.703000:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000001:00080000:2.0:1788391151.703038:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771083 is committed 00000001:00080000:2.0:1788391151.703064:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771081 is committed 00000100:00100000:2.0:1788391151.706057:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.706122:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135680 00000100:00100000:1.0:1788391151.706132:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135680 00000100:00100000:1.0:1788391151.706186:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:1.0:1788391151.706198:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32914:x1875263094135680:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391151.706261:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391151.706289:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e1b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe50 expref: 13 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.706328:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391151.706333:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391151.706366:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.706378:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.706387:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391151.706563:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b6f3de9 reply state 0000000085304de9 transno 30064771168 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.706572:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391151.706655:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:32914:x1875263094135680:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 459us (606us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1788391151.706661:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00010000:00010000:1.0:1788391151.708660:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708674:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708678:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708684:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.708688:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708710:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708737:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391151.708740:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.708745:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.708751:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36e37 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.709697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.709819:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094135808 00000100:00100000:3.0:1788391151.709828:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094135808 00000100:00100000:3.0:1788391151.709901:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788391151.709912:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094135808:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788391151.710438:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1788391151.710442:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788391151 00002000:00010000:3.0:1788391151.710445:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1788391151 00002000:00010000:3.0:1788391151.710447:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1788391151 -> 1788391151 00002000:00010000:3.0:1788391151.710450:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788391151.710501:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094135808:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 591us (809us total) trans 30064771085 rc 0/0 00000100:00100000:3.0:1788391151.710526:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788391151.713226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.713383:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136064 00000100:00100000:1.0:1788391151.713390:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136064 00000100:00100000:1.0:1788391151.713438:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1788391151.713445:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:32914:x1875263094136064:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788391151.713500:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.713513:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.713520:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.713544:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.713553:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 13 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.713579:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103457536:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391151.713666:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391151.721271:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103457536:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391151.721400:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.722851:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.723030:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136192 00000100:00100000:0.0:1788391151.723039:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136192 00010000:00010000:0.0:1788391151.723079:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.723107:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391151.723114:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094136192:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391151.723125:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391151.723131:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723141:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723157:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd36dff lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe42 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723168:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391151.723172:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723179:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723199:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.723217:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391151.723247:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723257:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723284:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723302:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723308:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723314:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.723318:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723326:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723335:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391151.723345:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788391151.723349:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.723354:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd36e3e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.723437:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094136192:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 322us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.723442:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1788391151.723473:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32914:x1875263094136064:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 10026us (10254us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788391151.723483:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1788391151.727418:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.727473:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136320 00000100:00100000:1.0:1788391151.727484:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136320 00000100:00100000:1.0:1788391151.727540:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1788391151.727552:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094136320:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788391151.727597:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.727618:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.727628:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391151.727631:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391151.727635:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.727666:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.727697:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 7 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.727718:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103457664:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391151.727808:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391151.731279:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103457664:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391151.731310:0:43326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.732305:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.732362:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136448 00000100:00100000:0.0:1788391151.732370:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136448 00010000:00010000:0.0:1788391151.732407:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 8 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.732447:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391151.732457:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094136448:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391151.732473:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391151.732500:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 8 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.732513:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 8 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.732537:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44b0022/0x9aafc5f04cd36e29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe5e expref: 8 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.732556:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391151.732561:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391151.732579:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.732590:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.732619:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391151.732654:0:43326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732667:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732706:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732717:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732723:0:43326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.732736:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094136448:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 220us (372us total) trans 0 rc 0/0 00010000:00010000:1.0:1788391151.732742:0:43326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391151.732747:0:43326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.732751:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00010000:00010000:1.0:1788391151.732759:0:43326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732772:0:43326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.732777:0:43326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.732843:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094136320:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5294us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.732852:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1788391151.734660:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.734713:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136704 00000100:00100000:0.0:1788391151.734724:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136704 00000100:00100000:0.0:1788391151.734774:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788391151.734784:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:32914:x1875263094136704:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788391151.734865:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.734894:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.734905:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.735123:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.735134:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.735142:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.735183:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.735196:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 13 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.735210:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103457792:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391151.735284:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391151.738698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.739357:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136832 00000100:00100000:1.0:1788391151.739367:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136832 00010000:00010000:1.0:1788391151.739411:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.739449:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1788391151.739465:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094136832:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391151.739489:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391151.739511:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.739524:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 14 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.739545:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391151.739549:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.739560:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.739567:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.739584:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391151.739639:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094136832:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 181us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.739646:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00010000:00010000:0.0:1788391151.740018:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36e0d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe49 expref: 13 pid: 42644 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.740040:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103457792:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391151.740061:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.740071:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.740078:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391151.740263:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771169 00000001:00080000:0.0:1788391151.740406:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771170 00000001:00080000:0.0:1788391151.740452:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771171 00000100:00100000:0.0:1788391151.740529:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103457920:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788391151.740591:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391151.740621:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d684eb3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391151.740630:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103457920 00000100:00100000:2.0:1788391151.740637:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103457920 00000100:00100000:2.0:1788391151.740672:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788391151.740678:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103457920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391151.740748:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103457920:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.740754:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788391151.740814:0:42645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:0.0:1788391151.740821:0:42645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771084 00000004:00080000:0.0:1788391151.740835:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d687863480, transno 30064771084 00000100:00100000:0.0:1788391151.740853:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103457920:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788391151.741445:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771172 00000100:00100000:0.0:1788391151.741487:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103458048:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788391151.741516:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391151.741535:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391151.741559:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103458048 00000100:00100000:2.0:1788391151.741564:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103458048 00000100:00100000:2.0:1788391151.741599:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788391151.741604:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103458048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391151.741741:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42645:x1875263103458048:12345-0@lo:1000:mdt00_001.0 Request processed in 136us (224us total) trans 30064771086 rc 0/0 00000100:00100000:2.0:1788391151.741749:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788391151.741773:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103458048:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788391151.741800:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741809:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741817:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741823:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.741828:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741834:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741846:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391151.741848:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391151.741852:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741869:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36e53 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741912:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741917:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741920:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741923:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.741925:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741928:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741934:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391151.741935:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391151.741941:0:42645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741951:0:42645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.741976:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.742013:0:42645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.742024:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103458176:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391151.742068:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391151.746147:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103458176:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391151.746177:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746187:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36d9d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.746197:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:0.0:1788391151.746268:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746283:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746294:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746305:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746311:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746319:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746351:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.746355:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746361:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746373:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391151.746376:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.746380:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746385:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e5a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746396:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746403:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746408:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746412:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.746415:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746421:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746440:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391151.746442:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391151.746444:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.746449:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36e4c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.746488:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094136960 00000100:00100000:3.0:1788391151.746495:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094136960 00000100:00080000:1.0:1788391151.746643:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391151.746653:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32914:x1875263094136704:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 11868us (11995us total) trans 30064771173 rc 0/0 00000100:00100000:0.0:1788391151.746664:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000020:00080000:0.0:1788391151.746669:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788391151.746677:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1788391151.746694:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+11:32902:x1875263094136960:12345-192.168.202.1@tcp:49:mmap_sanity.0 00000100:00100000:3.0:1788391151.746785:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+11:32902:x1875263094136960:12345-192.168.202.1@tcp:49:mmap_sanity.0 Request processed in 97us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391151.746792:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000040:00080000:3.0:1788391151.747759:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391151.747766:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391151.747793:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:3.0:1788391151.747801:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391151.753375:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.753424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.753437:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137344 00000100:00100000:2.0:1788391151.753462:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137344 00000100:00100000:2.0:1788391151.753521:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1788391151.753531:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:32914:x1875263094137344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391151.753940:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137216 00000100:00100000:1.0:1788391151.753944:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137216 00000100:00100000:1.0:1788391151.754002:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788391151.754012:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:32902:x1875263094137216:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391151.754102:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391151.754120:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe65 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391151.754140:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a98aeef, atime: 0x6a98aeef, ctime: 0x6a98aeef, blocks: 0xb 00010000:00010000:1.0:1788391151.754159:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=968s v=(0 0) 00010000:00010000:1.0:1788391151.754162:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391151.754169:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 6 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.754181:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 6 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.754190:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:1.0:1788391151.754361:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:32902:x1875263094137216:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 351us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.754368:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00080000:0.0:1788391151.754477:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788391151.754495:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788391151.754801:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771174 00010000:00010000:2.0:1788391151.754842:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754854:0:42648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754864:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754885:0:42648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754893:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754899:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.754914:0:42648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391151.754921:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391151.754929:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.754937:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391151.754941:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.754951:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.754992:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff95d6830d2200) 00000100:00100000:2.0:1788391151.755003:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32914:x1875263094137344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1471us (1635us total) trans 30064771175 rc 0/0 00010000:00010000:3.0:1788391151.755005:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391151.755012:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.755016:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000020:00080000:2.0:1788391151.755023:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788391151.755024:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd36e68 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.755048:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391151.755051:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391151.755054:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391151.757802:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.757915:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137472 00000100:00100000:0.0:1788391151.757927:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137472 00002000:00100000:0.0:1788391151.758049:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac67b80 x1875263094137472/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 488/0 e 0 to 0 dl 1788391162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.758062:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac67b80 with x1875263094137472 ext(0->4095) 00002000:00010000:0.0:1788391151.758067:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac67b80 00000100:00100000:0.0:1788391151.758093:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1788391151.758103:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094137472:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391151.758329:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094137472:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 228us (535us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788391151.758337:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00002000:00100000:0.0:1788391151.758344:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac67b80 x1875263094137472/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 488/4536 e 0 to 0 dl 1788391162 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.758372:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac67b80 with x1875263094137472 ext(0->4095) 00002000:00010000:0.0:1788391151.758375:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac67b80 00000100:00100000:3.0:1788391151.761657:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.761774:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137600 00000100:00100000:0.0:1788391151.761784:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137600 00000100:00100000:0.0:1788391151.761838:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1788391151.761847:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:32902:x1875263094137600:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391151.761870:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.761899:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e6f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe6c expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.761993:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe6c expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.762009:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e6f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe6c expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.762039:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:0.0:1788391151.762042:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391151.762046:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391151.762099:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094137600:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 252us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.762106:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788391151.766090:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.766163:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137728 00000100:00100000:2.0:1788391151.766172:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137728 00000100:00100000:2.0:1788391151.766240:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1788391151.766266:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32902:x1875263094137728:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391151.766283:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391151.766300:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe73 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.766333:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 5 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.766352:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391151.766356:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391151.766361:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.766393:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 5 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.766406:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 5 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391151.766419:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103458304:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391151.766496:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788391151.770005:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391151.770135:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103458304:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391151.770176:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.770197:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e400, rc 0) 00000100:00100000:2.0:1788391151.770350:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32902:x1875263094137728:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 4076us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.770375:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788391151.772099:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137856 00000100:00100000:0.0:1788391151.772110:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137856 00002000:00100000:0.0:1788391151.772159:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d6bc7c8700 x1875263094137856/t0(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 4584/0 e 0 to 0 dl 1788391162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.772187:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8700 with x1875263094137856 ext(0->4095) 00010000:00010000:0.0:1788391151.772196:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 6 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.772211:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 6 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391151.772218:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bc7c8700 00000100:00100000:0.0:1788391151.772262:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1788391151.772273:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094137856:12345-192.168.202.1@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1788391151.773187:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094137856:12345-192.168.202.1@tcp:4:ldlm_bl.0 Request processed in 913us (3189us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1788391151.773197:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:0.0:1788391151.773204:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d6bc7c8700 x1875263094137856/t30064771087(0) o4->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 4584/448 e 0 to 0 dl 1788391162 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.773214:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8700 with x1875263094137856 ext(0->4095) 00010000:00010000:0.0:1788391151.773220:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.773233:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391151.773240:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d6bc7c8700 00000100:00100000:1.0:1788391151.776551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.776661:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094137984 00000100:00100000:0.0:1788391151.776671:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094137984 00010000:00010000:0.0:1788391151.776715:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.776825:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788391151.776835:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2356:x1875263094137984:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391151.776868:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788391151.776900:0:42630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1788391151 -> 1788391152 00002000:00010000:0.0:1788391151.776904:0:42630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1788391151 -> 1788391152 00010000:00010000:0.0:1788391151.776910:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.776924:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.776945:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea5407ef/0x9aafc5f04cd36e61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe65 expref: 8 pid: 43698 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.777000:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391151.777005:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391151.777013:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.777023:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.777071:0:42630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.777086:0:42630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103458432:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391151.777147:0:42630:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6bc6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788391151.780417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.780468:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094138112 00000100:00100000:3.0:1788391151.780475:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094138112 00002000:00100000:3.0:1788391151.780515:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d6bc64aa00 x1875263094138112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:12/0 lens 488/0 e 0 to 0 dl 1788391162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391151.780526:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64aa00 with x1875263094138112 ext(0->4095) 00002000:00010000:3.0:1788391151.780531:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64aa00 00000100:00100000:3.0:1788391151.780560:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391151.780571:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094138112:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:3.0:1788391151.780882:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094138112:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 305us (462us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788391151.780891:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00002000:00100000:3.0:1788391151.780901:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d6bc64aa00 x1875263094138112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:12/0 lens 488/4536 e 0 to 0 dl 1788391162 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788391151.780909:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64aa00 with x1875263094138112 ext(0->4095) 00002000:00010000:3.0:1788391151.780926:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64aa00 00000100:00100000:0.0:1788391151.780928:0:42630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:42630:1875263103458432:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391151.780946:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391151.781230:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2356:x1875263094137984:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4395us (4686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391151.781239:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788391151.784382:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391151.784427:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094138240 00000100:00100000:3.0:1788391151.784435:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094138240 00000100:00100000:3.0:1788391151.784480:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788391151.784491:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32902:x1875263094138240:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788391151.784518:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391151.784535:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe7a expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.784559:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.784565:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391151.784568:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1788391151.784572:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 8 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.784597:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.784606:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 6 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.784615:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103458560:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391151.784680:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788391151.786471:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103458560:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391151.786495:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 8 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.786509:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:2.0:1788391151.786545:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32902:x1875263094138240:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 2055us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391151.786553:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788391151.787486:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.787543:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094138368 00000100:00100000:1.0:1788391151.787551:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094138368 00010000:00010000:1.0:1788391151.787578:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.787604:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1788391151.787613:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094138368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391151.787626:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391151.787647:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.787660:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.787690:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d387e50d/0x9aafc5f04cd36e76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe73 expref: 7 pid: 43328 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.787699:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1788391151.787702:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1788391151.787720:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 7 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.787739:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 7 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.787790:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 7 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.787804:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103458688:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391151.787866:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391151.789623:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103458688:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391151.789644:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391151.789692:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094138368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2080us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.789701:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788391151.790397:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.790892:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094138496 00000100:00100000:0.0:1788391151.790899:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094138496 00002000:00100000:0.0:1788391151.790936:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac65c00 x1875263094138496/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 488/0 e 0 to 0 dl 1788391162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.790943:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65c00 with x1875263094138496 ext(0->4095) 00002000:00010000:0.0:1788391151.790947:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac65c00 00000100:00100000:0.0:1788391151.790986:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788391151.790996:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2357:x1875263094138496:12345-192.168.202.1@tcp:3:kworker.0 00000100:00100000:0.0:1788391151.791138:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+8:2357:x1875263094138496:12345-192.168.202.1@tcp:3:kworker.0 Request processed in 144us (745us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788391151.791143:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00002000:00100000:0.0:1788391151.791147:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff95d58ac65c00 x1875263094138496/t0(0) o3->52ce7de6-d362-4c91-9bea-438b5645df6d@192.168.202.1@tcp:12/0 lens 488/4536 e 0 to 0 dl 1788391162 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788391151.791162:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65c00 with x1875263094138496 ext(0->4095) 00002000:00010000:0.0:1788391151.791164:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac65c00 00000100:00100000:3.0:1788391151.794234:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.794334:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094138752 00000100:00100000:0.0:1788391151.794345:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094138752 00000100:00100000:0.0:1788391151.794404:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391151.794415:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+11:32902:x1875263094138752:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1788391151.794677:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771176 00000100:00100000:0.0:1788391151.794800:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32902:x1875263094138752:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 386us (583us total) trans 30064771177 rc 0/0 00000100:00100000:0.0:1788391151.794807:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000020:00080000:0.0:1788391151.794812:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788391151.797699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.797806:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094139008 00000100:00100000:0.0:1788391151.797818:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094139008 00000100:00100000:0.0:1788391151.797884:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391151.797894:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:32902:x1875263094139008:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788391151.798152:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094139008:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 258us (458us total) trans 30064771178 rc 0/0 00000100:00100000:0.0:1788391151.798159:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391151.801059:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.801116:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094139136 00000100:00100000:1.0:1788391151.801126:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094139136 00000100:00100000:1.0:1788391151.801181:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:1.0:1788391151.801193:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094139136:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391151.801232:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391151.801251:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36e84 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe81 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801304:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801314:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801323:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801331:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801335:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801339:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801506:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801511:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801516:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391151.801541:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1788391151.801548:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391151.801564:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801573:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801579:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801583:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801587:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801590:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.801593:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801597:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801606:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391151.801608:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.801610:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801614:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd36e8b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801622:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801632:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801635:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801638:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.801639:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801643:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801647:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff95d6a0d29300) 00010000:00010000:1.0:1788391151.801648:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.801649:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801652:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36e92 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801672:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36e84 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe81 expref: 22 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801680:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe81 expref: 21 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.801685:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391151.801686:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391151.801691:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391151.801759:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094139136:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 568us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391151.801766:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:3.0:1788391151.803792:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.803838:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094139392 00000100:00100000:1.0:1788391151.803847:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094139392 00000100:00100000:1.0:1788391151.803909:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1788391151.803919:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094139392:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788391151.804008:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391151.804269:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36e99 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe81 expref: 21 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804285:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36e6f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe6c expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804293:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391151.804296:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391151.804312:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804320:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804326:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804334:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804338:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804348:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804511:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804516:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.804521:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391151.805024:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].5, 64 off8560 00010000:00010000:1.0:1788391151.805071:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805077:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805083:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805088:0:43348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805092:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805095:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805112:0:43348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391151.805137:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805143:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805149:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805153:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391151.805155:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391151.805159:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805159:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805165:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391151.805167:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805168:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805180:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805182:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391151.805184:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788391151.805187:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805189:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:2.0:1788391151.805191:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391151.805193:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36eae lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805194:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805206:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd36eb5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805208:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805214:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391151.805215:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391151.805217:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391151.805219:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391151.805220:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805232:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.805236:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805241:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805247:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391151.805249:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.805251:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.805254:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd36ea0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391151.805261:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079223a7f reply state 00000000abb4446a transno 30064771179 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.805266:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391151.805327:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:32902:x1875263094139392:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1408us (1540us total) trans 30064771179 rc 0/0 00000100:00100000:1.0:1788391151.805334:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00010000:00010000:1.0:1788391151.806725:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806739:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806746:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806765:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.806770:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806777:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806790:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391151.806792:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.806796:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.806803:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd36ea7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.808486:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.808607:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094139648 00000100:00100000:0.0:1788391151.808618:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094139648 00000100:00100000:0.0:1788391151.808708:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1788391151.808719:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:32902:x1875263094139648:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391151.808744:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.808763:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ebc lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe88 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808892:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808906:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808917:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808928:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808933:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.808937:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809421:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36ed1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809428:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36ed1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809433:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36ed1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391151.809440:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788391151.809457:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809462:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809471:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809475:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.809477:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809482:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809489:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391151.809491:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391151.809493:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809497:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ec3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391151.809506:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a272c44 reply state 000000005fcb2414 transno 30064771180 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.809512:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391151.809532:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ebc lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe88 expref: 23 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809541:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36ed1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe88 expref: 22 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.809546:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391151.809547:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788391151.809553:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788391151.809607:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094139648:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 891us (1128us total) trans 30064771180 rc 0/0 00000100:00100000:0.0:1788391151.809615:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00010000:00010000:1.0:1788391151.813557:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813577:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813584:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813591:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.813597:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813604:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813641:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff95d6a0d59500) 00010000:00010000:1.0:1788391151.813645:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.813650:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.813657:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36eca lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.886099:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.886172:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094139904 00000100:00100000:0.0:1788391151.886181:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094139904 00000100:00100000:0.0:1788391151.886225:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391151.886232:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:32902:x1875263094139904:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788391151.886549:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094139904:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 316us (457us total) trans 30064771181 rc 0/0 00000100:00100000:0.0:1788391151.886554:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391151.889064:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.889223:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094140160 00000100:00100000:0.0:1788391151.889231:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094140160 00000100:00100000:0.0:1788391151.889315:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:0.0:1788391151.889326:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:32902:x1875263094140160:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788391151.889347:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391151.889368:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36edf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe8f expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.889454:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ee6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.889464:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ee6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.889472:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ee6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391151.889479:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788391151.889587:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36edf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe8f expref: 26 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.889601:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ee6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe8f expref: 25 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.889607:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391151.889609:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788391151.889611:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788391151.889655:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094140160:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 332us (600us total) trans 30064771182 rc 0/0 00000100:00100000:0.0:1788391151.889659:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1788391151.938088:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391151.938154:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094140416 00000100:00100000:0.0:1788391151.938165:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094140416 00000100:00100000:0.0:1788391151.938222:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391151.938232:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094140416:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788391151.938464:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094140416:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 234us (384us total) trans 30064771183 rc 0/0 00000100:00100000:0.0:1788391151.938470:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788391151.942403:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.942555:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094140672 00000100:00100000:1.0:1788391151.942564:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094140672 00000100:00100000:0.0:1788391151.942737:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788391151.942749:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094140672:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788391151.942820:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788391151.942850:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36ee6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe8f expref: 26 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.942883:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36ed1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe88 expref: 25 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.942908:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff95d6a0d59b00) 00010000:00010000:0.0:1788391151.942921:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391151.942942:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.942954:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943016:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943030:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943037:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943043:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943133:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943141:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943148:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943509:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943529:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943537:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943544:0:42645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943551:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943556:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943579:0:42645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391151.943597:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943602:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943608:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943615:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.943619:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943627:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391151.943627:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943637:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943655:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391151.943661:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:3.0:1788391151.943662:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943668:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788391151.943674:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943675:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943687:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f02 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943694:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff95d6a0d59e00) 00010000:00010000:3.0:1788391151.943699:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788391151.943703:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943704:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943720:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943722:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f09 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943729:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943735:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391151.943738:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943750:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391151.943760:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391151.943761:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:3.0:1788391151.943764:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391151.943765:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391151.943768:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391151.943770:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391151.943777:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36ef4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391151.943797:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f0a7bf reply state 000000005eed3f54 transno 30064771184 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391151.943805:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391151.943883:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:32902:x1875263094140672:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 1124us (1487us total) trans 30064771184 rc 0/0 00000100:00100000:0.0:1788391151.943891:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00010000:00010000:1.0:1788391151.946273:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946289:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946296:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946301:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.946306:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946313:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946329:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff95d6a0d59500) 00010000:00010000:1.0:1788391151.946332:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.946336:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.946358:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd36efb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391151.946793:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391151.948229:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094140928 00000100:00100000:1.0:1788391151.948241:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094140928 00000100:00100000:1.0:1788391151.948349:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:1.0:1788391151.948361:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:32902:x1875263094140928:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391151.948397:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391151.948417:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f10 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe96 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948537:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948551:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948562:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948577:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948584:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.948591:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.949750:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36f25 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.949770:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36f25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.949779:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36f25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391151.949789:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:1.0:1788391151.950252:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950260:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950266:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950271:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.950275:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950282:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950688:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391151.950691:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.950696:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950703:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f17 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391151.950719:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001648b2b6 reply state 00000000377efabd transno 30064771185 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391151.950735:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391151.950771:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f10 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe96 expref: 28 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950785:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36f25 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe96 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.950792:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff95d6a0d29300) 00010000:00010000:1.0:1788391151.950795:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788391151.950797:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:1.0:1788391151.951569:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32902:x1875263094140928:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 3206us (4775us total) trans 30064771185 rc 0/0 00000100:00100000:1.0:1788391151.951578:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00010000:00010000:1.0:1788391151.953300:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953316:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953329:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953335:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391151.953340:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953349:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953384:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391151.953386:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391151.953389:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391151.953401:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd36f1e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391152.032086:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391152.032200:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094141184 00000100:00100000:2.0:1788391152.032210:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094141184 00000100:00100000:2.0:1788391152.032298:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788391152.032310:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:32902:x1875263094141184:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00080000:0.0:1788391152.032364:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391152.032661:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32902:x1875263094141184:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 353us (584us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1788391152.032669:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1788391152.040736:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391152.040804:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094141440 00000100:00100000:1.0:1788391152.040814:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094141440 00000100:00100000:1.0:1788391152.040924:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1788391152.040933:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32902:x1875263094141440:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788391152.040956:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391152.040989:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f33 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffe9d expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.041071:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f3a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.041082:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f3a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.041090:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f3a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391152.041097:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:1.0:1788391152.041208:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f33 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe9d expref: 31 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.041241:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe9d expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.041247:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff95d6a0d29300) 00010000:00010000:1.0:1788391152.041249:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788391152.041251:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391152.041306:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32902:x1875263094141440:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 375us (581us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1788391152.041311:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1788391152.110824:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391152.110950:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094141696 00000100:00100000:2.0:1788391152.110985:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094141696 00000100:00100000:2.0:1788391152.111085:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788391152.111096:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32902:x1875263094141696:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391152.111357:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094141696:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 262us (542us total) trans 30064771188 rc 0/0 00000100:00100000:2.0:1788391152.111367:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1788391152.115377:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391152.115443:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094141952 00000100:00100000:0.0:1788391152.115451:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094141952 00000100:00100000:0.0:1788391152.115495:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1788391152.115503:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094141952:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788391152.115548:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788391152.115570:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd36f3a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe9d expref: 31 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115585:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd36f25 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe96 expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115592:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff95d6a0d29300) 00010000:00010000:0.0:1788391152.115602:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391152.115618:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115628:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115635:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115654:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115659:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115663:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115734:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115739:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.115742:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116130:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116139:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116146:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116152:0:42644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116158:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116168:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116230:0:42644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391152.116248:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116254:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116259:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116264:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391152.116268:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116274:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116281:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391152.116284:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788391152.116287:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116292:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f56 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116306:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116311:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116321:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116325:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391152.116328:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116333:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116339:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391152.116341:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391152.116344:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391152.116348:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f48 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391152.116355:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007a729b1 reply state 0000000068313e41 transno 30064771189 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391152.116362:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391152.116426:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32902:x1875263094141952:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 922us (1055us total) trans 30064771189 rc 0/0 00000100:00100000:0.0:1788391152.116433:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00010000:00010000:3.0:1788391152.116846:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391152.116852:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391152.116858:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391152.116861:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391152.116867:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391152.116885:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:3.0:1788391152.116888:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391152.116890:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391152.116896:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f5d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391152.116909:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391152.116911:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391152.116913:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391152.117618:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117628:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117634:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117638:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391152.117642:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117648:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117657:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff95d6a0d59b00) 00010000:00010000:1.0:1788391152.117659:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391152.117674:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391152.117680:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd36f4f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391152.122465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391152.122562:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094142208 00000100:00100000:2.0:1788391152.122582:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094142208 00000100:00100000:2.0:1788391152.122642:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1788391152.122652:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32902:x1875263094142208:12345-192.168.202.1@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788391152.122702:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391152.122722:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36f64 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffea4 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.122825:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36f6b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.122839:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36f6b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.122861:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36f6b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391152.122886:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788391152.123048:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36f64 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffea4 expref: 33 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.123067:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36f6b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffea4 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.123076:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391152.123079:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391152.123082:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391152.123134:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094142208:12345-192.168.202.1@tcp:101:mmap_sanity.0 Request processed in 484us (678us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788391152.123141:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1788391152.124279:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391152.124398:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094142336 00000100:00100000:2.0:1788391152.124405:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094142336 00000100:00100000:2.0:1788391152.124451:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1788391152.124477:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+8:32287:x1875263094142336:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391152.124489:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391152.124521:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd36e7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe7a expref: 8 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391152.124542:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391152.124711:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32287:x1875263094142336:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 242us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391152.124718:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00010000:00010000:3.0:1788391152.589276:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391153.135117:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391153.135189:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094142592 00000100:00100000:0.0:1788391153.135198:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094142592 00000100:00100000:2.0:1788391153.135306:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391153.135321:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32902:x1875263094142592:12345-192.168.202.1@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788391153.135784:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32902:x1875263094142592:12345-192.168.202.1@tcp:35:mmap_sanity.0 Request processed in 466us (675us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1788391153.135793:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1788391153.147024:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391153.147103:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094142848 00000100:00100000:0.0:1788391153.147144:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094142848 00000100:00100000:0.0:1788391153.147219:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:0.0:1788391153.147230:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32902:x1875263094142848:12345-192.168.202.1@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788391153.147321:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788391153.147360:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd36f6b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffea4 expref: 33 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147385:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3673e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc97 expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147395:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391153.147405:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391153.147429:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147442:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147451:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147464:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147471:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147478:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147569:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147590:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.147597:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148068:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148077:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148085:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148092:0:42644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148098:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148104:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148125:0:42644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391153.148141:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148148:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148155:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148169:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391153.148175:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148177:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391153.148193:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148195:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148217:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391153.148228:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148229:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391153.148235:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788391153.148238:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148253:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd36f87 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148258:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148278:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:3.0:1788391153.148281:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788391153.148281:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148286:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148309:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd36f8e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148312:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148322:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148329:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391153.148334:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391153.148334:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391153.148337:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391153.148339:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391153.148348:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148373:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:0.0:1788391153.148376:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391153.148379:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391153.148385:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd36f79 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391153.151206:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abae570b reply state 000000004cd75801 transno 30064771192 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391153.151218:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391153.151529:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:32902:x1875263094142848:12345-192.168.202.1@tcp:36:mmap_sanity.0 Request processed in 4295us (4511us total) trans 30064771192 rc 0/0 00000100:00100000:0.0:1788391153.151540:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00010000:00010000:1.0:1788391153.154684:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.154711:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.154720:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.154726:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391153.154732:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.154741:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.154764:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff95d6a0d59600) 00010000:00010000:1.0:1788391153.154767:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391153.155047:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391153.155056:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd36f80 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391153.613195:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391153.613220:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103459200:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613290:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391153.613354:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103458816:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391153.613412:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391153.613418:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103459328:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613441:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391153.613462:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103458944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613473:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103458816 00000100:00100000:2.0:1788391153.613481:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103458816 00000100:00100000:0.0:1788391153.613500:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391153.613525:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103459456:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613531:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788391153.613551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391153.613563:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103458816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391153.613570:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391153.613577:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103459072:0@lo:400:kworker.0 00000100:00100000:0.0:1788391153.613610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391153.613624:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103458816:12345-0@lo:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391153.613634:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788391153.613649:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103458944 00000100:00100000:0.0:1788391153.613654:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103458944 00000100:00100000:2.0:1788391153.613692:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103458816:0@lo:400:kworker.0 00000100:00100000:0.0:1788391153.613696:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459072 00000100:00100000:0.0:1788391153.613701:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459072 00000100:00100000:2.0:1788391153.613722:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788391153.613732:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103458944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.613773:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103458944:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000004:00080000:3.0:1788391153.613937:0:42669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 970720973397ns, next at 971720970121ns, rc = 0 00000100:00100000:3.0:1788391153.613990:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391153.614046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391153.614094:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459584 00000100:00100000:3.0:1788391153.614101:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459584 00000100:00100000:3.0:1788391153.614146:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788391153.614156:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103459584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391153.614192:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391153.614240:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103459584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391153.614247:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788391153.614307:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103459584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788391153.614332:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391153.614358:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459200 00000100:00100000:1.0:1788391153.614366:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459200 00000100:00100000:1.0:1788391153.614402:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459328 00000100:00100000:1.0:1788391153.614415:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459328 00000100:00100000:1.0:1788391153.614429:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459456 00000100:00100000:1.0:1788391153.614431:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459456 00000100:00100000:1.0:1788391153.614450:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788391153.614456:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103459200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391153.614486:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103458944:0@lo:400:kworker.0 00000100:00100000:1.0:1788391153.614513:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103459200:12345-0@lo:400:kworker.0 Request processed in 54us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391153.614518:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788391153.614547:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788391153.614550:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103459200:0@lo:400:kworker.0 00000100:00100000:1.0:1788391153.614559:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103459328:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391153.614592:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391153.614597:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391153.614599:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391153.614619:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788391153.614628:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103459456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391153.614665:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103459456:12345-0@lo:400:kworker.0 Request processed in 40us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391153.614669:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788391153.614692:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103459456:0@lo:400:kworker.0 00000100:00100000:2.0:1788391153.614935:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391153.614984:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391153.615056:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103459072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391153.615384:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103459328:12345-0@lo:400:kworker.0 Request processed in 829us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391153.615388:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d584a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103459328:0@lo:400:kworker.0 00000100:00100000:1.0:1788391153.615398:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391153.615505:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103459072:12345-0@lo:400:kworker.0 Request processed in 514us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391153.615512:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788391153.616003:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103459072:0@lo:400:kworker.0 00000100:00100000:3.0:1788391154.264152:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391154.264205:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094142976 00000100:00100000:1.0:1788391154.264216:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094142976 00000100:00100000:1.0:1788391154.264311:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1788391154.264323:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+13:32288:x1875263094142976:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391154.264338:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:1.0:1788391154.264363:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd36879 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcd6 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264383:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:1.0:1788391154.264393:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd368c6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffceb expref: 12 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264404:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff95d6a0d29200) 00010000:00010000:1.0:1788391154.264418:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36da4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffe2d expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264437:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391154.264446:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd36bac lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffdbd expref: 10 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264453:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff95d686a70c00) 00000100:00080000:3.0:1788391154.264457:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788391154.264462:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd36ac5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffd69 expref: 9 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264469:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391154.264477:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd36895 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffcdd expref: 8 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.264482:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:1.0:1788391154.264484:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391154.265024:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+7:32288:x1875263094142976:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 702us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391154.265033:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1788391154.267582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391154.267901:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094143104 00000100:00100000:2.0:1788391154.267909:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094143104 00000100:00080000:3.0:1788391154.267949:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391154.267990:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1788391154.267998:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32287:x1875263094143104:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391154.268007:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788391154.268024:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd366ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc6d expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.268037:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70500) 00010000:00010000:2.0:1788391154.268047:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd36761 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc9e expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.268055:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70300) 00010000:00010000:2.0:1788391154.268067:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd36688 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc66 expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.268089:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d686a70000) 00010000:00010000:2.0:1788391154.268103:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd3666c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffc5f expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.268113:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391154.268119:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391154.268160:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32287:x1875263094143104:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391154.268166:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1788391154.288452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391154.288558:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094143232 00000100:00100000:1.0:1788391154.288568:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094143232 00000100:00100000:1.0:1788391154.288663:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:1.0:1788391154.288674:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:32941:x1875263094143232:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1788391154.288697:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391154.288720:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffeab expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.288816:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.288829:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.288841:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391154.288884:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391154.288889:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391154.288925:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.288949:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd36f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeab expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.288997:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeab expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391154.289005:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:1.0:1788391154.289008:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391154.289012:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6a00, rc 0) 00000100:00100000:1.0:1788391154.289072:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32941:x1875263094143232:12345-192.168.202.1@tcp:101:rm.0 Request processed in 400us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391154.289080:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:3.0:1788391154.292080:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391154.292144:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094143360 00000100:00100000:2.0:1788391154.292153:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094143360 00000100:00100000:2.0:1788391154.292205:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:2.0:1788391154.292225:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:32941:x1875263094143360:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788391154.292243:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391154.292261:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd36fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffeb2 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292319:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292333:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292345:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292359:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292379:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292387:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292620:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292626:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292631:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391154.292654:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391154.292657:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391154.292671:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292679:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292684:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292688:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292691:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391154.292694:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292703:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292711:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:2.0:1788391154.292713:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391154.292716:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292719:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd36faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292728:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292732:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292735:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292738:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391154.292740:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292743:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292746:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d6830d2100) 00010000:00010000:2.0:1788391154.292747:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391154.292749:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292757:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd36fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292777:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd36fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeb2 expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292785:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeb2 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391154.292790:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2400) 00010000:00010000:2.0:1788391154.292792:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391154.292793:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788391154.292836:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32941:x1875263094143360:12345-192.168.202.1@tcp:101:rm.0 Request processed in 614us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391154.292841:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:0.0:1788391154.300827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391154.300947:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094143616 00000100:00100000:3.0:1788391154.301029:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094143616 00000100:00100000:3.0:1788391154.301137:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391154.301157:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:32941:x1875263094143616:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788391154.301191:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391154.301223:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffeb9 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391154.305042:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788391154.305340:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeb9 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.305367:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:3.0:1788391154.305372:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391154.305380:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeb9 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.305404:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391154.305547:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32941:x1875263094143616:12345-192.168.202.1@tcp:101:rm.0 Request processed in 4393us (4724us total) trans 30064771193 rc 301/301 00000100:00100000:3.0:1788391154.305560:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:2.0:1788391154.313555:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391154.313705:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094143744 00000100:00100000:0.0:1788391154.313717:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094143744 00000100:00100000:0.0:1788391154.313772:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788391154.313780:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32941:x1875263094143744:12345-192.168.202.1@tcp:37:rm.0 00000100:00100000:3.0:1788391154.322447:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32941:x1875263094143744:12345-192.168.202.1@tcp:37:rm.0 Request processed in 8648us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391154.322478:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788391154.325409:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391154.325525:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144000 00000100:00100000:1.0:1788391154.325541:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144000 00000100:00100000:1.0:1788391154.325634:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788391154.325645:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:32941:x1875263094144000:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:1.0:1788391154.325913:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32941:x1875263094144000:12345-192.168.202.1@tcp:35:rm.0 Request processed in 268us (516us total) trans 30064771194 rc 0/0 00000100:00100000:1.0:1788391154.325920:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391154.330165:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391154.330253:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144256 00000100:00100000:3.0:1788391154.330264:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144256 00000100:00100000:3.0:1788391154.330316:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:3.0:1788391154.330326:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32941:x1875263094144256:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:3.0:1788391154.330379:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788391154.330405:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd36fb8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeb2 expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330426:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d6830d2400) 00010000:00010000:3.0:1788391154.330443:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd36f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeab expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330467:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29c00) 00010000:00010000:3.0:1788391154.330475:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391154.330504:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330516:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330523:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330531:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330536:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330540:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330749:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330755:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.330767:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391154.331283:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788391154.331295:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331304:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331308:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331312:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391154.331315:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331322:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331331:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391154.331334:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788391154.331337:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331342:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36fdb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331359:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331365:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331371:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331375:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391154.331383:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331389:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331396:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:3.0:1788391154.331399:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391154.331401:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.331407:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd36fcd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391154.331419:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dfbe3d0 reply state 00000000704052b5 transno 30064771195 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391154.331427:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391154.331503:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:32941:x1875263094144256:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1173us (1341us total) trans 30064771195 rc 0/0 00000100:00100000:3.0:1788391154.331511:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00010000:00010000:3.0:1788391154.334075:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334090:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334096:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334101:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391154.334106:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334125:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334147:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff95d686a70200) 00010000:00010000:3.0:1788391154.334150:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391154.334154:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391154.334160:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36fd4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391154.637182:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391154.637263:0:42667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 971744300641ns, next at 972744298395ns, rc = 0 00000100:00100000:0.0:1788391154.637270:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391154.637291:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103459712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391154.637375:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391154.637474:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459712 00000100:00100000:3.0:1788391154.637482:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459712 00000100:00100000:3.0:1788391154.637536:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391154.637547:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103459712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391154.637579:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788391154.637630:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103459712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391154.637637:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788391154.637696:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103459712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391155.318953:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319060:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319146:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391155.319171:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144640 00000100:00100000:2.0:1788391155.319179:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144640 00000100:00100000:2.0:1788391155.319237:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145152 00000100:00100000:2.0:1788391155.319240:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145152 00000100:00100000:2.0:1788391155.319252:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144768 00000100:00100000:2.0:1788391155.319255:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144768 00000100:00100000:2.0:1788391155.319267:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145024 00000100:00100000:2.0:1788391155.319269:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145024 00000100:00100000:2.0:1788391155.319284:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788391155.319293:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2358:x1875263094144640:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319365:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2358:x1875263094144640:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319373:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1788391155.319388:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788391155.319394:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2358:x1875263094145152:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319418:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2358:x1875263094145152:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319424:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788391155.319436:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391155.319443:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094144768:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319466:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094144768:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319471:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391155.319481:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391155.319487:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2359:x1875263094145024:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319509:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2359:x1875263094145024:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319523:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391155.319543:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144512 00000100:00100000:2.0:1788391155.319547:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144512 00000100:00100000:2.0:1788391155.319572:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144896 00000100:00100000:2.0:1788391155.319576:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144896 00000100:00100000:2.0:1788391155.319594:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391155.319601:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2359:x1875263094144512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319631:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2359:x1875263094144512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319638:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1788391155.319649:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1788391155.319656:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2358:x1875263094144896:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391155.319677:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+7:2358:x1875263094144896:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391155.319683:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00080000:2.0:1788391155.319703:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391155.319707:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391155.319993:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094144384 00000100:00100000:0.0:1788391155.319999:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094144384 00000100:00100000:0.0:1788391155.320029:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788391155.320037:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094144384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391155.320081:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094144384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391155.320088:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00010000:00010000:3.0:1788391155.661590:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788391155.688946:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771083 is committed 00000001:00080000:2.0:1788391155.688987:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771085 is committed 00000001:00080000:2.0:1788391155.688994:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771084 is committed 00010000:00010000:2.0:1788391156.689902:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788391156.739922:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771087 is committed 00000001:00080000:2.0:1788391156.739942:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771086 is committed 00000001:00080000:2.0:1788391156.739949:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771085 is committed 00000001:00080000:2.0:1788391156.742046:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771192 is committed 00000001:00080000:2.0:1788391156.742070:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771177 is committed 00000020:00080000:2.0:1788391156.742090:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d684eb3f00 refcount 2 committed 0 result 0 batchid 25769803900 00000020:00080000:2.0:1788391156.742095:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68fcd8100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d684eb3000 00000020:00080000:2.0:1788391156.742098:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68fcd8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58a880000 00000020:00080000:2.0:1788391156.742120:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803899 batchid updated 00000020:00080000:1.0:1788391156.742132:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803900 committed batchid 25769803899 00000004:00080000:2.0:1788391156.742133:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1788391156.742147:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771194 is committed 00000001:00080000:2.0:1788391156.742179:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771195 is committed 00000004:00080000:2.0:1788391156.742188:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788391156.742427:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000100:00100000:1.0:1788391156.742593:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103459840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391156.742686:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103459968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391156.742719:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391156.742781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391156.742854:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459840 00000100:00100000:1.0:1788391156.742864:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459840 00000100:00080000:2.0:1788391156.742922:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391156.742945:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103459968 00000100:00100000:1.0:1788391156.742950:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103459968 00000100:00080000:2.0:1788391156.743008:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391156.743029:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788391156.743043:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103459840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391156.743056:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788391156.743069:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103459968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788391156.743094:0:43328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:195 count 1 00002000:00010000:3.0:1788391156.743123:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a98aeee, atime: 0x6a98aeea, ctime: 0x6a98aeee, blocks: 0x403 00010000:00010000:3.0:1788391156.743130:0:43328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391156.743149:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=973s v=(0 0) 00010000:00010000:3.0:1788391156.743154:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391156.743158:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391156.743171:0:43328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391156.743180:0:43328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391156.743186:0:43328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391156.743204:0:43328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391156.743227:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391156.743233:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743357:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00000100:00100000:1.0:1788391156.743364:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103459840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (642us total) trans 30064771088 rc 0/0 00010000:00010000:2.0:1788391156.743367:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391156.743383:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788391156.743392:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743414:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743422:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd36fe2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743453:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391156.743454:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391156.743458:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391156.743466:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771086 gen 2 00000004:00080000:1.0:1788391156.743475:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771086 committed transno 30064771086 00000100:00100000:1.0:1788391156.743505:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d687863480 x1875263103459840/t30064771088(30064771088) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788391172 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788391156.743519:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d687863480/2, rc 0, transno 30064771088 00000100:00100000:1.0:1788391156.743540:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103459840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788391156.743610:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103460096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788391156.743654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391156.743729:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460096 00000100:00100000:2.0:1788391156.743737:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460096 00000100:00100000:2.0:1788391156.743779:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788391156.743788:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103460096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788391156.743789:0:43327:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788391156.743809:0:43327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:2.0:1788391156.743812:0:43698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:195 count 1 00000100:00100000:3.0:1788391156.743817:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103459968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 751us (1037us total) trans 30064771086 rc 0/0 00000100:00100000:3.0:1788391156.743824:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00002000:00010000:2.0:1788391156.743848:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a98aef0, atime: 0x6a98aeef, ctime: 0x6a98aef0, blocks: 0xb 00010000:00010000:2.0:1788391156.743854:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743863:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=973s v=(0 0) 00010000:00010000:2.0:1788391156.743866:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391156.743871:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391156.743881:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771084 gen 2 00010000:00010000:2.0:1788391156.743885:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391156.743887:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771084 committed transno 30064771084 00010000:00010000:2.0:1788391156.743893:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.743900:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391156.743911:0:3286:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d6bc68ce00 x1875263103459968/t30064771086(30064771086) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391172 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788391156.743923:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68ce00/2, rc 0, transno 30064771086 00000100:00100000:3.0:1788391156.743928:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103459968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788391156.743929:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788391156.745507:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103460096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1714us (1847us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1788391156.745519:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1788391156.745548:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391156.745555:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.745566:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391156.745570:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.745579:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.745598:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.745605:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd36fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391156.745620:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391156.745622:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391156.745623:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391156.745633:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68c700/2, rc 0, transno 30064771089 00000100:00100000:1.0:1788391156.745647:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103460096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788391157.710489:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391157.797659:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391157.797732:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145280 00000100:00100000:3.0:1788391157.797740:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145280 00000100:00100000:3.0:1788391157.797799:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1788391157.797807:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:33364:x1875263094145280:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:3.0:1788391157.797835:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391157.797859:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffec0 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.797914:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.797925:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.797934:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391157.797997:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391157.798001:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391157.798036:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.798054:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec0 expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.798070:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec0 expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391157.798077:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391157.798080:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391157.798100:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:3.0:1788391157.798157:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:33364:x1875263094145280:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 349us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391157.798164:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00080000:2.0:1788391157.798353:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391157.850428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391157.850563:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145408 00000100:00100000:3.0:1788391157.850574:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145408 00000100:00100000:3.0:1788391157.850639:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:3.0:1788391157.850660:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32891:x1875263094145408:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788391157.850826:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32891:x1875263094145408:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391157.850836:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:1.0:1788391157.854575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391157.855144:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145664 00000100:00100000:3.0:1788391157.855157:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145664 00000100:00100000:3.0:1788391157.855229:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1788391157.855242:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:32891:x1875263094145664:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391157.855620:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:32891:x1875263094145664:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 377us (1056us total) trans 30064771196 rc 0/0 00000100:00100000:3.0:1788391157.855629:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:2.0:1788391158.015814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391158.015907:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145792 00000100:00100000:3.0:1788391158.015915:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145792 00000100:00100000:3.0:1788391158.016001:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:3.0:1788391158.016009:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:33382:x1875263094145792:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:3.0:1788391158.016027:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788391158.016039:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788391158.016044:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffec7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016120:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016133:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016146:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391158.016181:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391158.016185:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391158.016224:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016258:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd36ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016275:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391158.016283:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391158.016286:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391158.016289:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1400, rc 0) 00000100:00100000:3.0:1788391158.016345:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:33382:x1875263094145792:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 337us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391158.016352:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00010000:00010000:2.0:1788391158.733362:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391158.733678:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103460352:0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.733746:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391158.733795:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103460864:0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.733823:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391158.733852:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788391158.733858:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103460224:0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.733884:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391158.733906:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103460736:0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.733932:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391158.733981:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460224 00000100:00100000:2.0:1788391158.733989:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460224 00000100:00100000:2.0:1788391158.734033:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788391158.734042:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103460224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.734091:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103460224:12345-0@lo:400:kworker.0 Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391158.734098:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788391158.734146:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103460224:0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.734222:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460352 00000100:00100000:0.0:1788391158.734227:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460352 00000100:00100000:0.0:1788391158.734271:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788391158.734284:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103460352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.734326:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103460352:12345-0@lo:400:kworker.0 Request processed in 49us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391158.734349:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788391158.734381:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103460352:0@lo:400:kworker.0 00000100:00080000:2.0:1788391158.734440:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391158.734497:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103460608:0@lo:400:kworker.0 00000100:00100000:1.0:1788391158.734529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391158.734591:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391158.734597:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103460480:0@lo:400:kworker.0 00000100:00100000:1.0:1788391158.734621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391158.734685:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460480 00000100:00100000:2.0:1788391158.734690:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460480 00000100:00100000:2.0:1788391158.734727:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788391158.734735:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103460480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391158.734780:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103460480:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391158.734796:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788391158.734825:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391158.734849:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103460480:0@lo:400:kworker.0 00000100:00100000:3.0:1788391158.734855:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103460992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391158.734894:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391158.734945:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460992 00000100:00100000:3.0:1788391158.734950:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460992 00000100:00100000:3.0:1788391158.735002:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391158.735008:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103460992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391158.735036:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391158.735070:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103460992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391158.735076:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391158.735110:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103460992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391158.736322:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460864 00000100:00100000:0.0:1788391158.736333:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460864 00000100:00100000:0.0:1788391158.736397:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460736 00000100:00100000:0.0:1788391158.736401:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460736 00000100:00100000:0.0:1788391158.736418:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103460608 00000100:00100000:0.0:1788391158.736421:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103460608 00000100:00100000:0.0:1788391158.736438:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788391158.736447:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103460864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.736522:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103460864:12345-0@lo:400:kworker.0 Request processed in 75us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391158.736529:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788391158.736544:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788391158.736550:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103460736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.736579:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103460736:12345-0@lo:400:kworker.0 Request processed in 29us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391158.736585:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788391158.736610:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788391158.736617:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103460608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.736652:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103460608:12345-0@lo:400:kworker.0 Request processed in 35us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391158.736658:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788391158.736702:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103460608:0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.736737:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103460736:0@lo:400:kworker.0 00000100:00100000:0.0:1788391158.736764:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103460864:0@lo:400:kworker.0 00000100:00080000:3.0:1788391158.737545:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788391159.356572:0:44978:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 5: Mmap 00000100:00100000:0.0:1788391159.757344:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5872e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103461120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391159.757445:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391159.757613:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103461120 00000100:00100000:1.0:1788391159.757624:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103461120 00000100:00100000:1.0:1788391159.757687:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788391159.757700:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103461120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391159.757747:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391159.757844:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103461120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391159.757853:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788391159.757953:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5872e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103461120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391159.761051:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391159.949387:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391159.949468:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094145920 00000100:00100000:2.0:1788391159.949483:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094145920 00000100:00100000:2.0:1788391159.949592:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:2.0:1788391159.949606:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:33641:x1875263094145920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391159.949638:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391159.949670:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3700c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffece expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949752:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949770:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949786:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949815:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949823:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.949831:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788391159.950106:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391159.950349:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd37021 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950367:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd37021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950376:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd37021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391159.950416:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391159.950421:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391159.950445:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd37021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950458:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950465:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950472:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950478:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391159.950483:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950490:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950504:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:2.0:1788391159.950507:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391159.950512:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950529:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950543:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950550:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950556:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950561:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391159.950564:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950570:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950578:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95d6830d2400) 00010000:00010000:2.0:1788391159.950581:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391159.950584:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950589:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3701a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950626:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3700c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffece expref: 9 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950779:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f600/0x9aafc5f04cd37021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffece expref: 8 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.950789:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:2.0:1788391159.950792:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391159.950794:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f600, rc 0) 00000100:00100000:2.0:1788391159.951223:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:33641:x1875263094145920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1618us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391159.951229:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:1.0:1788391159.956650:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391159.956889:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146176 00000100:00100000:2.0:1788391159.956903:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146176 00000100:00100000:2.0:1788391159.957108:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1788391159.957123:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:33641:x1875263094146176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391159.957150:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391159.957174:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37028 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffed5 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957270:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957287:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957300:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957315:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957340:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.957347:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958122:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3703d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958135:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3703d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958144:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3703d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391159.958156:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788391159.958275:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958284:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958291:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958298:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ec00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391159.958303:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958311:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958337:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:2.0:1788391159.958340:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391159.958346:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958353:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3702f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958369:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958376:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958382:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958387:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391159.958390:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958396:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958404:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6830d2400) 00010000:00010000:2.0:1788391159.958406:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391159.958409:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.958416:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37036 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.959698:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37028 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffed5 expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.959727:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e400/0x9aafc5f04cd3703d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffed5 expref: 10 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391159.959736:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391159.959739:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391159.959741:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e400, rc 0) 00000100:00100000:2.0:1788391159.959929:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:33641:x1875263094146176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2808us (3294us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1788391159.959941:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:0.0:1788391159.962675:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391159.962998:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146304 00000100:00100000:3.0:1788391159.963012:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146304 00000100:00100000:3.0:1788391159.963089:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:3.0:1788391159.963102:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:33641:x1875263094146304:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788391159.963317:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:33641:x1875263094146304:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 216us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391159.963327:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:0.0:1788391160.022238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.022307:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146560 00000100:00100000:3.0:1788391160.022322:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146560 00000100:00100000:3.0:1788391160.022460:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1788391160.022475:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:33655:x1875263094146560:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391160.022507:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.022510:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391160.022552:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd36ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec0 expref: 10 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.022597:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391160.022603:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391160.022635:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd3704b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffedc expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.023015:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.023029:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.023036:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.023072:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.023083:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 5 pid: 42644 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.023096:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103461248:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391160.023203:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788391160.025471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.025489:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103461248:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391160.025526:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.025549:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146688 00000100:00100000:0.0:1788391160.025557:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146688 00000100:00080000:3.0:1788391160.025603:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788391160.025606:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 6 pid: 42644 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.025664:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1788391160.025677:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094146688:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391160.025695:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391160.025703:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 6 pid: 42644 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025718:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 6 pid: 42644 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025747:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffec7 expref: 6 pid: 42644 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025765:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:0.0:1788391160.025770:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025790:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025806:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.025841:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391160.025954:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.025986:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.026016:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.026023:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094146688:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 345us (615us total) trans 0 rc 0/0 00010000:00010000:3.0:1788391160.026032:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.026034:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00010000:00010000:3.0:1788391160.026051:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391160.027555:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc4:0x0], index 0: 0 00010000:00010000:3.0:1788391160.027950:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028000:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028015:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028069:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028077:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028086:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028105:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.028111:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028120:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028135:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391160.028138:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.028143:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028149:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37052 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391160.028165:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a24b57d reply state 000000002f64e37d transno 30064771198 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.028175:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391160.028221:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd3704b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 12 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028246:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 11 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.028254:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:3.0:1788391160.028257:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391160.028260:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:3.0:1788391160.028347:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:33655:x1875263094146560:12345-192.168.202.1@tcp:101:bash.0 Request processed in 5875us (6123us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1788391160.028363:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00010000:00010000:3.0:1788391160.030266:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030279:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030284:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030287:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.030291:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030296:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030309:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d686a70e00) 00010000:00010000:3.0:1788391160.030311:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.030314:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.030318:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37059 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391160.031342:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.031461:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146816 00000100:00100000:2.0:1788391160.031474:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146816 00000100:00080000:3.0:1788391160.031520:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391160.031556:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788391160.031570:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094146816:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391160.031592:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.031617:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffee3 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391160.031649:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391160.031672:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=977s v=(0 0) 00010000:00010000:2.0:1788391160.031678:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391160.031690:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 6 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.031735:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 6 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.031749:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391160.031829:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094146816:12345-192.168.202.1@tcp:101:bash.0 Request processed in 262us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.031838:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1788391160.036199:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.036295:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094146944 00000100:00100000:3.0:1788391160.036309:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094146944 00000100:00100000:3.0:1788391160.036384:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1788391160.036398:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:33655:x1875263094146944:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391160.036440:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.036463:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffeea expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.036502:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.036509:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391160.036512:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391160.036516:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.036558:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.036574:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 1077 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.036591:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103461376:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391160.036745:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391160.041925:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:43328:1875263103461376:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391160.042010:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 7 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.042041:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:3.0:1788391160.042154:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:33655:x1875263094146944:12345-192.168.202.1@tcp:101:bash.0 Request processed in 5758us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.042169:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788391160.043946:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.044071:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094147072 00000100:00100000:2.0:1788391160.044085:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094147072 00010000:00010000:2.0:1788391160.044195:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 1077 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.044295:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391160.044308:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094147072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391160.044329:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391160.044359:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 1077 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.044376:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 1077 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.044405:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a68acc/0x9aafc5f04cd3706e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffee3 expref: 7 pid: 43698 timeout: 1077 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.044438:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391160.044444:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391160.044455:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.044467:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.044516:0:42630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.044533:0:42630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:42630:1875263103461504:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391160.044648:0:42630:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69fd21a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391160.051671:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.051758:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094147328 00000100:00100000:3.0:1788391160.051770:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094147328 00000100:00100000:3.0:1788391160.051957:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788391160.051998:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:33655:x1875263094147328:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:3.0:1788391160.052651:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:33655:x1875263094147328:12345-192.168.202.1@tcp:35:bash.0 Request processed in 653us (994us total) trans 30064771199 rc 0/0 00000100:00100000:3.0:1788391160.052662:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391160.052733:0:42630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:42630:1875263103461504:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391160.052766:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391160.052811:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094147072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8492us (8864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.052823:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1788391160.094268:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.094425:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094147456 00000100:00100000:2.0:1788391160.094437:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094147456 00000100:00100000:2.0:1788391160.094531:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:2.0:1788391160.094543:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:33661:x1875263094147456:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391160.094573:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.094598:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3707c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffef1 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094697:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094725:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094748:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391160.094805:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391160.094810:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391160.094837:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094869:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3707c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef1 expref: 14 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094891:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef1 expref: 13 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.094901:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391160.094904:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391160.094909:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f800, rc 0) 00000100:00100000:2.0:1788391160.095097:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:33661:x1875263094147456:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 555us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.095102:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1788391160.098318:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.098411:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094147712 00000100:00100000:2.0:1788391160.098423:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094147712 00000100:00100000:2.0:1788391160.098508:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1788391160.098520:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:33661:x1875263094147712:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391160.098550:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.098575:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3708a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffef8 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.098877:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.098894:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.098901:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.098941:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.098952:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 14 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.099092:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103461632:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391160.099266:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69fd21a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391160.101305:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391160.101388:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094147840 00000100:00100000:0.0:1788391160.101398:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094147840 00010000:00010000:0.0:1788391160.101439:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 15 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.101508:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788391160.101516:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094147840:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391160.101530:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391160.101536:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 15 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.101548:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 15 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.101571:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:0.0:1788391160.101575:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.101600:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.101605:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.101622:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391160.101679:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094147840:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391160.101688:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00010000:00010000:2.0:1788391160.101774:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37060 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffedc expref: 14 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.101796:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103461632:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391160.101841:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.101859:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.101866:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391160.101891:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788391160.102145:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ec00/0x9aafc5f04cd3708a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef8 expref: 15 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.102178:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef8 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.102186:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:2.0:1788391160.102189:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391160.102192:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788391160.102233:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:33661:x1875263094147712:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3715us (3926us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1788391160.102241:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:1.0:1788391160.104622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.104687:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148096 00000100:00100000:3.0:1788391160.104828:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148096 00000100:00100000:3.0:1788391160.104890:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1788391160.104899:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:33661:x1875263094148096:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391160.104927:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.104929:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391160.104955:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd37091 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef8 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105002:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:3.0:1788391160.105013:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391160.105028:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd3709f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffeff expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105147:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105158:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105190:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391160.105203:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1788391160.105350:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd3709f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeff expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105362:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeff expref: 15 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.105368:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70e00) 00010000:00010000:3.0:1788391160.105370:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391160.105371:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1a00, rc 0) 00000100:00100000:3.0:1788391160.105447:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:33661:x1875263094148096:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 548us (835us total) trans 30064771201 rc 0/0 00000100:00100000:3.0:1788391160.105454:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1788391160.108367:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.108529:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148224 00000100:00100000:2.0:1788391160.108543:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148224 00000100:00100000:2.0:1788391160.108661:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:2.0:1788391160.108675:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:33661:x1875263094148224:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391160.108717:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.108753:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff06 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.108877:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.108896:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.108919:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70e00) 00010000:00010000:2.0:1788391160.108921:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391160.108925:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391160.109021:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:33661:x1875263094148224:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 349us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.109029:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1788391160.112514:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.112567:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148352 00000100:00100000:3.0:1788391160.112579:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148352 00000100:00100000:3.0:1788391160.112688:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788391160.112701:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094148352:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1788391160.112780:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.112812:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.112841:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391160.112845:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391160.112849:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.112889:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.112902:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 6 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.112916:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103461760:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391160.113040:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391160.115513:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103461760:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391160.115556:0:44885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391160.115890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.116093:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148480 00000100:00100000:2.0:1788391160.116104:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148480 00002000:00100000:2.0:1788391160.116182:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff95d5872eb100 x1875263094148480/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:21/0 lens 504/0 e 0 to 0 dl 1788391171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391160.116193:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872eb100 with x1875263094148480 ext(0->15) 00010000:00010000:2.0:1788391160.116202:0:43331:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 7 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.116219:0:43331:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 7 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391160.116226:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d5872eb100 00000100:00100000:2.0:1788391160.116263:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1788391160.116291:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094148480:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:2.0:1788391160.117570:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094148480:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1267us (1669us total) trans 30064771087 rc 0/0 00000100:00100000:2.0:1788391160.117584:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:2.0:1788391160.117596:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff95d5872eb100 x1875263094148480/t30064771087(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:21/0 lens 504/448 e 0 to 0 dl 1788391171 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391160.117605:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872eb100 with x1875263094148480 ext(0->15) 00010000:00010000:2.0:1788391160.117614:0:43331:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.117631:0:43331:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391160.117638:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d5872eb100 00000100:00100000:1.0:1788391160.120307:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.120385:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148608 00000100:00100000:2.0:1788391160.120411:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148608 00010000:00010000:2.0:1788391160.120465:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.120520:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391160.120533:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2358:x1875263094148608:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391160.120561:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788391160.120600:0:42630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:2.0:1788391160.120604:0:42630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788391160 00002000:00010000:2.0:1788391160.120606:0:42630:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1788391160 00002000:00010000:2.0:1788391160.120627:0:42630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb ctime from disk: 0 -> 1788391160 00010000:00010000:2.0:1788391160.120635:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.120650:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.120684:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134783e5/0x9aafc5f04cd37075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeea expref: 9 pid: 43328 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.120706:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391160.120711:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391160.120719:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.120730:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.121015:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391160.121088:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5852f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2358:x1875263094148608:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 553us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.121097:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00010000:00010000:3.0:1788391160.121208:0:44885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121219:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121255:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121281:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121289:0:44885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121298:0:44885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391160.121303:0:44885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121313:0:44885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121328:0:44885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.121346:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68aac6c/0x9aafc5f04cd370bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.121412:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094148352:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 8714us (8912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.121421:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788391160.125704:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391160.125913:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148864 00000100:00100000:0.0:1788391160.125925:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148864 00000100:00100000:0.0:1788391160.126054:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1788391160.126068:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:33661:x1875263094148864:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:0.0:1788391160.126151:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeff expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391160.126570:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771202 00000001:00080000:0.0:1788391160.126704:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771203 00000001:00080000:0.0:1788391160.127411:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771204 00010000:00010000:0.0:1788391160.127474:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.127495:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 20 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.127504:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.127554:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 20 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.127569:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 20 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391160.127704:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103461888:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391160.127818:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391160.130517:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391160.130517:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103461888:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391160.130561:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.130606:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094148992 00000100:00100000:2.0:1788391160.130616:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094148992 00010000:00010000:2.0:1788391160.130667:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 21 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.130717:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1788391160.130744:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094148992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391160.130766:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391160.130784:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 21 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130810:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 21 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130840:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370b4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff06 expref: 21 pid: 43348 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130860:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70e00) 00010000:00010000:2.0:1788391160.130866:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130878:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130886:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.130915:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391160.130940:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391160.130948:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.131031:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2356:x1875263094148992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 288us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.131039:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000001:00080000:0.0:1788391160.131144:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771205 00000001:00080000:0.0:1788391160.131399:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771206 00000100:00100000:0.0:1788391160.131544:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103462016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391160.131603:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391160.131644:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391160.131647:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103462016 00000100:00100000:2.0:1788391160.131652:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103462016 00000100:00100000:2.0:1788391160.131706:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788391160.131713:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103462016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391160.131833:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103462016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 119us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.131840:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788391160.131921:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103462016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391160.132465:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771207 00000100:00100000:1.0:1788391160.132523:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5872ea300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103462144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391160.132572:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391160.132598:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68316c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391160.132636:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103462144 00000100:00100000:3.0:1788391160.132640:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103462144 00000100:00100000:3.0:1788391160.132673:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788391160.132689:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103462144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788391160.132815:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391160.132851:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:42648:x1875263103462144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (278us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1788391160.132856:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788391160.133313:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5872ea300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103462144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391160.133364:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771208 00010000:00010000:1.0:1788391160.133406:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133418:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133426:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133433:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391160.133438:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133471:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133491:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70e00) 00010000:00010000:1.0:1788391160.133494:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788391160.133499:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391160.133506:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd370c2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391160.133732:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788391160.133869:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].6, 64 off8624 00000004:00080000:1.0:1788391160.133880:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 977240918719ns, next at 978240917073ns, rc = 0 00000001:00080000:1.0:1788391160.133886:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771209 00010000:00010000:1.0:1788391160.133914:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70e00) 00010000:00010000:1.0:1788391160.133917:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391160.133924:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd370a6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffeff expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391160.134090:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:33661:x1875263094148864:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 8024us (8401us total) trans 30064771210 rc 0/0 00000100:00100000:1.0:1788391160.134100:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000020:00080000:1.0:1788391160.134105:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788391160.138818:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.138924:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094149120 00000100:00100000:3.0:1788391160.138937:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094149120 00000100:00100000:3.0:1788391160.139160:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1788391160.139172:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:33661:x1875263094149120:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391160.139204:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.139234:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd370c9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff0d expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.139322:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd370c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff0d expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.139342:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd370c9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff0d expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.139365:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:3.0:1788391160.139369:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391160.139373:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391160.139458:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:33661:x1875263094149120:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 278us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.139466:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:2.0:1788391160.145381:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.145442:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094149376 00000100:00100000:3.0:1788391160.145465:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094149376 00000100:00100000:3.0:1788391160.145523:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788391160.145549:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:33661:x1875263094149376:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391160.145918:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:33661:x1875263094149376:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 370us (551us total) trans 30064771211 rc 0/0 00000100:00100000:3.0:1788391160.145927:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1788391160.184412:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.184496:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094149504 00000100:00100000:2.0:1788391160.184511:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094149504 00000100:00100000:2.0:1788391160.184587:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:2.0:1788391160.184598:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:33671:x1875263094149504:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391160.184705:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184725:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184738:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184757:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184765:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184772:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184891:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184897:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.184918:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391160.185014:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185027:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185032:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185038:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185042:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.185045:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185050:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185062:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391160.185064:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391160.185068:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185073:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd370d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185089:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185101:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185108:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185121:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.185126:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185131:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185137:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d6830d2200) 00010000:00010000:2.0:1788391160.185138:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391160.185140:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185144:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd370d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185156:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185159:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185163:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185168:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.185176:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185182:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185189:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:2.0:1788391160.185191:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391160.185194:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.185201:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd370de lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391160.185293:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:33671:x1875263094149504:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 696us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.185302:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1788391160.209105:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.209175:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094149632 00000100:00100000:3.0:1788391160.209189:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094149632 00000100:00100000:3.0:1788391160.209271:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1788391160.209284:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:33672:x1875263094149632:12345-192.168.202.1@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788391160.209311:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.209348:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd370e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff14 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209431:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209448:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209462:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209477:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209484:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209490:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209626:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209635:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209642:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391160.209688:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788391160.209694:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391160.209747:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209762:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209772:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209779:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209786:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209792:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.209810:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209820:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209842:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391160.209846:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.209852:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209859:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd370ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209875:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209881:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209887:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209893:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.209896:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209901:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209907:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d686a70100) 00010000:00010000:3.0:1788391160.209909:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.209912:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.209918:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd370f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.210027:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd370e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff14 expref: 27 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.210043:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff14 expref: 26 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.210052:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:3.0:1788391160.210054:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391160.210058:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391160.210138:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33672:x1875263094149632:12345-192.168.202.1@tcp:101:mmap_cat.0 Request processed in 856us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.210146:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:1.0:1788391160.213082:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.213155:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094149888 00000100:00100000:3.0:1788391160.213170:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094149888 00000100:00100000:3.0:1788391160.213257:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1788391160.213266:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33672:x1875263094149888:12345-192.168.202.1@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788391160.213288:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.213309:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff1b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.213415:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37108 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.213427:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37108 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.213440:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37108 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391160.213463:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1788391160.213644:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff1b expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.213667:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37108 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff1b expref: 28 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.213677:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:3.0:1788391160.213681:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788391160.213685:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:3.0:1788391160.213756:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33672:x1875263094149888:12345-192.168.202.1@tcp:101:mmap_cat.0 Request processed in 491us (688us total) trans 30064771212 rc 0/0 00000100:00100000:3.0:1788391160.213762:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788391160.231501:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391160.231592:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150272 00000100:00100000:0.0:1788391160.231608:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150272 00000100:00100000:0.0:1788391160.231691:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788391160.231701:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33673:x1875263094150272:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788391160.232232:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33673:x1875263094150272:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 530us (747us total) trans 30064771213 rc 0/0 00000100:00100000:0.0:1788391160.232242:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788391160.239908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.240068:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150400 00000100:00100000:2.0:1788391160.240080:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150400 00000100:00100000:2.0:1788391160.241817:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1788391160.242339:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33673:x1875263094150400:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:2.0:1788391160.242471:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788391160.242504:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd370fa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff14 expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.242531:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37108 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff1b expref: 28 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.242544:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd370c9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff0d expref: 27 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.242577:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70400) 00010000:00010000:2.0:1788391160.242593:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391160.242687:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33673:x1875263094150400:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 624us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.242697:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1788391160.245416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.245527:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150528 00000100:00100000:3.0:1788391160.245538:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150528 00000100:00100000:3.0:1788391160.245599:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1788391160.245608:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33673:x1875263094150528:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:3.0:1788391160.245775:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.245795:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.245822:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391160.246236:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].5, 136 off8872 00000100:00100000:3.0:1788391160.246843:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33673:x1875263094150528:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1231us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.246854:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:1.0:1788391160.265201:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.265348:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150656 00000100:00100000:2.0:1788391160.265362:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150656 00000100:00100000:2.0:1788391160.265436:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:2.0:1788391160.265452:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:33675:x1875263094150656:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391160.265486:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.265514:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3711d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff22 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.266950:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.266994:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267008:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267027:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267033:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267058:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267171:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267178:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267183:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391160.267222:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:2.0:1788391160.267226:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391160.267245:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267254:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267262:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267267:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267271:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267275:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.267279:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267289:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267301:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391160.267303:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391160.267306:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267311:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267372:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267377:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267381:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267384:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.267386:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267389:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267393:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d6830d2200) 00010000:00010000:2.0:1788391160.267395:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391160.267396:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267408:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3712b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267441:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3711d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 28 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267451:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 27 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.267457:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391160.267459:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391160.267460:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788391160.267546:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33675:x1875263094150656:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2091us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.267558:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:1.0:1788391160.437374:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391160.437417:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.437457:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150912 00000100:00100000:1.0:1788391160.437463:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.437472:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150912 00000100:00100000:3.0:1788391160.437480:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151168 00000100:00100000:3.0:1788391160.437487:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151168 00000100:00100000:1.0:1788391160.437512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391160.437543:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094150784 00000100:00100000:0.0:1788391160.437552:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094150784 00000100:00080000:1.0:1788391160.437568:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391160.437576:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151040 00000100:00100000:2.0:1788391160.437582:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151040 00000100:00100000:3.0:1788391160.437587:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788391160.437604:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094151168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391160.437612:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391160.437622:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788391160.437628:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094150912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391160.437632:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788391160.437638:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094150784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391160.437649:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094151040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391160.437706:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094151168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 107us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.437714:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00080000:3.0:1788391160.437745:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391160.438858:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094150784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1216us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391160.438865:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094150912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1239us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391160.438874:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788391160.438879:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1788391160.439072:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094151040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1426us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.439082:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000040:00080000:3.0:1788391160.743744:0:45028:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391160.743760:0:45028:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391160.743835:0:45028:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1788391160.743842:0:45028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391160.781064:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788391160.808517:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771087 is committed 00000001:00080000:2.0:1788391160.808548:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771088 is committed 00000040:00080000:0.0:1788391160.973298:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391160.973313:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391160.973361:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:0.0:1788391160.973368:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391160.973542:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103462272:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391160.973724:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683071f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391160.977568:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103462272:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391160.978248:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.978357:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151296 00000100:00100000:2.0:1788391160.978367:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151296 00000100:00100000:2.0:1788391160.978443:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:2.0:1788391160.978455:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33687:x1875263094151296:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391160.978524:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391160.978661:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33687:x1875263094151296:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 207us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.978669:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:1.0:1788391160.983092:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.983406:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151424 00000100:00100000:3.0:1788391160.983418:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151424 00000100:00100000:3.0:1788391160.983497:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1788391160.983510:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33687:x1875263094151424:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788391160.983611:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983629:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983651:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983683:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983802:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983812:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983848:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983856:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983860:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391160.983908:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788391160.983914:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391160.983929:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983942:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983949:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.983957:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984007:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.984013:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984021:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984036:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391160.984040:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.984046:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984053:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37139 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984069:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984076:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984083:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984088:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.984091:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984098:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984118:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x743283ca (ffff95d686a70b00) 00010000:00010000:3.0:1788391160.984120:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.984123:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984129:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37140 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984146:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984152:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984159:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984164:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391160.984168:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984174:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984182:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391160.984184:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391160.984187:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.984193:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37147 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391160.984529:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33687:x1875263094151424:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1017us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391160.984538:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:1.0:1788391160.988233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.988411:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151680 00000100:00100000:2.0:1788391160.988426:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151680 00000100:00100000:2.0:1788391160.988533:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:2.0:1788391160.988547:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:33687:x1875263094151680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391160.988576:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391160.988604:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3714e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff29 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.988775:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.988803:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.988818:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391160.988832:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788391160.989013:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989044:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989052:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989058:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391160.989064:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989072:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989088:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391160.989092:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391160.989099:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989105:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd37155 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989172:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3714e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff29 expref: 29 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989184:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391160.989187:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391160.989192:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3714e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff29 expref: 29 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391160.989202:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391160.989297:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094151680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 753us (1078us total) trans 30064771214 rc 301/301 00000100:00100000:2.0:1788391160.989304:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:1.0:1788391160.992653:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391160.992749:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094151808 00000100:00100000:2.0:1788391160.992761:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094151808 00000100:00100000:2.0:1788391160.992844:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:2.0:1788391160.992856:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094151808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391160.992903:0:42646:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391160.993057:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094151808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391160.993066:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:1.0:1788391160.997450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391160.997667:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152064 00000100:00100000:3.0:1788391160.997683:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152064 00000100:00100000:3.0:1788391160.997813:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1788391160.997828:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094152064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391160.997859:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391160.997863:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391160.997913:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37083 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffef1 expref: 28 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391160.997936:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391160.997950:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391160.998247:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37163 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff30 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391160.998917:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc4:0x0], index 1: 0 00010000:00010000:3.0:1788391161.001845:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3716a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.001867:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3716a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.001877:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3716a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.002127:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37163 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff30 expref: 30 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.002176:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3716a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff30 expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.002199:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:3.0:1788391161.002202:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391161.002206:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391161.002287:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33687:x1875263094152064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 4462us (4852us total) trans 30064771215 rc 0/0 00000100:00100000:3.0:1788391161.002298:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:1.0:1788391161.005311:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.005578:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152192 00000100:00100000:2.0:1788391161.005592:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152192 00000100:00100000:2.0:1788391161.005712:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:2.0:1788391161.005726:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33687:x1875263094152192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.005759:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391161.005799:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff37 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.005891:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.005909:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.005920:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391161.006021:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391161.006026:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391161.006049:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.006080:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff37 expref: 31 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.006101:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff37 expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.006111:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2800) 00010000:00010000:2.0:1788391161.006115:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391161.006119:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391161.006191:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:33687:x1875263094152192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 468us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.006198:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00080000:3.0:1788391161.007013:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391161.009144:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.009210:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152448 00000100:00100000:2.0:1788391161.009226:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152448 00000100:00100000:2.0:1788391161.009300:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:2.0:1788391161.009315:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:33687:x1875263094152448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.009370:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788391161.009398:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3716a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff30 expref: 30 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009429:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d686a70c00) 00010000:00010000:2.0:1788391161.009461:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3717f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff37 expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009470:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2800) 00010000:00010000:2.0:1788391161.009476:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391161.009499:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009512:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009521:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009531:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009538:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009544:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009606:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009613:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009620:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.009626:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391161.009637:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010117:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010131:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2200) 00010000:00010000:2.0:1788391161.010135:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391161.010140:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010146:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37186 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010161:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010168:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010174:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010179:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391161.010182:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010188:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010195:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfefec000 (ffff95d6830d2500) 00010000:00010000:2.0:1788391161.010197:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391161.010206:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.010212:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd3718d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfefec000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.010302:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094152448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 991us (1170us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391161.010310:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:1.0:1788391161.013086:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.015928:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152576 00000100:00100000:2.0:1788391161.015944:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152576 00000100:00100000:2.0:1788391161.016054:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:2.0:1788391161.016068:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:33687:x1875263094152576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.016090:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391161.016114:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37194 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff3e expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016157:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016172:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016184:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016284:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37194 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016299:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.016314:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391161.016317:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391161.016320:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f800, rc 0) 00000100:00100000:2.0:1788391161.016386:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33687:x1875263094152576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 322us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.016393:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:1.0:1788391161.020184:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.020249:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152832 00000100:00100000:3.0:1788391161.020262:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152832 00000100:00100000:3.0:1788391161.020334:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:3.0:1788391161.020347:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:33687:x1875263094152832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391161.020469:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.020491:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.020564:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391161.021160:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].6, 88 off8648 00000004:00080000:3.0:1788391161.021174:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 978128212759ns, next at 979128209031ns, rc = 0 00000004:00010000:3.0:1788391161.021295:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9ff2794 reply state 000000003087f269 transno 30064771216 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391161.021317:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391161.021437:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:33687:x1875263094152832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1089us (1262us total) trans 30064771216 rc 0/0 00000100:00100000:3.0:1788391161.021446:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00010000:00010000:2.0:1788391161.024432:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024450:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024457:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024465:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391161.024473:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024483:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024505:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391161.024509:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391161.024513:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.024519:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd371a2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391161.024873:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.024931:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094152960 00000100:00100000:3.0:1788391161.024946:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094152960 00000100:00100000:3.0:1788391161.025050:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1788391161.025060:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:33687:x1875263094152960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391161.025090:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391161.025111:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff45 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.025174:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.025185:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.025201:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:3.0:1788391161.025204:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391161.025207:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:3.0:1788391161.025270:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:33687:x1875263094152960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 212us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391161.025278:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:1.0:1788391161.028228:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.028374:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094153088 00000100:00100000:3.0:1788391161.028386:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094153088 00000100:00100000:3.0:1788391161.028475:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391161.028486:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094153088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391161.028883:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094153088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 396us (667us total) trans 30064771090 rc 0/0 00000100:00100000:3.0:1788391161.028892:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788391161.031916:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.032019:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094153344 00000100:00100000:0.0:1788391161.032033:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094153344 00000100:00100000:0.0:1788391161.032112:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788391161.032125:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:33687:x1875263094153344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788391161.032478:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:33687:x1875263094153344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 355us (575us total) trans 30064771217 rc 0/0 00000100:00100000:0.0:1788391161.032487:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788391161.035203:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.035453:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094153600 00000100:00100000:3.0:1788391161.035466:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094153600 00000100:00100000:3.0:1788391161.035522:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1788391161.035530:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:33687:x1875263094153600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391161.035671:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:33687:x1875263094153600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 141us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391161.035679:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:1.0:1788391161.040081:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.040207:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094153728 00000100:00100000:2.0:1788391161.040222:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094153728 00000100:00100000:2.0:1788391161.040303:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:2.0:1788391161.040314:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:33687:x1875263094153728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.040337:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391161.040359:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd371b0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff4c expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040427:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040441:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040452:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391161.040490:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391161.040510:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040537:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd371b0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff4c expref: 34 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040556:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff4c expref: 33 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.040565:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391161.040582:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788391161.040586:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e600, rc 0) 00000100:00100000:2.0:1788391161.040657:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:33687:x1875263094153728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.040666:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:1.0:1788391161.046137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.046882:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094153856 00000100:00100000:3.0:1788391161.046899:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094153856 00000100:00100000:3.0:1788391161.047037:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788391161.047052:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094153856:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391161.047084:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391161.047115:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff53 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391161.047154:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98aef9, blocks: 0x1 00010000:00010000:3.0:1788391161.047181:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=978s v=(0 0) 00010000:00010000:3.0:1788391161.047187:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391161.047200:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 7 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.047247:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 7 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.047279:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391161.047360:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094153856:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 311us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391161.047368:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788391161.050137:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.050292:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154112 00000100:00100000:2.0:1788391161.050303:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154112 00000100:00100000:2.0:1788391161.050414:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:2.0:1788391161.050427:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:33687:x1875263094154112:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788391161.050568:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:33687:x1875263094154112:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.050577:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1788391161.058041:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.058125:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154240 00000100:00100000:2.0:1788391161.058137:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154240 00000100:00100000:2.0:1788391161.058348:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788391161.058362:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:33687:x1875263094154240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.058389:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391161.058415:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff5a expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.058459:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.058470:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391161.058476:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391161.058482:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.058543:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.058615:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 1078 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.058633:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103462400:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391161.058745:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788391161.063763:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.063883:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103462400:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391161.063919:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.063942:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391161.064051:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:33687:x1875263094154240:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5691us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.064062:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1788391161.064266:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154368 00000100:00100000:0.0:1788391161.064283:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154368 00010000:00010000:0.0:1788391161.064338:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 1078 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.064390:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1788391161.064401:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094154368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391161.064417:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391161.064442:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 1078 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.064457:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 1078 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.064481:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e31ee2/0x9aafc5f04cd371be lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff53 expref: 8 pid: 43326 timeout: 1078 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.064499:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391161.064503:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391161.064511:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.064521:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.064562:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.064594:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103462528:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391161.064717:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788391161.066345:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:42631:1875263103462528:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391161.066368:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391161.066406:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094154368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2007us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391161.066417:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1788391161.068580:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391161.068632:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154496 00000100:00100000:3.0:1788391161.068643:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154496 00002000:00100000:3.0:1788391161.068699:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff95d6bc68fb80 x1875263094154496/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:22/0 lens 504/0 e 0 to 0 dl 1788391172 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391161.068710:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68fb80 with x1875263094154496 ext(0->15) 00002000:00010000:3.0:1788391161.068717:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc68fb80 00000100:00100000:3.0:1788391161.068758:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788391161.068770:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094154496:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391161.069686:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094154496:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 914us (1113us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1788391161.069700:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00002000:00100000:3.0:1788391161.069707:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff95d6bc68fb80 x1875263094154496/t30064771091(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:22/0 lens 504/448 e 0 to 0 dl 1788391172 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391161.069716:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68fb80 with x1875263094154496 ext(0->15) 00002000:00010000:3.0:1788391161.069721:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc68fb80 00000100:00100000:1.0:1788391161.072347:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.072414:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154624 00000100:00100000:2.0:1788391161.072427:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154624 00000100:00100000:2.0:1788391161.072538:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:2.0:1788391161.072548:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:33687:x1875263094154624:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788391161.096430:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771217 is committed 00000004:00080000:3.0:1788391161.096540:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788391161.096567:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a79e40 refcount 2 committed 0 result 0 batchid 25769803901 00000020:00080000:3.0:1788391161.096573:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fd0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a79c00 00000020:00080000:3.0:1788391161.096577:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6a83a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58ae9e800 00000020:00080000:3.0:1788391161.096590:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803900 batchid updated 00000020:00080000:3.0:1788391161.096811:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803901 committed batchid 25769803900 00000004:00080000:1.0:1788391161.097046:0:45044:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788391161.097093:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000100:00100000:2.0:1788391161.097360:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:33687:x1875263094154624:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 24803us (25018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.097384:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1788391161.097523:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103462656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788391161.097661:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391161.097826:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103462656 00000100:00100000:3.0:1788391161.097837:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103462656 00000100:00100000:3.0:1788391161.097906:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788391161.097916:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103462656:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788391161.097991:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788391161.098204:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:3.0:1788391161.098208:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788391161 00002000:00010000:3.0:1788391161.098212:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391161.098214:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1788391161 -> 1788391161 00002000:00010000:3.0:1788391161.098216:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391161.098292:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103462784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788391161.098326:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391161.098387:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3288:x1875263103462656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 471us (727us total) trans 30064771092 rc 0/0 00000100:00100000:3.0:1788391161.098395:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1788391161.098401:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d682e95500/2, rc 0, transno 30064771092 00000100:00100000:3.0:1788391161.098407:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103462784 00000100:00100000:0.0:1788391161.098408:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103462656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391161.098410:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103462784 00000100:00100000:3.0:1788391161.098715:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788391161.098724:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103462784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788391161.098745:0:43328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:196 count 1 00002000:00010000:3.0:1788391161.098778:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6a98aef8, atime: 0x6a98aef8, ctime: 0x6a98aef8, blocks: 0xb 00010000:00010000:3.0:1788391161.098808:0:43328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.098828:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=978s v=(0 0) 00010000:00010000:3.0:1788391161.098833:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391161.098840:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.098861:0:43328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.098877:0:43328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.098886:0:43328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391161.098912:0:43328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788391161.098938:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391161.098946:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.098954:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391161.098979:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.098991:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.099012:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.099026:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a9349ff/0x9aafc5f04cd371cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.099047:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391161.099049:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391161.099050:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391161.099431:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103462784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 708us (1103us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1788391161.099439:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788391161.099512:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771088 gen 2 00000004:00080000:0.0:1788391161.099518:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc68ce00, transno 30064771086 00000004:00080000:0.0:1788391161.099537:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771088 committed transno 30064771088 00000100:00100000:0.0:1788391161.099864:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d6bc68f480 x1875263103462784/t30064771089(30064771089) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391177 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788391161.099877:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc68f480/2, rc 0, transno 30064771089 00000100:00100000:0.0:1788391161.099881:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103462784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391161.100280:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.100354:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094154752 00000100:00100000:2.0:1788391161.100361:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094154752 00000100:00100000:2.0:1788391161.100419:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1788391161.100433:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094154752:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788391161.123999:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771088 is committed 00000001:00080000:1.0:1788391161.124022:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771089 is committed 00000001:00080000:1.0:1788391161.124031:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771092 is committed 00000001:00080000:1.0:1788391161.124035:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771091 is committed 00000100:00100000:2.0:1788391161.124059:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094154752:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 23617us (23772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.124074:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788391161.127534:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.127648:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155008 00000100:00100000:0.0:1788391161.127662:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155008 00000100:00100000:0.0:1788391161.127745:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:0.0:1788391161.127759:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:33687:x1875263094155008:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391161.127860:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391161.127898:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd371b7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff4c expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.127925:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391161.127931:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391161.128024:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.128065:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.128078:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391161.128317:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bae980b reply state 00000000354901ba transno 30064771218 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.128329:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391161.128450:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:33687:x1875263094155008:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 695us (926us total) trans 30064771218 rc 0/0 00000100:00100000:0.0:1788391161.128460:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00010000:00010000:1.0:1788391161.131194:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131222:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131229:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131234:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391161.131238:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131244:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131263:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391161.131266:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391161.131271:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391161.131295:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd371d3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391161.132256:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.132575:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155136 00000100:00100000:0.0:1788391161.132587:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155136 00000100:00100000:0.0:1788391161.132651:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1788391161.132664:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094155136:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788391161.133064:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 16 -> 16 00002000:00010000:0.0:1788391161.133068:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 1788391161 -> 1788391160 00002000:00010000:0.0:1788391161.133071:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1788391160 00002000:00010000:0.0:1788391161.133074:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1788391161 -> 1788391160 00002000:00010000:0.0:1788391161.133077:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788391161.133150:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094155136:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 488us (899us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1788391161.133159:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788391161.137440:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.137900:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155392 00000100:00100000:0.0:1788391161.137918:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155392 00000100:00100000:0.0:1788391161.138059:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1788391161.138072:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:33687:x1875263094155392:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788391161.138172:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.138193:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.138203:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.138251:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.138267:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 11 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.138285:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103462912:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391161.138402:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391161.142946:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.143064:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103462912:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391161.143084:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155520 00000100:00100000:2.0:1788391161.143093:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155520 00010000:00010000:0.0:1788391161.143100:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143140:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 12 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.143182:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1788391161.143190:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094155520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391161.143206:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391161.143212:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 12 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143222:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 12 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143245:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3719b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff3e expref: 12 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143282:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391161.143287:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143299:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143308:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.143332:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391161.143361:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143372:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143418:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143426:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143432:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143437:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391161.143441:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143447:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143456:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391161.143458:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788391161.143461:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.143467:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371da lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.143508:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:33687:x1875263094155392:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 5440us (6077us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788391161.143516:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:2.0:1788391161.143555:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094155520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.143561:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1788391161.145019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.145056:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155648 00000100:00100000:2.0:1788391161.145064:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155648 00000100:00100000:2.0:1788391161.145155:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391161.145164:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094155648:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.145206:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.145224:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.145230:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391161.145234:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391161.145238:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.145291:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.145308:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 7 pid: 43698 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.145322:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103463040:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391161.145422:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391161.150102:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103463040:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391161.150149:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391161.150359:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.150419:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094155776 00000100:00100000:0.0:1788391161.150430:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094155776 00010000:00010000:0.0:1788391161.150484:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.150542:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788391161.150553:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094155776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391161.150574:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391161.150611:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.150628:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.150673:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd371c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff5a expref: 8 pid: 43698 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.150694:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391161.150699:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391161.150705:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.150715:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.150758:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391161.150800:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150813:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150847:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.150850:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094155776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 297us (489us total) trans 0 rc 0/0 00010000:00010000:2.0:1788391161.150867:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.150872:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00010000:00010000:2.0:1788391161.150894:0:43327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150903:0:43327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391161.150908:0:43327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150920:0:43327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150935:0:43327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.150943:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a3c7b3b/0x9aafc5f04cd371e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.151028:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094155648:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5864us (6013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.151038:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1788391161.152491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.152541:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156032 00000100:00100000:2.0:1788391161.152550:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156032 00000100:00100000:2.0:1788391161.152613:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:2.0:1788391161.152624:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:33687:x1875263094156032:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391161.152729:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.152761:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.152774:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.153032:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.153042:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 11 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.153047:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.153077:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 11 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.153087:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 11 pid: 43348 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.153101:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103463168:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391161.153179:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391161.155130:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103463168:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391161.155176:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391161.155259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391161.155326:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156160 00000100:00100000:2.0:1788391161.155350:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156160 00010000:00010000:2.0:1788391161.155394:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 12 pid: 43348 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.155436:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1788391161.155456:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094156160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391161.155475:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391161.155483:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 12 pid: 43348 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155498:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 12 pid: 43348 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155524:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd371a9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff45 expref: 12 pid: 43348 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155539:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391161.155543:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155550:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155556:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.155589:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391161.155655:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094156160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 209us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.155674:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00010000:00010000:0.0:1788391161.155698:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.155708:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391161.156006:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771219 00000001:00080000:0.0:1788391161.156186:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771220 00000001:00080000:0.0:1788391161.156237:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771221 00000100:00100000:0.0:1788391161.156323:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103463296:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788391161.156380:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391161.156414:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a22c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788391161.156431:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103463296 00000100:00100000:2.0:1788391161.156438:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103463296 00000100:00100000:2.0:1788391161.156477:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788391161.156482:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103463296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391161.156578:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103463296:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391161.156585:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788391161.157333:0:42645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:0.0:1788391161.157341:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d687863480, transno 30064771088 00000004:00080000:0.0:1788391161.157473:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc68c700, transno 30064771089 00000004:00080000:0.0:1788391161.157478:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d682e95500, transno 30064771092 00000100:00100000:0.0:1788391161.157490:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103463296:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788391161.158165:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771222 00000100:00100000:0.0:1788391161.158247:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103463424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788391161.158302:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391161.158341:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6925b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391161.158374:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103463424 00000100:00100000:3.0:1788391161.158381:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103463424 00000100:00100000:3.0:1788391161.158433:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788391161.158443:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103463424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788391161.158658:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42645:x1875263103463424:12345-0@lo:1000:mdt00_001.0 Request processed in 217us (356us total) trans 30064771094 rc 0/0 00000100:00100000:3.0:1788391161.158667:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788391161.158914:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103463424:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788391161.159025:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771223 00010000:00010000:0.0:1788391161.159059:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159131:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159140:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159157:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391161.159162:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159171:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159192:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391161.159196:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391161.159202:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159209:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd371ef lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159252:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159259:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159265:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159270:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391161.159273:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159279:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159299:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391161.159301:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391161.159305:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159310:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd37116 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159338:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159356:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 15 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159366:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159396:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 15 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.159412:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 15 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.159426:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103463552:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391161.159509:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6834c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788391161.161034:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103463552:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391161.161060:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391161.162083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.162156:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156288 00000100:00100000:0.0:1788391161.162166:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156288 00010000:00010000:0.0:1788391161.162211:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 16 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.162257:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1788391161.162268:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094156288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391161.162285:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391161.162292:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 16 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162306:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 16 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162328:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e000/0x9aafc5f04cd37132 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff22 expref: 16 pid: 42646 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162347:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391161.162353:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162363:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162371:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.162399:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391161.162419:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162429:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162443:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162450:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162456:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162462:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391161.162468:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391161.162473:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094156288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 205us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391161.162483:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:2.0:1788391161.162489:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162514:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391161.162518:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391161.162522:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162527:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd371f6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162551:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162558:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162563:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162567:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391161.162570:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162576:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162582:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391161.162585:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391161.162587:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.162593:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd371e8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391161.162856:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:33687:x1875263094156032:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 10233us (10371us total) trans 30064771224 rc 0/0 00000100:00100000:2.0:1788391161.162866:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000020:00080000:2.0:1788391161.162870:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1788391161.163017:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391161.163022:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391161.163047:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:0.0:1788391161.163053:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391161.164542:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391161.164637:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156544 00000100:00100000:0.0:1788391161.164649:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156544 00000100:00100000:0.0:1788391161.164709:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391161.164717:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:33687:x1875263094156544:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788391161.165460:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788391161.165547:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771225 00010000:00010000:0.0:1788391161.165596:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165616:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165630:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165640:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165648:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165654:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391161.165691:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391161.165712:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391161.165720:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.165727:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391161.165730:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.165737:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.165749:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391161.165751:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391161.165755:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.165759:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd371fd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391161.165774:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391161.165775:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391161.165776:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391161.165786:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:33687:x1875263094156544:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1068us (1249us total) trans 30064771226 rc 0/0 00000100:00100000:0.0:1788391161.165803:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000020:00080000:0.0:1788391161.165807:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788391161.805322:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391162.269556:0:45085:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391162.269566:0:45085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391162.269702:0:45085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1788391162.269707:0:45085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391162.374762:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391162.374813:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156672 00000100:00100000:2.0:1788391162.374824:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156672 00000100:00100000:2.0:1788391162.374871:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:2.0:1788391162.374884:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:33704:x1875263094156672:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391162.374903:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391162.374921:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd37204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff61 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.374992:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.375006:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.375020:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391162.377172:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391162.377182:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391162.377218:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.377257:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd37204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff61 expref: 18 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.377275:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff61 expref: 17 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.377283:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391162.377285:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391162.377288:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391162.377361:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:33704:x1875263094156672:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2477us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391162.377380:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:3.0:1788391162.382524:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391162.382562:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156800 00000100:00100000:3.0:1788391162.382571:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156800 00000100:00100000:3.0:1788391162.382627:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1788391162.382638:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:33704:x1875263094156800:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788391162.382722:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.382739:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.382751:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.382773:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.382798:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.382806:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383056:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383065:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383072:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391162.383110:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383122:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383128:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383134:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383140:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391162.383144:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383152:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383170:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:3.0:1788391162.383173:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391162.383177:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383182:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383193:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383198:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383203:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383208:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391162.383210:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383215:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383222:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d686a70d00) 00010000:00010000:3.0:1788391162.383224:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391162.383226:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383231:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383252:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383259:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383264:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383269:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391162.383272:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383278:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383285:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391162.383288:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391162.383290:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391162.383296:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd37220 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391162.383362:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:33704:x1875263094156800:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 725us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391162.383370:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1788391162.407670:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391162.407740:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094156928 00000100:00100000:2.0:1788391162.407748:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094156928 00000100:00100000:2.0:1788391162.407814:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1788391162.407825:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:33705:x1875263094156928:12345-192.168.202.1@tcp:101:mmap_cat.0 00010000:00010000:2.0:1788391162.407843:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391162.407860:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd37227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff68 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407910:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407921:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407929:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407938:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407942:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.407946:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408173:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408186:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408191:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391162.408218:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:2.0:1788391162.408223:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391162.408244:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408256:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408265:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408269:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408274:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408278:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391162.408281:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408287:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408298:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391162.408307:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391162.408312:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408319:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3722e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408330:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408334:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408338:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408341:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391162.408343:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408346:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408351:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff95d6830d2200) 00010000:00010000:2.0:1788391162.408352:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391162.408354:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408357:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408378:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd37227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff68 expref: 19 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408402:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fc00/0x9aafc5f04cd3723c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff68 expref: 18 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.408409:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d6830d2800) 00010000:00010000:2.0:1788391162.408412:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391162.408414:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fc00, rc 0) 00000100:00100000:2.0:1788391162.408476:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:33705:x1875263094156928:12345-192.168.202.1@tcp:101:mmap_cat.0 Request processed in 652us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391162.408483:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:3.0:1788391162.410976:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391162.411271:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157056 00000100:00100000:2.0:1788391162.411282:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157056 00000100:00100000:2.0:1788391162.411356:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788391162.411366:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094157056:12345-192.168.202.1@tcp:101:mmap_cat.0 00010000:00010000:2.0:1788391162.411384:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391162.411403:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d59bd3/0x9aafc5f04cd37243 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff6f expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391162.411430:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6a98aef8, atime: 0x6a98aef8, ctime: 0x6a98aef8, blocks: 0xb 00010000:00010000:2.0:1788391162.411449:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=979s v=(0 0) 00010000:00010000:2.0:1788391162.411453:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391162.411461:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d59bd3/0x9aafc5f04cd37243 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff6f expref: 7 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.411480:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030d59bd3/0x9aafc5f04cd37243 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff6f expref: 7 pid: 43698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391162.411515:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ec00, rc 0) 00000100:00100000:2.0:1788391162.411573:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094157056:12345-192.168.202.1@tcp:101:mmap_cat.0 Request processed in 208us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391162.411581:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00080000:1.0:1788391162.411691:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391162.419536:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391162.419596:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157312 00000100:00100000:0.0:1788391162.419604:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157312 00000100:00100000:0.0:1788391162.419651:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:0.0:1788391162.419662:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:33705:x1875263094157312:12345-192.168.202.1@tcp:101:mmap_cat.0 00010000:00010000:0.0:1788391162.419734:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391162.419756:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3724a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff76 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391162.419864:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd37251 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391162.419875:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd37251 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391162.419884:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd37251 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391162.419892:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1788391162.420165:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3724a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff76 expref: 21 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391162.420178:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b800/0x9aafc5f04cd37251 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff76 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391162.420189:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff95d6830d2800) 00010000:00010000:0.0:1788391162.420191:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788391162.420194:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b800, rc 0) 00000100:00100000:0.0:1788391162.420241:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:33705:x1875263094157312:12345-192.168.202.1@tcp:101:mmap_cat.0 Request processed in 582us (712us total) trans 30064771227 rc 0/0 00000100:00100000:0.0:1788391162.420248:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1788391162.423815:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391162.423864:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157440 00000100:00100000:2.0:1788391162.423874:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157440 00002000:00100000:2.0:1788391162.423924:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff95d68f323100 x1875263094157440/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:23/0 lens 488/0 e 0 to 0 dl 1788391173 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391162.423934:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323100 with x1875263094157440 ext(0->4095) 00002000:00010000:2.0:1788391162.423939:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323100 00000100:00100000:2.0:1788391162.424051:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1788391162.424062:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2358:x1875263094157440:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391162.424258:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2358:x1875263094157440:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 198us (870us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788391162.424266:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00002000:00100000:2.0:1788391162.424273:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff95d68f323100 x1875263094157440/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:23/0 lens 488/4536 e 0 to 0 dl 1788391173 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391162.424282:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323100 with x1875263094157440 ext(0->4095) 00002000:00010000:2.0:1788391162.424296:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323100 00010000:00010000:2.0:1788391162.829098:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391163.853222:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103463808:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853317:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853386:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103464320:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853413:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853441:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788391163.853447:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103463680:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853476:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853497:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103464192:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853545:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103463936:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853570:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853591:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391163.853597:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103464064:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853619:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391163.853662:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103463808 00000100:00100000:0.0:1788391163.853670:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103463808 00000100:00100000:0.0:1788391163.853733:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103463936 00000100:00100000:0.0:1788391163.853736:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103463936 00000100:00100000:0.0:1788391163.853798:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391163.853814:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103463808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853870:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103463808:12345-0@lo:400:kworker.0 Request processed in 64us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.853878:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391163.853897:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788391163.853904:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103463936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.853938:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103463936:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.853943:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788391163.853991:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464320 00000100:00100000:0.0:1788391163.853995:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464320 00000100:00100000:0.0:1788391163.854021:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464192 00000100:00100000:0.0:1788391163.854024:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464192 00000100:00100000:0.0:1788391163.854037:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464064 00000100:00100000:0.0:1788391163.854039:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464064 00000100:00100000:0.0:1788391163.854052:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788391163.854058:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103464320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854090:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103464320:12345-0@lo:400:kworker.0 Request processed in 32us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.854095:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788391163.854106:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788391163.854112:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103464192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854136:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103464192:12345-0@lo:400:kworker.0 Request processed in 24us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.854142:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788391163.854154:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391163.854166:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103464064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854195:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103464064:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.854202:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391163.854221:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103463680 00000100:00100000:0.0:1788391163.854224:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103463680 00000100:00100000:0.0:1788391163.854250:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788391163.854257:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103463680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854285:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103463680:12345-0@lo:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.854291:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788391163.854326:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391163.854331:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391163.854334:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391163.854378:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103464064:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854391:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103463936:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854424:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103463680:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854436:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103464192:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854446:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103463808:0@lo:400:kworker.0 00000100:00100000:0.0:1788391163.854456:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103464320:0@lo:400:kworker.0 00010000:00010000:1.0:1788391163.856448:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391163.857989:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103464448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391163.858083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391163.858219:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464448 00000100:00100000:3.0:1788391163.858229:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464448 00000100:00100000:3.0:1788391163.858301:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788391163.858313:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103464448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391163.858356:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391163.866623:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103464448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8299us (8527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391163.866638:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103464448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391163.866640:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788391164.877243:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391164.878939:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391164.878976:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103464576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391164.879064:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391164.879131:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464576 00000100:00100000:1.0:1788391164.879139:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464576 00000100:00100000:1.0:1788391164.879199:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391164.879207:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103464576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391164.879249:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391164.879301:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103464576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391164.879307:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391164.879357:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103464576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391165.560891:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561049:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561077:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561108:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391165.561154:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391165.562136:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157824 00000100:00100000:0.0:1788391165.562148:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157824 00000100:00100000:0.0:1788391165.562220:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158336 00000100:00100000:0.0:1788391165.562223:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158336 00000100:00100000:0.0:1788391165.562240:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157952 00000100:00100000:0.0:1788391165.562243:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157952 00000100:00100000:0.0:1788391165.562261:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158208 00000100:00100000:0.0:1788391165.562264:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158208 00000100:00100000:0.0:1788391165.562285:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391165.562296:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094157824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562369:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2356:x1875263094157824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562377:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391165.562394:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391165.562402:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562435:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562441:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1788391165.562453:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391165.562460:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094157952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562481:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094157952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562485:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391165.562492:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391165.562497:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562522:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562526:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391165.562542:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158080 00000100:00100000:0.0:1788391165.562545:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158080 00000100:00100000:0.0:1788391165.562571:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157696 00000100:00100000:0.0:1788391165.562574:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157696 00000100:00100000:0.0:1788391165.562581:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158464 00000100:00100000:0.0:1788391165.562582:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158464 00000100:00100000:0.0:1788391165.562589:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391165.562593:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562609:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094158080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562613:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391165.562619:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391165.562623:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094157696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391165.562637:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094157696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562641:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1788391165.562656:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1788391165.562661:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:33641:x1875263094158464:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788391165.562696:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:33641:x1875263094158464:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 36us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.562701:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00080000:3.0:1788391165.562877:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391165.562883:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391165.562885:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391165.563095:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094157568 00000100:00100000:1.0:1788391165.563100:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094157568 00000100:00100000:1.0:1788391165.563136:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788391165.563143:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094157568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391165.563225:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094157568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391165.563232:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788391165.564623:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391165.564676:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158720 00000100:00100000:1.0:1788391165.564694:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158720 00000100:00100000:1.0:1788391165.564737:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1788391165.564745:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:33641:x1875263094158720:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391165.564944:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:33641:x1875263094158720:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 200us (325us total) trans 30064771228 rc 0/0 00000100:00100000:1.0:1788391165.564952:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788391165.791450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391165.791558:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158848 00000100:00100000:0.0:1788391165.791581:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158848 00000100:00100000:0.0:1788391165.791889:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:0.0:1788391165.791901:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:34145:x1875263094158848:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:0.0:1788391165.791922:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391165.791941:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd3725f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff7d expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792031:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792046:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792058:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391165.792092:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391165.792096:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391165.792116:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792140:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd3725f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 7 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792157:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 6 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391165.792165:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391165.792167:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391165.792171:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391165.792279:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:34145:x1875263094158848:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 380us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391165.792285:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00010000:00010000:3.0:1788391165.901221:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391165.945920:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771089 is committed 00000001:00080000:3.0:1788391166.466549:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771227 is committed 00000020:00080000:3.0:1788391166.466697:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a220c0 refcount 2 committed 0 result 0 batchid 25769803902 00000020:00080000:3.0:1788391166.466704:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d585132d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a22c00 00000020:00080000:3.0:1788391166.466707:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d585132000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5810d3c00 00000001:00080000:3.0:1788391166.466735:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771228 is committed 00000020:00080000:1.0:1788391166.466860:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803902 committed batchid 25769803900 00000020:00080000:1.0:1788391166.467394:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000001:00080000:2.0:1788391166.467789:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771093 is committed 00000001:00080000:2.0:1788391166.467808:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771094 is committed 00000020:00080000:3.0:1788391166.467912:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803901 batchid updated 00010000:00010000:2.0:1788391166.925249:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391167.578395:0:45286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_6 skipping ALWAYS excluded test 6 00010000:00010000:3.0:1788391167.950289:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788391168.671569:0:45334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7a skipping ALWAYS excluded test 7a 00010000:00010000:2.0:1788391168.973198:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391168.974409:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103464704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391168.974484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391168.974673:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464704 00000100:00100000:2.0:1788391168.974684:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464704 00000100:00100000:2.0:1788391168.974769:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788391168.974780:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103464704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391168.974825:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788391168.974889:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103464704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391168.974896:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788391168.975439:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391168.975485:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771094 gen 2 00000004:00080000:0.0:1788391168.975492:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771094 00000100:00100000:0.0:1788391168.975523:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103464704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391168.978445:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103464832:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391168.978553:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103465344:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978581:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391168.978606:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391168.978611:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103465216:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978630:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391168.978654:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103465088:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978675:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391168.978692:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391168.978695:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103464960:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978712:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391168.978754:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103465344 00000100:00100000:0.0:1788391168.978761:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103465344 00000100:00100000:0.0:1788391168.978812:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103465216 00000100:00100000:0.0:1788391168.978816:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103465216 00000100:00100000:1.0:1788391168.978836:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464960 00000100:00100000:1.0:1788391168.978843:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464960 00000100:00100000:0.0:1788391168.978858:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103465088 00000100:00100000:0.0:1788391168.978863:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103465088 00000100:00100000:0.0:1788391168.978892:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788391168.978893:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788391168.978904:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103465344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391168.978908:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.978997:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103465344:12345-0@lo:400:kworker.0 Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391168.979004:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788391168.979023:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788391168.979030:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103465216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.979058:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103465216:12345-0@lo:400:kworker.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391168.979065:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788391168.979074:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788391168.979079:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.979101:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103465088:12345-0@lo:400:kworker.0 Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391168.979106:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788391168.979122:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391168.979126:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391168.979156:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103465216:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.979165:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103465344:0@lo:400:kworker.0 00000100:00100000:1.0:1788391168.979308:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103464960:12345-0@lo:400:kworker.0 Request processed in 405us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391168.979316:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391168.979346:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103464832 00000100:00100000:1.0:1788391168.979350:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103464832 00000100:00100000:1.0:1788391168.979376:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788391168.979384:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.979392:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:0.0:1788391168.979399:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc68f480, transno 30064771089 00000100:00100000:0.0:1788391168.979412:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103464960:0@lo:400:kworker.0 00000100:00100000:0.0:1788391168.979428:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103465088:0@lo:400:kworker.0 00000100:00100000:1.0:1788391168.979431:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103464832:12345-0@lo:400:kworker.0 Request processed in 46us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391168.979441:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788391168.979485:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103464832:0@lo:400:kworker.0 00000001:02000400:3.0:1788391169.829801:0:45383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7b skipping ALWAYS excluded test 7b 00000100:00100000:0.0:1788391169.997281:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788391169.997608:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391169.997671:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391169.997776:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391169.998058:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103465472 00000100:00100000:2.0:1788391169.998070:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103465472 00000100:00100000:2.0:1788391169.998176:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788391169.998189:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103465472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391169.998239:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391169.998352:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103465472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391169.998361:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391169.998451:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391170.681714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391170.681770:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391170.681795:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094158976 00000100:00100000:2.0:1788391170.681806:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391170.681814:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094158976 00000100:00100000:2.0:1788391170.681836:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391170.681863:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391170.681892:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391170.681909:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788391170.681926:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094158976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391170.682020:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391170.682064:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159104 00000100:00100000:0.0:1788391170.682066:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094158976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 143us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391170.682076:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159104 00000100:00100000:0.0:1788391170.682078:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1788391170.682183:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1788391170.682194:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094159104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391170.682235:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094159104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391170.682240:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1788391170.684570:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159488 00000100:00100000:2.0:1788391170.684585:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159488 00000100:00100000:2.0:1788391170.684678:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391170.684691:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094159488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391170.684781:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094159488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391170.684789:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391170.684834:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159232 00000100:00100000:2.0:1788391170.684839:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159232 00000100:00100000:2.0:1788391170.684874:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159360 00000100:00100000:2.0:1788391170.684877:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159360 00000100:00100000:2.0:1788391170.684894:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159616 00000100:00100000:2.0:1788391170.684899:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159616 00000100:00100000:1.0:1788391170.684916:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094159744 00000100:00100000:2.0:1788391170.684930:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1788391170.684931:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094159744 00000100:00100000:2.0:1788391170.684939:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094159232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391170.685010:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094159232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 70us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391170.685018:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1788391170.685035:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1788391170.685046:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094159360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391170.685082:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094159360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391170.685091:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788391170.685111:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094159616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391170.685325:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094159616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 224us (3432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391170.685337:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788391170.685388:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1788391170.685411:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391170.685418:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094159744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391170.685443:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094159744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391170.685450:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00080000:3.0:1788391170.687870:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391170.687882:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391170.687885:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788391171.019954:0:45431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 19:19:30 (1788391170) 00010000:00010000:2.0:1788391171.021383:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391171.405316:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391171.405326:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391171.405359:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1788391171.405364:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000020:00080000:3.0:1788391171.568620:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803902 batchid updated 00000020:00080000:0.0:1788391171.568845:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000020:00080000:0.0:1788391171.568879:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000100:00100000:3.0:1788391171.932899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391171.933847:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160000 00000100:00100000:0.0:1788391171.933862:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160000 00000100:00100000:1.0:1788391171.934387:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:1.0:1788391171.934404:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:34820:x1875263094160000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391171.934433:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391171.934461:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3726d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff84 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934565:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934584:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934614:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934651:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934658:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.934664:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935041:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37282 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935052:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935060:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391171.935072:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788391171.935240:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935249:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935257:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935263:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391171.935269:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935289:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935304:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:1.0:1788391171.935307:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391171.935313:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935320:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37274 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935334:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935340:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935346:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935351:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391171.935354:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935360:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935368:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a0d29600) 00010000:00010000:1.0:1788391171.935371:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391171.935374:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.935389:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd3727b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.936479:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3726d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff84 expref: 13 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.936500:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37282 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff84 expref: 12 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.936508:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391171.936511:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391171.936514:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6400, rc 0) 00000100:00100000:1.0:1788391171.936610:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:34820:x1875263094160000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2209us (3723us total) trans 30064771229 rc 0/0 00000100:00100000:1.0:1788391171.936620:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:3.0:1788391171.940630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391171.941302:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391171.941379:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160256 00000100:00100000:0.0:1788391171.941392:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160256 00000100:00100000:0.0:1788391171.941482:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1788391171.941494:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2359:x1875263094160256:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391171.941527:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391171.941557:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37282 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff84 expref: 12 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391171.941579:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391171.941585:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391171.941874:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2359:x1875263094160256:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 381us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391171.941883:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1788391171.943238:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160128 00000100:00100000:2.0:1788391171.943253:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160128 00000100:00100000:2.0:1788391171.943332:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:2.0:1788391171.943362:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:34820:x1875263094160128:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788391171.943488:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:34820:x1875263094160128:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 127us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391171.943496:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1788391171.994522:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391171.994780:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160512 00000100:00100000:1.0:1788391171.994794:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160512 00000100:00100000:1.0:1788391171.994925:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788391171.994937:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:34591:x1875263094160512:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391171.995003:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391171.995007:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391171.995042:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd3720b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff61 expref: 11 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995066:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391171.995072:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391171.995107:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37290 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff8b expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995444:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995462:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995472:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995511:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391171.995527:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 5 pid: 43348 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391171.995543:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103465600:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391171.995680:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391171.998037:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103465600:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391171.998075:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391171.998846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391171.998954:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160640 00000100:00100000:2.0:1788391171.998988:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160640 00010000:00010000:2.0:1788391171.999039:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 6 pid: 43348 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391171.999079:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1788391171.999089:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094160640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391171.999106:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391171.999113:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 6 pid: 43348 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999126:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 6 pid: 43348 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999146:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37266 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff7d expref: 6 pid: 43348 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999162:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391171.999166:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999175:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999198:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391171.999263:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391171.999311:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094160640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 225us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391171.999316:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00010000:00010000:3.0:1788391172.001449:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.001462:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.001490:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.001503:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.001514:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391172.002905:0:42645:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc5:0x0], index 0: 0 00010000:00010000:3.0:1788391172.004747:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004779:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004791:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004840:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004847:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004853:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004858:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391172.004862:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004870:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004883:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:3.0:1788391172.004886:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391172.004890:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.004897:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37297 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391172.004911:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa87d008 reply state 00000000947c7fff transno 30064771230 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.004926:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391172.004993:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37290 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 13 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.005015:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 12 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.005023:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d686a70d00) 00010000:00010000:3.0:1788391172.005025:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391172.005027:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391172.005100:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34591:x1875263094160512:12345-192.168.202.1@tcp:101:bash.0 Request processed in 10165us (10591us total) trans 30064771230 rc 0/0 00000100:00100000:3.0:1788391172.005109:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00010000:00010000:2.0:1788391172.007566:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007583:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007590:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007779:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391172.007784:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007790:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007805:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff95d686a70a00) 00010000:00010000:2.0:1788391172.007808:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391172.007811:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.007817:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd3729e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.008542:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.008621:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094160768 00000100:00100000:1.0:1788391172.008638:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094160768 00000100:00100000:1.0:1788391172.008749:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788391172.008779:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:34591:x1875263094160768:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391172.008806:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788391172.008810:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788391172.008849:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff92 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391172.008888:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391172.008917:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=989s v=(0 0) 00010000:00010000:1.0:1788391172.008922:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391172.008935:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.008956:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.009007:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:1.0:1788391172.009099:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:34591:x1875263094160768:12345-192.168.202.1@tcp:101:bash.0 Request processed in 339us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.009109:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391172.014102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.015159:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161024 00000100:00100000:0.0:1788391172.015170:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161024 00000100:00080000:3.0:1788391172.015228:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391172.015246:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788391172.015261:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:34591:x1875263094161024:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:0.0:1788391172.015562:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34591:x1875263094161024:12345-192.168.202.1@tcp:35:bash.0 Request processed in 302us (1464us total) trans 30064771231 rc 0/0 00000100:00100000:0.0:1788391172.015570:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00010000:00010000:3.0:1788391172.048153:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391172.063155:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.063280:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161152 00000100:00100000:0.0:1788391172.063290:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161152 00000100:00100000:0.0:1788391172.063351:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1788391172.063362:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34834:x1875263094161152:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391172.063385:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.063406:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd372ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfff99 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063464:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063490:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063500:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.063533:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391172.063536:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391172.063554:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063576:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd372ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff99 expref: 15 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063593:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff99 expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.063601:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.063604:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391172.063607:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391172.063667:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:34834:x1875263094161152:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 307us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.063672:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1788391172.066653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.066734:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161408 00000100:00100000:1.0:1788391172.066743:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161408 00000100:00100000:1.0:1788391172.066798:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:1.0:1788391172.066808:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:34834:x1875263094161408:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391172.066827:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.066844:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffa0 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.066932:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.066945:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 15 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.067107:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.067140:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 15 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.067153:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 15 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.067166:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103465728:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391172.067287:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391172.070310:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.070583:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103465728:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391172.070624:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.070736:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161536 00000100:00100000:0.0:1788391172.070743:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161536 00010000:00010000:0.0:1788391172.070781:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 16 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.070838:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788391172.070848:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094161536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391172.070860:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391172.070868:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 16 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070879:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 16 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070900:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd372a5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff8b expref: 16 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070915:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d686a70d00) 00010000:00010000:0.0:1788391172.070920:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070929:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070936:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.070984:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391172.070989:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.071007:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.071025:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00000100:00100000:0.0:1788391172.071028:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094161536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 182us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.071035:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00010000:00010000:1.0:1788391172.071157:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa0 expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.071171:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa0 expref: 15 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.071190:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d686a70d00) 00010000:00010000:1.0:1788391172.071192:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788391172.071195:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391172.071232:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:34834:x1875263094161408:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4425us (4585us total) trans 30064771232 rc 0/0 00000100:00100000:1.0:1788391172.071239:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788391172.078041:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.078152:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161792 00000100:00100000:0.0:1788391172.078173:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161792 00000100:00100000:0.0:1788391172.078231:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:0.0:1788391172.078243:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:34834:x1875263094161792:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391172.078266:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.078269:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391172.078293:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd372cf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa0 expref: 15 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078313:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d686a70d00) 00010000:00010000:0.0:1788391172.078324:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391172.078339:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd372dd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffa7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078429:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078442:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078451:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.078463:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788391172.078577:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd372dd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa7 expref: 17 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078593:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa7 expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.078601:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391172.078609:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391172.078622:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a400, rc 0) 00000100:00100000:0.0:1788391172.078680:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:34834:x1875263094161792:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 439us (648us total) trans 30064771233 rc 0/0 00000100:00100000:0.0:1788391172.078687:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:3.0:1788391172.082992:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.083093:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094161920 00000100:00100000:1.0:1788391172.083103:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094161920 00000100:00100000:1.0:1788391172.083154:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:1.0:1788391172.083163:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:34834:x1875263094161920:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391172.083185:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.083202:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffae expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.083257:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 17 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.083270:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 17 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.083288:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391172.083291:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.083295:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:1.0:1788391172.083384:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:34834:x1875263094161920:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 222us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.083406:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:3.0:1788391172.088671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.088864:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162048 00000100:00100000:0.0:1788391172.088875:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162048 00000100:00100000:0.0:1788391172.088935:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1788391172.088948:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094162048:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:0.0:1788391172.089036:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.089064:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.089071:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391172.089075:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391172.089078:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.089108:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.089118:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 6 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.089130:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103465856:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391172.089208:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402300 going to sleep for 11 seconds 00000100:00100000:2.0:1788391172.092106:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.092138:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162176 00000100:00100000:2.0:1788391172.092147:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162176 00002000:00100000:2.0:1788391172.092190:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff95d6bc68ce00 x1875263094162176/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:33/0 lens 496/0 e 0 to 0 dl 1788391183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391172.092201:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ce00 with x1875263094162176 ext(0->5) 00010000:00010000:2.0:1788391172.092211:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 7 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.092226:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 7 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391172.092233:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d6bc68ce00 00000100:00100000:2.0:1788391172.092261:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1788391172.092271:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094162176:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:0.0:1788391172.092279:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103465856:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391172.092308:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.092762:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094162176:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 490us (662us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1788391172.092771:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00100000:2.0:1788391172.092778:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff95d6bc68ce00 x1875263094162176/t30064771090(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:33/0 lens 496/448 e 0 to 0 dl 1788391183 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391172.092786:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ce00 with x1875263094162176 ext(0->5) 00010000:00010000:2.0:1788391172.092791:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.092812:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391172.092818:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d6bc68ce00 00000100:00100000:3.0:1788391172.095547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.095611:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162304 00000100:00100000:0.0:1788391172.095621:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162304 00010000:00010000:0.0:1788391172.095660:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.095713:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788391172.095724:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2359:x1875263094162304:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391172.095739:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788391172.095767:0:42629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788391172.095770:0:42629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788391172 00002000:00010000:0.0:1788391172.095773:0:42629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1788391172 00002000:00010000:0.0:1788391172.095775:0:42629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 0 -> 1788391172 00010000:00010000:0.0:1788391172.095782:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.095797:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.095832:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000088c8082/0x9aafc5f04cd372b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff92 expref: 9 pid: 44885 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.095869:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391172.095874:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391172.095881:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.095891:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.095927:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391172.096005:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2359:x1875263094162304:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 282us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.096014:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00010000:00010000:3.0:1788391172.096112:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096124:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096161:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096170:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096178:0:43327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096185:0:43327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79bc00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391172.096189:0:43327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096198:0:43327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096211:0:43327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.096220:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092685f10/0x9aafc5f04cd372f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.096267:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094162048:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 7322us (7605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391172.096275:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1788391172.099167:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.099218:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162560 00000100:00100000:1.0:1788391172.099228:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162560 00000100:00100000:1.0:1788391172.099286:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1788391172.099295:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:34834:x1875263094162560:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1788391172.099350:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x13:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa7 expref: 17 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391172.099846:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771234 00000001:00080000:1.0:1788391172.099889:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771235 00000001:00080000:1.0:1788391172.100473:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771236 00010000:00010000:1.0:1788391172.100792:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.100808:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 21 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.100817:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.100851:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 21 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.100866:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 21 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.100880:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103465984:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391172.100994:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391172.106743:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.107031:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162688 00000100:00100000:0.0:1788391172.107041:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162688 00000100:00100000:1.0:1788391172.107078:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103465984:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391172.107101:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 22 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.107103:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.107156:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1788391172.107167:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2357:x1875263094162688:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391172.107182:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391172.107189:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 22 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107202:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 22 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107238:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd372f2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffae expref: 22 pid: 42645 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107254:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:0.0:1788391172.107258:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107268:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107275:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.107300:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391172.107324:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.107332:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.107357:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094162688:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 191us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.107365:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000001:00080000:1.0:1788391172.107448:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771237 00000001:00080000:1.0:1788391172.108164:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771238 00000100:00100000:1.0:1788391172.108267:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103466112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391172.108314:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391172.108338:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138900 going to sleep for 11 seconds 00000100:00100000:3.0:1788391172.108364:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103466112 00000100:00100000:3.0:1788391172.108372:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103466112 00000100:00100000:3.0:1788391172.108559:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788391172.108568:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103466112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391172.108638:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103466112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391172.108645:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788391172.108701:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391172.108741:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103466112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391172.109192:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771239 00000100:00100000:1.0:1788391172.109242:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103466240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391172.109269:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391172.109371:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391172.109449:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103466240 00000100:00100000:2.0:1788391172.109454:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103466240 00000100:00100000:2.0:1788391172.109481:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788391172.109488:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103466240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391172.109628:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103466240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (357us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1788391172.109635:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788391172.109716:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103466240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391172.109754:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771240 00010000:00010000:1.0:1788391172.109786:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109796:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109816:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109822:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.109826:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109834:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109847:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391172.109850:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788391172.109854:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.109860:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37300 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391172.110174:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788391172.110271:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].7, 64 off8688 00000004:00080000:1.0:1788391172.110281:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 989217319390ns, next at 990217317672ns, rc = 0 00000001:00080000:1.0:1788391172.110288:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771241 00010000:00010000:1.0:1788391172.110318:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59600) 00010000:00010000:1.0:1788391172.110322:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391172.110328:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd372e4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffa7 expref: 25 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.110423:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:34834:x1875263094162560:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 11127us (11264us total) trans 30064771242 rc 0/0 00000100:00100000:1.0:1788391172.110441:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000020:00080000:1.0:1788391172.110445:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788391172.113130:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.113215:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094162816 00000100:00100000:1.0:1788391172.113225:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094162816 00000100:00100000:1.0:1788391172.113276:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:1.0:1788391172.113286:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:34834:x1875263094162816:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391172.113309:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.113331:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37307 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffb5 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.113386:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37307 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffb5 expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.113400:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37307 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffb5 expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.113418:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391172.113421:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.113424:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:1.0:1788391172.113505:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34834:x1875263094162816:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 221us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.113511:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:2.0:1788391172.116098:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.116189:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094163072 00000100:00100000:0.0:1788391172.116198:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094163072 00000100:00100000:0.0:1788391172.116285:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1788391172.116297:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34834:x1875263094163072:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788391172.116565:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:34834:x1875263094163072:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 271us (471us total) trans 30064771243 rc 0/0 00000100:00100000:0.0:1788391172.116573:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1788391172.190657:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.190721:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094163200 00000100:00100000:1.0:1788391172.190731:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094163200 00000100:00100000:1.0:1788391172.190788:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:1.0:1788391172.190800:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:34844:x1875263094163200:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391172.190894:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.190911:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.190922:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.190938:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.190946:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.190952:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191056:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191065:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191071:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391172.191110:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191121:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191137:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191144:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191160:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.191164:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191172:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191184:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.191186:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.191191:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191196:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd3730e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191209:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191215:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191221:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191226:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.191234:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191240:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191248:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff95d6a0d29600) 00010000:00010000:1.0:1788391172.191251:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.191254:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191261:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37315 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191276:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191282:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191288:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191293:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.191296:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191301:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191308:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391172.191310:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.191317:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.191323:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3731c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.191451:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:34844:x1875263094163200:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 652us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.191458:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1788391172.273059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.274403:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094163456 00000100:00100000:0.0:1788391172.274416:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094163456 00000100:00100000:0.0:1788391172.274530:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1788391172.274549:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:34851:x1875263094163456:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1788391172.274566:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.274583:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffbc expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274655:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274669:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274681:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274707:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274715:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274722:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274836:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37338 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274850:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37338 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274858:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37338 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.274880:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788391172.274990:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.274998:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275006:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275012:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.275016:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275024:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275142:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.275146:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.275151:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275157:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd3732a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275171:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275178:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275194:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275200:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.275203:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275208:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275217:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391172.275219:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.275221:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275227:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37331 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275282:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffbc expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275296:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37338 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffbc expref: 28 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.275303:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:0.0:1788391172.275305:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391172.275308:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391172.275430:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:34851:x1875263094163456:12345-192.168.202.1@tcp:101:cat.0 Request processed in 881us (2477us total) trans 30064771244 rc 0/0 00000100:00100000:0.0:1788391172.275447:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:2.0:1788391172.278864:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.279140:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094163712 00000100:00100000:1.0:1788391172.279151:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094163712 00000100:00100000:1.0:1788391172.279235:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1788391172.279245:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:34851:x1875263094163712:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1788391172.279486:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:34851:x1875263094163712:12345-192.168.202.1@tcp:35:cat.0 Request processed in 242us (630us total) trans 30064771245 rc 0/0 00000100:00100000:1.0:1788391172.279493:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788391172.398215:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.398423:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094163968 00000100:00100000:0.0:1788391172.398433:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094163968 00000100:00100000:0.0:1788391172.398605:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:0.0:1788391172.398617:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:34863:x1875263094163968:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391172.398652:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.398655:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391172.398681:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd372c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfff99 expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.398734:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.398746:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391172.398760:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37346 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffc3 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.398874:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3734d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.398888:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3734d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.398897:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3734d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.398908:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788391172.399094:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37346 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffc3 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.399131:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3734d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffc3 expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.399138:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:0.0:1788391172.399141:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391172.399144:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a400, rc 0) 00000100:00100000:0.0:1788391172.399207:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34863:x1875263094163968:12345-192.168.202.1@tcp:101:bash.0 Request processed in 593us (999us total) trans 30064771246 rc 0/0 00000100:00100000:0.0:1788391172.399214:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:2.0:1788391172.406518:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.406714:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164224 00000100:00100000:1.0:1788391172.406724:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164224 00000100:00100000:1.0:1788391172.406846:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:1.0:1788391172.406857:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34863:x1875263094164224:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1788391172.406913:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391172.406940:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3734d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffc3 expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.407002:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37338 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffbc expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.407015:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391172.407043:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391172.407234:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.407248:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.407258:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391172.407311:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771247 00000004:00010000:1.0:1788391172.407350:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f753849 reply state 000000008d0be887 transno 30064771248 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.407360:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391172.407453:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34863:x1875263094164224:12345-192.168.202.1@tcp:36:bash.0 Request processed in 597us (953us total) trans 30064771248 rc 0/0 00000100:00100000:1.0:1788391172.407460:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000020:00080000:1.0:1788391172.407465:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391172.409741:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409756:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409764:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409770:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.409775:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409799:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409814:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391172.409817:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.409821:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.409827:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3735b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.411143:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.411254:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164352 00000100:00100000:1.0:1788391172.411262:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164352 00000100:00100000:1.0:1788391172.411303:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1788391172.411310:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34863:x1875263094164352:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391172.411599:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.411615:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37362 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffca expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411699:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411716:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411727:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.411755:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:1.0:1788391172.411770:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391172.411791:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411816:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37362 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffca expref: 32 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411829:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffca expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.411837:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:1.0:1788391172.411839:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391172.411842:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6c00, rc 0) 00000100:00100000:1.0:1788391172.411916:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34863:x1875263094164352:12345-192.168.202.1@tcp:101:bash.0 Request processed in 606us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.411924:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788391172.422226:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.422446:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164608 00000100:00100000:0.0:1788391172.422456:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164608 00000100:00100000:0.0:1788391172.422631:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1788391172.422643:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34863:x1875263094164608:12345-192.168.202.1@tcp:103:bash.0 00010000:00010000:0.0:1788391172.422658:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788391172.422681:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37369 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffca expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.422714:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37307 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffb5 expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.422725:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d29800) 00010000:00010000:0.0:1788391172.422736:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391172.422833:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:34863:x1875263094164608:12345-192.168.202.1@tcp:103:bash.0 Request processed in 192us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.422840:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1788391172.425487:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.428698:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164736 00000100:00100000:0.0:1788391172.428713:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164736 00000100:00100000:0.0:1788391172.428790:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1788391172.428802:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:34863:x1875263094164736:12345-192.168.202.1@tcp:58:bash.0 00010000:00010000:0.0:1788391172.428896:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.428913:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.428924:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391172.431051:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].6, 136 off9008 00000100:00100000:0.0:1788391172.431164:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:34863:x1875263094164736:12345-192.168.202.1@tcp:58:bash.0 Request processed in 2360us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.431174:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000040:00080000:2.0:1788391172.432421:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391172.432428:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391172.432465:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:2.0:1788391172.432472:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391172.433278:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103466368:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788391172.433352:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747300 going to sleep for 11 seconds 00000100:00100000:0.0:1788391172.434023:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.434121:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164864 00000100:00100000:1.0:1788391172.434130:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164864 00000100:00100000:1.0:1788391172.434221:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1788391172.434232:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34863:x1875263094164864:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391172.434259:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.434278:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffd1 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434335:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434346:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434379:0:43348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434393:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434406:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.434409:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.434413:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 31 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.434420:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6200, rc 0) 00000100:00100000:1.0:1788391172.434465:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34863:x1875263094164864:12345-192.168.202.1@tcp:101:bash.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.434472:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1788391172.436804:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103466368:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391172.439874:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391172.440105:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094164992 00000100:00100000:3.0:1788391172.440116:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094164992 00000100:00100000:3.0:1788391172.440176:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:3.0:1788391172.440186:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34864:x1875263094164992:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391172.440219:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391172.440313:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34864:x1875263094164992:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 128us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391172.440320:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:3.0:1788391172.444854:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.445047:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094165120 00000100:00100000:1.0:1788391172.445065:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094165120 00000100:00100000:1.0:1788391172.445122:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:1.0:1788391172.445134:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34864:x1875263094165120:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.445202:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445219:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445230:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445259:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445265:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445269:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445287:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445292:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445295:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.445334:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:1.0:1788391172.445337:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391172.445346:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445353:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445357:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445362:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445380:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.445384:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445389:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445399:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391172.445400:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.445403:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445407:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3737e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445416:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445419:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445423:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445426:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.445427:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445430:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445440:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb4468db5 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391172.445441:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.445443:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445446:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37385 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445456:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445459:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445462:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445465:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.445466:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445470:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445473:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.445475:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.445476:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.445479:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd3738c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.445537:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34864:x1875263094165120:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 406us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.445546:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:0.0:1788391172.448289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.448380:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094165376 00000100:00100000:1.0:1788391172.448390:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094165376 00000100:00100000:1.0:1788391172.448468:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:1.0:1788391172.448478:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:34864:x1875263094165376:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.448497:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.448515:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37393 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffd8 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448606:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448616:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448625:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.448632:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00010000:00010000:1.0:1788391172.448719:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448726:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448733:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448757:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.448766:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448774:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448786:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.448789:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391172.448793:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448797:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3739a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448828:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37393 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd8 expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448835:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391172.448836:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391172.448839:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37393 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd8 expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.448845:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7a00, rc 0) 00000100:00100000:1.0:1788391172.449045:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34864:x1875263094165376:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 566us (762us total) trans 30064771249 rc 301/301 00000100:00100000:1.0:1788391172.449053:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1788391172.453566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.453648:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094165504 00000100:00100000:1.0:1788391172.453669:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094165504 00000100:00100000:1.0:1788391172.453734:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:1.0:1788391172.453745:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34864:x1875263094165504:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788391172.453780:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788391172.453875:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34864:x1875263094165504:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.453883:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1788391172.456382:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.456454:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094165632 00000100:00100000:0.0:1788391172.456464:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094165632 00000100:00100000:0.0:1788391172.456548:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:0.0:1788391172.456559:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:34864:x1875263094165632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391172.456584:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.456605:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffdf expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456711:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456725:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456737:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.456771:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391172.456775:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391172.456794:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456818:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffdf expref: 33 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456835:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffdf expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.456842:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.456845:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391172.456848:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391172.456904:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:34864:x1875263094165632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 347us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.456911:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:0.0:1788391172.460141:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.460217:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094165888 00000100:00100000:1.0:1788391172.460227:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094165888 00000100:00100000:1.0:1788391172.460281:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1788391172.460292:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:34864:x1875263094165888:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.460312:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.460315:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391172.460340:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd373af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffdf expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.460358:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.460367:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391172.460381:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffe6 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391172.460783:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc5:0x0], index 1: 0 00010000:00010000:1.0:1788391172.461009:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd373bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.461022:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd373bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.461046:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd373bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.461098:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffe6 expref: 34 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.461117:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd373bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffe6 expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.461124:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d29a00) 00010000:00010000:1.0:1788391172.461127:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391172.461130:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6800, rc 0) 00000100:00100000:1.0:1788391172.461189:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:34864:x1875263094165888:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 898us (1057us total) trans 30064771250 rc 0/0 00000100:00100000:1.0:1788391172.461196:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:3.0:1788391172.466106:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.466187:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166016 00000100:00100000:1.0:1788391172.466196:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166016 00000100:00100000:1.0:1788391172.466286:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788391172.466296:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:34864:x1875263094166016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.466319:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.466339:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd373cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbfffed expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466402:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466414:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466439:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.466473:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391172.466477:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391172.466497:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466520:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd373cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffed expref: 35 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466538:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffed expref: 34 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.466546:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391172.466549:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391172.466553:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391172.466620:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:34864:x1875263094166016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 326us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.466628:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1788391172.470124:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.470199:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166272 00000100:00100000:1.0:1788391172.470209:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166272 00000100:00100000:1.0:1788391172.470265:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:1.0:1788391172.470275:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:34864:x1875263094166272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.470327:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391172.470351:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd373bd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffe6 expref: 34 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470384:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d29a00) 00010000:00010000:1.0:1788391172.470401:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd373d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffed expref: 33 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470409:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391172.470414:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391172.470435:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470446:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470457:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470467:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470473:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470480:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470539:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470546:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470563:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470569:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.470573:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470582:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470589:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391172.470592:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.470596:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470601:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd373d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470613:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470618:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470623:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470627:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.470629:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470642:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470650:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5f3a7f1 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391172.470652:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.470655:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.470660:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc5f3a7f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.470758:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:34864:x1875263094166272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 484us (641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788391172.470765:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:3.0:1788391172.474162:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.476388:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166400 00000100:00100000:0.0:1788391172.476413:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166400 00000100:00100000:0.0:1788391172.476474:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:0.0:1788391172.476484:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:34864:x1875263094166400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391172.476504:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.476524:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd373e7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffff4 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.476556:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373ee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.476568:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.476579:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.477071:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd373e7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffff4 expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.477091:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a600/0x9aafc5f04cd373ee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffff4 expref: 33 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.477101:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.477104:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391172.477107:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79a600, rc 0) 00000100:00100000:0.0:1788391172.477160:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:34864:x1875263094166400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 678us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.477168:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:0.0:1788391172.479558:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.479674:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166656 00000100:00100000:1.0:1788391172.479683:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166656 00000100:00100000:3.0:1788391172.479887:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:3.0:1788391172.479900:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:34864:x1875263094166656:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391172.480209:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.480226:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.480235:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391172.480564:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].7, 88 off8736 00000004:00080000:3.0:1788391172.480575:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 989587613407ns, next at 990587610800ns, rc = 0 00000004:00010000:3.0:1788391172.480652:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ab9073a reply state 0000000069d68234 transno 30064771251 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.480659:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391172.480798:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:34864:x1875263094166656:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 899us (1248us total) trans 30064771251 rc 0/0 00000100:00100000:3.0:1788391172.480806:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00010000:00010000:1.0:1788391172.482732:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482747:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482759:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482765:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.482770:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482777:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482808:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.482811:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391172.482815:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.482822:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd373f5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.484431:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.484521:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166784 00000100:00100000:1.0:1788391172.484531:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166784 00000100:00100000:1.0:1788391172.484625:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:1.0:1788391172.484636:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:34864:x1875263094166784:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.484658:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.484676:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcbffffb expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.484741:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 35 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.484754:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 35 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.484770:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.484773:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.484776:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6a00, rc 0) 00000100:00100000:1.0:1788391172.484828:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:34864:x1875263094166784:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 194us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.484848:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:2.0:1788391172.486491:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391172.486564:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094166912 00000100:00100000:3.0:1788391172.486572:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094166912 00000100:00080000:1.0:1788391172.486611:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391172.486633:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788391172.486643:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2358:x1875263094166912:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391172.487249:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2358:x1875263094166912:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 606us (761us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1788391172.487258:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788391172.488701:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.488843:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094167168 00000100:00100000:0.0:1788391172.488849:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094167168 00000100:00100000:0.0:1788391172.488896:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788391172.488906:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:34864:x1875263094167168:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391172.489140:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:34864:x1875263094167168:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 234us (456us total) trans 30064771252 rc 0/0 00000100:00100000:1.0:1788391172.489147:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1788391172.491643:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.491769:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094167424 00000100:00100000:0.0:1788391172.491779:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094167424 00000100:00100000:0.0:1788391172.491839:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:0.0:1788391172.491849:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:34864:x1875263094167424:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788391172.492049:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:34864:x1875263094167424:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 202us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.492054:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788391172.494329:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.494422:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094167552 00000100:00100000:0.0:1788391172.494430:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094167552 00000100:00100000:0.0:1788391172.494486:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1788391172.494497:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:34864:x1875263094167552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391172.494515:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.494535:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37403 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00002 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.494630:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.494644:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.494653:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.494700:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391172.494924:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.494946:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37403 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00002 expref: 38 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.495093:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00002 expref: 37 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.495100:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:0.0:1788391172.495103:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788391172.495105:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391172.495154:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:34864:x1875263094167552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 661us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.495161:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:1.0:1788391172.497292:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.497553:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094167680 00000100:00100000:0.0:1788391172.497562:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094167680 00000100:00100000:0.0:1788391172.497626:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1788391172.497636:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094167680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391172.497651:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.497666:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00009 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391172.497696:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af04, blocks: 0x1 00010000:00010000:0.0:1788391172.497718:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=989s v=(0 0) 00010000:00010000:0.0:1788391172.497734:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391172.497743:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 8 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.497766:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 8 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.497779:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b600, rc 0) 00000100:00100000:0.0:1788391172.497834:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094167680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 199us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.497840:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788391172.499882:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.499946:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094167936 00000100:00100000:0.0:1788391172.499953:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094167936 00000100:00100000:0.0:1788391172.500049:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:0.0:1788391172.500056:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:34864:x1875263094167936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788391172.500127:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:34864:x1875263094167936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 73us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.500133:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1788391172.502138:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.502176:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168064 00000100:00100000:0.0:1788391172.502185:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168064 00000100:00100000:0.0:1788391172.502269:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:0.0:1788391172.502281:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:34864:x1875263094168064:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788391172.520454:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771246 is committed 00000001:00080000:2.0:1788391172.520474:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771252 is committed 00000004:00080000:2.0:1788391172.520489:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788391172.520511:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d691559240 refcount 2 committed 0 result 0 batchid 25769803903 00000020:00080000:2.0:1788391172.520516:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d69f421900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d691559840 00000020:00080000:2.0:1788391172.520520:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d69f421300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d586677400 00000004:00080000:2.0:1788391172.520546:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788391172.520677:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391172.520704:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103466496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788391172.520711:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34864:x1875263094168064:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 18431us (18576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.520721:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391172.520756:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788391172.520757:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803903 committed batchid 25769803902 00000100:00100000:2.0:1788391172.520801:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103466496 00000100:00100000:2.0:1788391172.520807:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103466496 00000100:00100000:2.0:1788391172.520851:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788391172.520859:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103466496:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788391172.520918:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00002000:00010000:2.0:1788391172.521003:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788391172.521007:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788391172.521009:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391172.521011:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1788391172 -> 1788391172 00002000:00010000:2.0:1788391172.521013:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391172.521042:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103466496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (286us total) trans 30064771096 rc 0/0 00000100:00100000:2.0:1788391172.521048:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1788391172.521089:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d691119180/2, rc 0, transno 30064771096 00000100:00100000:2.0:1788391172.521095:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103466496:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788391172.521281:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391172.521299:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391172.521375:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5872e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103466624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391172.521406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391172.521617:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103466624 00000100:00100000:3.0:1788391172.521622:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103466624 00000100:00100000:3.0:1788391172.521661:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788391172.521678:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103466624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788391172.521706:0:43326:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:197 count 1 00002000:00010000:3.0:1788391172.521732:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 6, mtime: 0x6a98af04, atime: 0x6a98af04, ctime: 0x6a98af04, blocks: 0x1 00010000:00010000:3.0:1788391172.521740:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.521756:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=989s v=(0 0) 00010000:00010000:3.0:1788391172.521759:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391172.521764:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.521774:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.521780:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.521785:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.521799:0:43326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391172.521824:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391172.521830:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.521837:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391172.521841:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.521850:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.521867:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.521874:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83ddd92/0x9aafc5f04cd37418 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.521889:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391172.521890:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391172.521892:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391172.522201:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103466624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 523us (793us total) trans 30064771092 rc 0/0 00000100:00100000:3.0:1788391172.522208:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:1.0:1788391172.522231:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d5872e9f80/2, rc 0, transno 30064771092 00000100:00100000:1.0:1788391172.522237:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5872e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103466624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391172.523906:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391172.523952:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168192 00000100:00100000:3.0:1788391172.524025:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168192 00000100:00100000:2.0:1788391172.524094:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788391172.524104:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094168192:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788391172.524188:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094168192:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391172.524209:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:0.0:1788391172.526809:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391172.526903:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168448 00000100:00100000:3.0:1788391172.526924:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168448 00000100:00100000:3.0:1788391172.526996:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:3.0:1788391172.527006:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34864:x1875263094168448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391172.527059:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391172.527086:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3740a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00002 expref: 13 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.527104:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:3.0:1788391172.527108:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391172.527134:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.527143:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.527150:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391172.527292:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b60011a reply state 00000000882891bc transno 30064771253 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.527301:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391172.527398:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:34864:x1875263094168448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 393us (595us total) trans 30064771253 rc 0/0 00000100:00100000:3.0:1788391172.527405:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:3.0:1788391172.529473:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.529563:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168576 00000100:00100000:2.0:1788391172.529573:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168576 00000100:00100000:2.0:1788391172.529640:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788391172.529651:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094168576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788391172.529874:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788391172.529878:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788391172 00002000:00010000:2.0:1788391172.529880:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1788391172 00002000:00010000:2.0:1788391172.529882:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1788391172 -> 1788391172 00002000:00010000:2.0:1788391172.529884:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391172.529951:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094168576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 301us (484us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1788391172.529994:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00010000:00010000:1.0:1788391172.530623:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530635:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530643:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530648:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.530653:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530660:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530699:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.530702:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.530714:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.530720:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd3741f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.532210:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.532296:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168704 00000100:00100000:2.0:1788391172.532308:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168704 00000100:00100000:2.0:1788391172.532359:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1788391172.532370:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094168704:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391172.532410:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532426:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391172.532430:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391172.532436:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532449:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532480:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532485:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532490:0:43326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532493:0:43326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391172.532496:0:43326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532502:0:43326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532509:0:43326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.532513:0:43326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37426 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.532601:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094168704:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 233us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391172.532617:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391172.533921:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.534060:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094168960 00000100:00100000:1.0:1788391172.534066:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094168960 00000100:00100000:1.0:1788391172.534103:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:1.0:1788391172.534112:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:34864:x1875263094168960:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788391172.534175:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534186:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534194:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534467:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534475:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534481:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534517:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 14 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.534529:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 14 pid: 42646 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.534544:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103466752:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391172.534632:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788391172.536849:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103466752:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391172.536877:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391172.537753:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.537842:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169088 00000100:00100000:2.0:1788391172.537850:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169088 00010000:00010000:2.0:1788391172.537885:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 15 pid: 42646 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.538053:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1788391172.538060:0:42630:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788391172.538064:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692290450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094169088:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788391172.538069:0:42630:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788391172.538079:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391172.538085:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 15 pid: 42646 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538097:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 15 pid: 42646 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538116:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd373fc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbffffb expref: 15 pid: 42646 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538127:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:2.0:1788391172.538131:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538138:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538143:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.538164:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391172.538206:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692290450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094169088:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 143us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391172.538213:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00010000:00010000:1.0:1788391172.538299:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.538373:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391172.538557:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771254 00000001:00080000:1.0:1788391172.538717:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771255 00000001:00080000:1.0:1788391172.538763:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771256 00000100:00100000:1.0:1788391172.538840:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103466880:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788391172.538897:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391172.538928:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788391172.539165:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103466880 00000100:00100000:2.0:1788391172.539171:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103466880 00000100:00100000:2.0:1788391172.539204:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788391172.539212:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42646:x1875263103466880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391172.539273:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42646:x1875263103466880:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391172.539278:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788391172.539518:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103466880:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788391172.539921:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771257 00000100:00100000:0.0:1788391172.539990:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103467008:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391172.540016:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391172.540038:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391172.540249:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103467008 00000100:00100000:3.0:1788391172.540254:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103467008 00000100:00100000:3.0:1788391172.540292:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788391172.540298:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42646:x1875263103467008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788391172.540471:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:42646:x1875263103467008:12345-0@lo:1000:mdt00_002.0 Request processed in 172us (452us total) trans 30064771098 rc 0/0 00000100:00100000:3.0:1788391172.540479:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788391172.540497:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103467008:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788391172.540524:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540554:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540560:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540566:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.540570:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540578:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540603:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.540606:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.540610:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540616:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37434 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540635:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540641:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540647:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540652:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.540660:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540666:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540674:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.540676:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391172.540682:0:42646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540887:0:42646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540895:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.540917:0:42646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6200/0x9aafc5f04cd37377 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcbfffd1 expref: 17 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.540925:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103467136:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391172.540990:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fd1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788391172.542792:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103467136:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391172.542810:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542816:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37370 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542858:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542867:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542875:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542884:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542890:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542897:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542902:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.542905:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542910:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542917:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.542919:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391172.542921:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542924:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3743b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542937:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542941:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542944:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542947:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391172.542949:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542952:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542956:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:1.0:1788391172.542957:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391172.542986:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.542992:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3742d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391172.543150:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:34864:x1875263094168960:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 9038us (9233us total) trans 30064771258 rc 0/0 00000100:00100000:1.0:1788391172.543159:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000020:00080000:1.0:1788391172.543163:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788391172.543209:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391172.543226:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391172.543261:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:2.0:1788391172.543268:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391172.544903:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.545256:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169344 00000100:00100000:1.0:1788391172.545266:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169344 00000100:00100000:0.0:1788391172.545386:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.545824:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169472 00000100:00100000:3.0:1788391172.545834:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788391172.545846:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:34864:x1875263094169344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391172.545889:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169472 00000004:00080000:3.0:1788391172.546518:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788391172.547113:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771259 00010000:00010000:3.0:1788391172.547146:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547158:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547166:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547172:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547176:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547180:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391172.547231:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391172.547330:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:34864:x1875263094169344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1477us (2421us total) trans 30064771260 rc 0/0 00000100:00100000:3.0:1788391172.547339:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000020:00080000:3.0:1788391172.547344:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788391172.547388:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1788391172.547395:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:34863:x1875263094169472:12345-192.168.202.1@tcp:49:bash.0 00000100:00100000:3.0:1788391172.547446:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:34863:x1875263094169472:12345-192.168.202.1@tcp:49:bash.0 Request processed in 52us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391172.547450:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:1.0:1788391172.548123:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391172.548131:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.548138:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391172.548142:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.548149:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.548162:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff95d6a0d59000) 00010000:00010000:1.0:1788391172.548165:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391172.548169:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.548175:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37442 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.548186:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391172.548188:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391172.548190:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391172.550271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.550829:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169600 00000100:00100000:2.0:1788391172.550839:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169600 00000100:00100000:2.0:1788391172.550894:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391172.550904:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:34863:x1875263094169600:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391172.550921:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391172.550939:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00010 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.551002:0:43328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 10 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.551031:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391172.551035:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391172.551041:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00010 expref: 10 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.551075:0:43328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 10 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.551089:0:43328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 10 pid: 44885 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.551102:0:43328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103467264:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391172.551180:0:43328:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747300 going to sleep for 11 seconds 00000100:00100000:3.0:1788391172.555089:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.555174:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169728 00000100:00100000:0.0:1788391172.555184:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169728 00010000:00010000:0.0:1788391172.555229:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 11 pid: 44885 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.555275:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1788391172.555289:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094169728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391172.555304:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391172.555336:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 11 pid: 44885 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.555350:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 11 pid: 44885 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.555375:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391172.555394:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391172.555404:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00010 expref: 11 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.555415:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00010 expref: 11 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.555454:0:42629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00010 expref: 11 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.555469:0:42629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:42629:1875263103467392:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391172.555550:0:42629:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d685298b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788391172.555657:0:43328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94e34a2/0x9aafc5f04cd37411 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00009 expref: 11 pid: 44885 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391172.555673:0:43328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:43328:1875263103467264:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391172.555707:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e13b8a1/0x9aafc5f04cd37449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00010 expref: 10 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391172.555718:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e000, rc 0) 00000100:00100000:2.0:1788391172.555745:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:34863:x1875263094169600:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4842us (5482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391172.555762:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1788391172.559759:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391172.559862:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094169984 00000100:00100000:2.0:1788391172.559871:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094169984 00000100:00100000:2.0:1788391172.559928:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788391172.559938:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:34863:x1875263094169984:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1788391172.560211:0:42629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:42629:1875263103467392:192.168.202.1@tcp:105: 00000001:00080000:2.0:1788391172.560225:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771261 00010000:00010000:1.0:1788391172.560238:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391172.560332:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2358:x1875263094169728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 5046us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.560341:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1788391172.560702:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:34863:x1875263094169984:12345-192.168.202.1@tcp:35:bash.0 Request processed in 764us (951us total) trans 30064771262 rc 0/0 00000100:00100000:2.0:1788391172.560710:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000020:00080000:2.0:1788391172.560714:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788391172.618998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.619095:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094170112 00000100:00100000:1.0:1788391172.619106:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094170112 00000100:00100000:1.0:1788391172.619177:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:1.0:1788391172.619187:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:34874:x1875263094170112:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391172.619212:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391172.619235:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00017 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619297:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619322:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619334:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391172.619365:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391172.619369:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391172.619388:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619410:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00017 expref: 23 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619428:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00017 expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391172.619436:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391172.619438:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391172.619441:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6800, rc 0) 00000100:00100000:1.0:1788391172.619488:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:34874:x1875263094170112:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 302us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391172.619501:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:3.0:1788391172.623083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.623172:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094170240 00000100:00100000:0.0:1788391172.623182:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094170240 00000100:00100000:0.0:1788391172.623235:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1788391172.623246:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:34874:x1875263094170240:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391172.623332:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623348:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623360:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623376:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623400:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623406:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623641:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623650:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623657:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391172.623705:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623718:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623724:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623730:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623735:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.623740:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623748:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623764:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:0.0:1788391172.623767:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.623772:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623778:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd3745e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623792:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623797:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623803:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623808:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.623811:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623817:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623824:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391172.623826:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.623829:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623835:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd37465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623860:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623866:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623872:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623878:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.623880:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623885:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623892:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391172.623894:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.623897:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.623902:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd3746c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391172.624032:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:34874:x1875263094170240:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 787us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391172.624041:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:1.0:1788391172.706275:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391172.706432:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094170496 00000100:00100000:0.0:1788391172.706443:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094170496 00000100:00100000:0.0:1788391172.706509:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1788391172.706537:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:34881:x1875263094170496:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1788391172.706569:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391172.706597:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd37473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0001e expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706670:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706696:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706708:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706723:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706730:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.706738:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707031:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37488 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707041:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37488 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707048:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37488 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391172.707069:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 12 00010000:00010000:0.0:1788391172.707164:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707172:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707178:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707184:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.707188:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707196:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707208:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:0.0:1788391172.707211:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.707216:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707222:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd3747a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707234:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707446:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707462:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707467:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391172.707470:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707477:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707486:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391172.707488:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391172.707491:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707497:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707537:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd37473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0001e expref: 25 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707551:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79bc00/0x9aafc5f04cd37488 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0001e expref: 24 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391172.707703:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff95d6a0d59f00) 00010000:00010000:0.0:1788391172.707706:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391172.707708:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79bc00, rc 0) 00000100:00100000:0.0:1788391172.707828:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:34881:x1875263094170496:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1294us (1562us total) trans 30064771263 rc 0/0 00000100:00100000:0.0:1788391172.707843:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:3.0:1788391172.712910:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391172.713011:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094170752 00000100:00100000:1.0:1788391172.713022:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094170752 00000100:00100000:1.0:1788391172.713082:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1788391172.713094:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:34881:x1875263094170752:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1788391172.713452:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34881:x1875263094170752:12345-192.168.202.1@tcp:35:cat.0 Request processed in 360us (551us total) trans 30064771264 rc 0/0 00000100:00100000:1.0:1788391172.713460:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00010000:00010000:2.0:1788391173.069102:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391174.093463:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391174.093484:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391174.093547:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391174.093761:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103467648:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.093794:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391174.093868:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103468032:0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.093898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391174.093918:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391174.093924:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103467904:0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.093944:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391174.093950:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103468160:0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.093982:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468032 00000100:00100000:3.0:1788391174.093988:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391174.093989:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468032 00000100:00100000:3.0:1788391174.094055:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391174.094061:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103467776:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.094087:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391174.094136:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103467904 00000100:00100000:0.0:1788391174.094140:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103467904 00000100:00100000:0.0:1788391174.094160:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468160 00000100:00100000:0.0:1788391174.094162:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468160 00000100:00100000:0.0:1788391174.094178:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788391174.094185:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103468032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.094233:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103468032:12345-0@lo:400:kworker.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391174.094239:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788391174.094254:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788391174.094260:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103467904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.094285:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103467904:12345-0@lo:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391174.094291:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788391174.094301:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391174.094307:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103468160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.094339:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103468160:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391174.094355:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103467520 00000100:00100000:3.0:1788391174.094359:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103467520 00000100:00100000:0.0:1788391174.094360:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391174.094376:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103467776 00000100:00100000:0.0:1788391174.094379:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103467776 00000100:00100000:3.0:1788391174.094421:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788391174.094434:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103467520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391174.094460:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788391174.095117:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103467520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 681us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391174.095124:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788391174.095146:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391174.095206:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103468160:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.095263:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103467904:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.095274:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103468032:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.095304:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391174.099196:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788391174.099213:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103467776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391174.099287:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103467776:12345-0@lo:400:kworker.0 Request processed in 82us (5200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391174.099291:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788391174.099334:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103467776:0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.099986:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103467648 00000100:00100000:3.0:1788391174.100005:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103467648 00000100:00100000:3.0:1788391174.100099:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788391174.100108:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103467648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391174.100156:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103467648:12345-0@lo:400:kworker.0 Request processed in 50us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391174.100162:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788391174.100722:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391174.100729:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391174.100732:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391174.100867:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103467648:0@lo:400:kworker.0 00010000:00010000:2.0:1788391175.117120:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391175.119330:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391175.119353:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391175.119421:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391175.119683:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468288 00000100:00100000:1.0:1788391175.119692:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468288 00000100:00100000:1.0:1788391175.119801:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788391175.119821:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103468288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391175.119857:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788391175.119928:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103468288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391175.119936:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788391175.120036:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391175.801146:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.801198:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.801223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.801254:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.801281:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.801309:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171392 00000100:00100000:3.0:1788391175.801317:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171392 00000100:00100000:3.0:1788391175.801378:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171008 00000100:00100000:3.0:1788391175.801392:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171008 00000100:00100000:3.0:1788391175.801426:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788391175.801437:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094171392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391175.801512:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094171392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391175.801519:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1788391175.801536:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391175.801543:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094171008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391175.801588:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094171008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391175.801595:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391175.801615:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171136 00000100:00100000:3.0:1788391175.801618:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171136 00000100:00100000:3.0:1788391175.801641:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171264 00000100:00100000:3.0:1788391175.801643:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171264 00000100:00100000:3.0:1788391175.801675:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391175.801681:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094171136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391175.801709:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094171136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391175.801715:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391175.801727:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788391175.801733:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094171264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391175.801759:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094171264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391175.801765:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00080000:3.0:1788391175.801935:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391175.801939:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391175.801942:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391175.802666:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094170880 00000100:00100000:2.0:1788391175.802674:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094170880 00000100:00100000:2.0:1788391175.802710:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1788391175.802718:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094170880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391175.802768:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094170880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391175.802775:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1788391175.812822:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391175.812856:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391175.812917:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171520 00000100:00100000:0.0:1788391175.812926:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171520 00000100:00100000:0.0:1788391175.813000:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171648 00000100:00100000:0.0:1788391175.813002:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171648 00000100:00100000:0.0:1788391175.813019:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788391175.813026:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2355:x1875263094171520:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1788391175.813052:0:43698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd36634 00000100:00080000:0.0:1788391175.813067:0:43698:0:(import.c:65:import_set_state_nolock()) ffff95d6a6e14000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788391175.813108:0:43698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771092 00000100:00100000:0.0:1788391175.813294:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+2:2355:x1875263094171520:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 269us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391175.813312:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1788391175.813325:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:0.0:1788391175.813330:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2355:x1875263094171648:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1788391175.813338:0:43698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9aafc5f04cd3663b 00000100:00080000:0.0:1788391175.813343:0:43698:0:(import.c:65:import_set_state_nolock()) ffff95d6a6e15000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788391175.813360:0:43698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771098 00000100:00100000:0.0:1788391175.813456:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+2:2355:x1875263094171648:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 125us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391175.813463:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00010000:00010000:0.0:1788391175.813510:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788391175.813650:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391175.813662:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391175.813717:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391176.144759:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788391176.183000:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52ce7de6-d362-4c91-9bea-438b5645df6d 00000020:00000080:3.0:1788391176.183008:0:6676:0:(genops.c:885:class_export_put()) final put ffff95d6a6e17800/52ce7de6-d362-4c91-9bea-438b5645df6d 00000001:00080000:3.0:1788391176.183035:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771091 is committed 00000001:00080000:3.0:1788391176.183043:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771090 is committed 00000001:00080000:3.0:1788391176.183053:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771092 is committed 00000020:00000080:0.0:1788391176.183190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6e17800/52ce7de6-d362-4c91-9bea-438b5645df6d for lustre-OST0000 00000020:00000080:0.0:1788391176.183244:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a6e14000 for lustre-OST0000 00000100:00100000:2.0:1788391176.569570:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391176.569639:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094171776 00000100:00100000:3.0:1788391176.569678:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094171776 00000100:00100000:3.0:1788391176.569745:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:3.0:1788391176.569756:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34820:x1875263094171776:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788391176.569879:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34820:x1875263094171776:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391176.569887:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:0.0:1788391176.578920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391176.579318:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172032 00000100:00100000:2.0:1788391176.579345:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172032 00000100:00100000:2.0:1788391176.579414:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788391176.579425:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:34820:x1875263094172032:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391176.579941:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:34820:x1875263094172032:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 515us (1028us total) trans 30064771265 rc 0/0 00000100:00100000:2.0:1788391176.579949:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000001:00100000:1.0:1788391176.696590:0:7599:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52ce7de6-d362-4c91-9bea-438b5645df6d 00000020:00000080:1.0:1788391176.696598:0:7599:0:(genops.c:885:class_export_put()) final put ffff95d6a6e12000/52ce7de6-d362-4c91-9bea-438b5645df6d 00000001:00080000:1.0:1788391176.696622:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771097 is committed 00000001:00080000:1.0:1788391176.696630:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771096 is committed 00000001:00080000:1.0:1788391176.696636:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771098 is committed 00000020:00000080:1.0:1788391176.696657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95d6a6e12000/52ce7de6-d362-4c91-9bea-438b5645df6d for lustre-OST0001 00000020:00000080:1.0:1788391176.696717:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95d6a6e15000 for lustre-OST0001 00000100:00100000:1.0:1788391176.736780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391176.736916:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172160 00000100:00100000:3.0:1788391176.736927:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172160 00000100:00100000:3.0:1788391176.737031:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:3.0:1788391176.737042:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:35320:x1875263094172160:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:3.0:1788391176.737062:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391176.737082:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00025 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737150:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737177:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737188:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391176.737225:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391176.737229:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391176.737248:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737272:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737288:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391176.737296:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:3.0:1788391176.737299:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391176.737303:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:3.0:1788391176.737351:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:35320:x1875263094172160:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 312us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391176.737356:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00010000:00010000:2.0:1788391177.165062:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788391177.734633:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771263 is committed 00000020:00080000:2.0:1788391177.734662:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d68f402480 refcount 2 committed 0 result 0 batchid 25769803904 00000020:00080000:2.0:1788391177.734667:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6c1c1f100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68f402840 00000020:00080000:2.0:1788391177.734751:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6c1c1f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58a78fc00 00000020:00080000:2.0:1788391177.734774:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803903 batchid updated 00000001:00080000:2.0:1788391177.734781:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771264 is committed 00000001:00080000:2.0:1788391177.734793:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771265 is committed 00000020:00080000:0.0:1788391177.734844:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803904 committed batchid 25769803903 00000020:00080000:0.0:1788391177.735067:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803903 00010000:00010000:2.0:1788391178.189265:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788391178.845713:0:45636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 19:19:38 (1788391178) 00010000:00010000:2.0:1788391179.213124:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391179.214059:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391179.214079:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103468416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391179.214144:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391179.214258:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468416 00000100:00100000:2.0:1788391179.214266:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468416 00000100:00100000:2.0:1788391179.214327:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788391179.214336:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103468416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391179.214368:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788391179.214414:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103468416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.214420:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788391179.214479:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391179.214509:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771098 gen 2 00000004:00080000:1.0:1788391179.214515:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d691119180, transno 30064771096 00000004:00080000:1.0:1788391179.214531:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771098 committed transno 30064771098 00000100:00100000:1.0:1788391179.214556:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103468416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391179.214843:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103468544:0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.214887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391179.214995:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103468672:0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.215033:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391179.215042:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788391179.215063:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468544 00000100:00100000:3.0:1788391179.215069:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468544 00000100:00100000:1.0:1788391179.215099:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103468800:0@lo:400:kworker.0 00000100:00100000:3.0:1788391179.215107:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788391179.215122:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103468544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391179.215309:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391179.215322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391179.215356:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103469056:0@lo:400:kworker.0 00000100:00100000:2.0:1788391179.215363:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468672 00000100:00100000:2.0:1788391179.215368:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468672 00000100:00100000:0.0:1788391179.215385:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391179.215417:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788391179.215424:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468928 00000100:00100000:2.0:1788391179.215425:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103468672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.215447:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468928 00000100:00100000:2.0:1788391179.215466:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103468672:12345-0@lo:400:kworker.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.215473:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788391179.215485:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103469056 00000100:00100000:0.0:1788391179.215489:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103469056 00000100:00100000:2.0:1788391179.215505:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:2.0:1788391179.215510:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771091 committed transno 30064771092 00000004:00080000:2.0:1788391179.215526:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d5872e9f80, transno 30064771092 00000100:00100000:0.0:1788391179.215530:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788391179.215540:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103468672:0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.215553:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103468928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391179.215581:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788391179.215591:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103469056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.215600:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103468928:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391179.215608:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788391179.215644:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103469056:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.215651:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788391179.215660:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103469056:0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.215673:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103468928:0@lo:400:kworker.0 00000100:00080000:0.0:1788391179.215712:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391179.215716:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391179.216097:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391179.216171:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103468800 00000100:00100000:0.0:1788391179.216176:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103468800 00000100:00100000:0.0:1788391179.216210:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788391179.216216:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103468800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.216329:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103468800:12345-0@lo:400:kworker.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391179.216334:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788391179.216377:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103468800:0@lo:400:kworker.0 00000100:00100000:3.0:1788391179.219858:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103468544:12345-0@lo:400:kworker.0 Request processed in 4735us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391179.219886:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788391179.221045:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103468544:0@lo:400:kworker.0 00000100:00100000:0.0:1788391179.775750:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391179.775872:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172416 00000100:00100000:3.0:1788391179.775883:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172416 00000100:00100000:3.0:1788391179.775994:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:3.0:1788391179.776006:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:35578:x1875263094172416:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391179.776029:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391179.776048:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd374a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0002c expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776119:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776133:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776144:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776159:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776166:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776173:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776419:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776439:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776445:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391179.776455:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788391179.776564:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776572:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776578:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776586:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391179.776590:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776598:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776609:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:3.0:1788391179.776612:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391179.776616:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776634:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd374ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776646:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776657:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776664:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776668:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391179.776671:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776677:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776684:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d686a70800) 00010000:00010000:3.0:1788391179.776687:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391179.776689:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.776695:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd374b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.777077:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd374a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0002c expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.777095:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0002c expref: 15 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.777104:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391179.777107:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391179.777114:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391179.777172:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35578:x1875263094172416:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1168us (1432us total) trans 30064771266 rc 0/0 00000100:00100000:3.0:1788391179.777179:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00080000:0.0:1788391179.777375:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391179.779832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391179.780047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.780159:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172544 00000100:00100000:2.0:1788391179.780169:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172544 00000100:00100000:2.0:1788391179.780231:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1788391179.780252:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35578:x1875263094172544:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788391179.780356:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35578:x1875263094172544:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 117us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.780364:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:3.0:1788391179.781039:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172672 00000100:00100000:3.0:1788391179.781046:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172672 00000100:00100000:3.0:1788391179.781152:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1788391179.781161:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094172672:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391179.781172:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391179.781196:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0002c expref: 15 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.781213:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391179.781217:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391179.781318:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2359:x1875263094172672:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 157us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391179.781325:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1788391179.900456:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391179.900590:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094172928 00000100:00100000:1.0:1788391179.900600:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094172928 00000100:00100000:1.0:1788391179.900671:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:1.0:1788391179.900682:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:35593:x1875263094172928:12345-192.168.202.1@tcp:101:touch.0 00010000:00010000:1.0:1788391179.900702:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391179.900705:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391179.900732:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37457 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00017 expref: 14 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.900751:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391179.900756:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391179.900768:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd374c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00033 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.901134:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.901149:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.901156:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.901186:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.901199:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 5 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391179.901211:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103469184:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391179.901312:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391179.903312:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103469184:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391179.903338:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391179.904680:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391179.904735:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173056 00000100:00100000:1.0:1788391179.904745:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173056 00010000:00010000:1.0:1788391179.904811:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 6 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391179.904854:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788391179.904864:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094173056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391179.904877:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391179.904883:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 6 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.904907:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 6 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.904928:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3749d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00025 expref: 6 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.904944:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391179.904950:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.904979:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.904986:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.905012:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391179.905041:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.905063:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391179.905071:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094173056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 207us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391179.905081:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:0.0:1788391179.905094:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.905110:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.905120:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788391179.905888:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788391179.906242:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc6:0x0], index 0: 0 00010000:00010000:0.0:1788391179.907390:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd374dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907411:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd374dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907424:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd374dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907481:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907489:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907496:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907502:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391179.907516:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907810:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907836:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:0.0:1788391179.907840:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391179.907845:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.907852:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd374ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391179.907871:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881c85b3 reply state 00000000ef6788c2 transno 30064771267 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391179.907881:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391179.908062:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd374c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00033 expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.908218:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd374dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00033 expref: 15 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.908230:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704cd00) 00010000:00010000:0.0:1788391179.908232:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391179.908235:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b200, rc 0) 00000100:00100000:0.0:1788391179.908414:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35593:x1875263094172928:12345-192.168.202.1@tcp:101:touch.0 Request processed in 7731us (7965us total) trans 30064771267 rc 0/0 00000100:00100000:0.0:1788391179.908425:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:0.0:1788391179.911647:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.911869:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173312 00000100:00100000:2.0:1788391179.911882:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173312 00000100:00100000:2.0:1788391179.911982:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:2.0:1788391179.911996:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35593:x1875263094173312:12345-192.168.202.1@tcp:36:touch.0 00010000:00010000:2.0:1788391179.912074:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391179.912119:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd374dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00033 expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.912144:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704cd00) 00010000:00010000:2.0:1788391179.912166:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391179.912230:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.912245:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.912256:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391179.912508:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c817230 reply state 00000000b1ddfa8c transno 30064771268 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391179.912518:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391179.912837:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:35593:x1875263094173312:12345-192.168.202.1@tcp:36:touch.0 Request processed in 841us (1199us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1788391179.912846:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00010000:00010000:1.0:1788391179.914805:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914825:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914834:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914865:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391179.914871:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914879:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914901:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6a704c100) 00010000:00010000:1.0:1788391179.914905:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391179.914910:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.914917:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd374d5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915311:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915319:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915325:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915330:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391179.915334:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915340:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915362:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:1.0:1788391179.915365:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391179.915369:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391179.915376:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd374ea lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391179.915794:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391179.915857:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173440 00000100:00100000:3.0:1788391179.915868:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173440 00000100:00100000:3.0:1788391179.915921:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:3.0:1788391179.915929:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35593:x1875263094173440:12345-192.168.202.1@tcp:101:touch.0 00010000:00010000:3.0:1788391179.915955:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391179.916002:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0003a expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.916068:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.916261:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.916401:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391179.916405:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391179.916408:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391179.916488:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35593:x1875263094173440:12345-192.168.202.1@tcp:101:touch.0 Request processed in 558us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391179.916495:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:0.0:1788391179.920080:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.920351:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173568 00000100:00100000:2.0:1788391179.920380:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173568 00000100:00100000:2.0:1788391179.920486:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1788391179.920496:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2359:x1875263094173568:12345-192.168.202.1@tcp:2:touch.0 00000100:00100000:2.0:1788391179.920897:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094173568:12345-192.168.202.1@tcp:2:touch.0 Request processed in 401us (828us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1788391179.920903:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00080000:0.0:1788391179.921758:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391179.924646:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391179.924748:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173824 00000100:00100000:3.0:1788391179.924760:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173824 00000100:00100000:3.0:1788391179.924832:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391179.924844:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35593:x1875263094173824:12345-192.168.202.1@tcp:35:touch.0 00000100:00100000:2.0:1788391179.925903:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:35593:x1875263094173824:12345-192.168.202.1@tcp:35:touch.0 Request processed in 1050us (1274us total) trans 30064771269 rc 0/0 00000100:00100000:2.0:1788391179.925914:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788391179.969265:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.969398:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094173952 00000100:00100000:2.0:1788391179.969411:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094173952 00000100:00100000:2.0:1788391179.969534:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:2.0:1788391179.969545:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:35599:x1875263094173952:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391179.969576:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391179.969599:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd374f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00041 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969710:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969727:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969741:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391179.969786:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391179.969790:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391179.969836:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969864:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd374f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00041 expref: 19 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969880:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00041 expref: 18 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.969887:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2e00) 00010000:00010000:2.0:1788391179.969889:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391179.969892:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e600, rc 0) 00000100:00100000:2.0:1788391179.969955:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:35599:x1875263094173952:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 413us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.969996:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:0.0:1788391179.973140:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.973310:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174080 00000100:00100000:2.0:1788391179.973323:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174080 00000100:00100000:2.0:1788391179.973390:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:2.0:1788391179.973399:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:35599:x1875263094174080:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391179.973424:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391179.973447:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00048 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973517:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973530:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973559:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973571:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973575:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973579:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973697:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973705:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973712:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391179.973754:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1788391179.973758:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391179.973781:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973795:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973805:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973824:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973831:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973837:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391179.973842:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973850:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973865:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2e00) 00010000:00010000:2.0:1788391179.973868:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391179.973874:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973880:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3750d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973896:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973902:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973907:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973912:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391179.973921:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973928:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973936:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6830d2a00) 00010000:00010000:2.0:1788391179.973938:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391179.973942:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.973947:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37514 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.974013:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.974028:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.974035:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:2.0:1788391179.974038:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391179.974041:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391179.974419:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35599:x1875263094174080:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1017us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.974427:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:1.0:1788391179.977576:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391179.977834:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174208 00000100:00100000:3.0:1788391179.977846:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174208 00000100:00100000:3.0:1788391179.977921:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1788391179.977933:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094174208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391179.978121:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391179.978151:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0004f expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391179.978189:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6a98af0c, atime: 0x6a98af0c, ctime: 0x6a98af0c, blocks: 0x1 00010000:00010000:3.0:1788391179.978217:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=997s v=(0 0) 00010000:00010000:3.0:1788391179.978222:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391179.978233:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.978277:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.978294:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:3.0:1788391179.978374:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094174208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 443us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391179.978382:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788391179.981917:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391179.985918:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174464 00000100:00100000:0.0:1788391179.985936:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174464 00000100:00100000:0.0:1788391179.986036:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:0.0:1788391179.986046:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35599:x1875263094174464:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391179.986069:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391179.986112:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00056 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.986246:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.986264:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.986272:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.986316:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 20 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.986330:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 20 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391179.986345:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103469312:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391179.986466:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788391179.988642:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103469312:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391179.988690:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391179.989486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391179.989636:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174592 00000100:00100000:2.0:1788391179.989647:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174592 00010000:00010000:2.0:1788391179.989699:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 21 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391179.989878:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788391179.989890:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094174592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391179.989915:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391179.989923:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 21 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.989938:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 21 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.989986:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd3751b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00048 expref: 21 pid: 42644 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.990006:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:2.0:1788391179.990011:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.990022:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.990030:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391179.990052:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391179.990132:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.990140:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391179.990164:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1788391179.990343:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd37529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00056 expref: 22 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.990361:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00056 expref: 21 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391179.990369:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:0.0:1788391179.990372:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391179.990374:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:2.0:1788391179.990436:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094174592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 547us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391179.990443:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1788391179.990884:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:35599:x1875263094174464:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4837us (8980us total) trans 30064771270 rc 0/0 00000100:00100000:0.0:1788391179.990893:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:0.0:1788391179.993303:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391179.993418:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174848 00000100:00100000:3.0:1788391179.993430:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174848 00000100:00100000:3.0:1788391179.993537:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:3.0:1788391179.993550:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:35599:x1875263094174848:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391179.993585:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391179.993589:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391179.993646:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd37530 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00056 expref: 20 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.993670:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391179.993676:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391179.993693:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd3753e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0005d expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.993819:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.993831:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.993850:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391179.993861:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:3.0:1788391179.994014:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd3753e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0005d expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.994026:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0005d expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391179.994031:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391179.994034:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391179.994036:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1400, rc 0) 00000100:00100000:3.0:1788391179.994102:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:35599:x1875263094174848:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 555us (813us total) trans 30064771271 rc 0/0 00000100:00100000:3.0:1788391179.994109:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:2.0:1788391180.000848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.000946:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094174976 00000100:00100000:0.0:1788391180.000976:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094174976 00002000:00100000:0.0:1788391180.001053:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff95d691118e00 x1875263094174976/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.001077:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691118e00 with x1875263094174976 ext(0->4095) 00002000:00010000:0.0:1788391180.001094:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691118e00 00000100:00100000:0.0:1788391180.001132:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1788391180.001144:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094174976:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391180.001446:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094174976:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 302us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.001455:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00002000:00100000:0.0:1788391180.001461:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff95d691118e00 x1875263094174976/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/440 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.001470:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691118e00 with x1875263094174976 ext(0->4095) 00002000:00010000:0.0:1788391180.001473:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691118e00 00000100:00100000:1.0:1788391180.004203:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.004314:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094175104 00000100:00100000:0.0:1788391180.004327:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094175104 00000100:00100000:0.0:1788391180.004403:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:0.0:1788391180.004416:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094175104:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:0.0:1788391180.004476:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.004502:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.004512:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391180.004517:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391180.004522:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.004583:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.004595:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.004609:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103469440:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391180.004855:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391180.008182:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.008669:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094175232 00000100:00100000:2.0:1788391180.008683:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094175232 00010000:00010000:2.0:1788391180.008740:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 8 pid: 43327 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391180.008801:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788391180.008813:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094175232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391180.008832:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391180.008861:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 8 pid: 43327 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.008875:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 8 pid: 43327 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.008907:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391180.008911:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391180.008918:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.008928:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.008954:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391180.009215:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094175232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 403us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.009223:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00010000:00010000:0.0:1788391180.009747:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37522 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0004f expref: 7 pid: 43327 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.009779:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103469440:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391180.009819:0:43698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009831:0:43698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009844:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009875:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009910:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009918:0:43698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009926:0:43698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391180.009932:0:43698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.009941:0:43698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.010326:0:43698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.010338:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f6b73c0/0x9aafc5f04cd37553 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.010426:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2359:x1875263094175104:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 6011us (6236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.010436:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1788391180.014395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391180.014634:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094175488 00000100:00100000:1.0:1788391180.014649:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094175488 00000100:00100000:1.0:1788391180.014867:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788391180.014881:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:35599:x1875263094175488:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1788391180.015331:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x16:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0005d expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391180.015910:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771272 00000001:00080000:1.0:1788391180.015952:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771273 00000001:00080000:1.0:1788391180.018201:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771274 00010000:00010000:1.0:1788391180.018327:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.018357:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 25 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.018376:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.018420:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 25 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.018436:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 25 pid: 43348 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391180.018450:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103469568:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391180.018720:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391180.022099:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.022280:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103469568:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391180.022316:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391180.022392:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094175616 00000100:00100000:3.0:1788391180.022401:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094175616 00010000:00010000:3.0:1788391180.022459:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 26 pid: 43348 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391180.022502:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1788391180.022512:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2357:x1875263094175616:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391180.022535:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391180.022543:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 26 pid: 43348 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022594:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 26 pid: 43348 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022630:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd374f1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0003a expref: 26 pid: 43348 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022785:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.022792:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022803:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022811:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.022839:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391180.023012:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.023019:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391180.023173:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771275 00000001:00080000:2.0:1788391180.023426:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771276 00000100:00100000:2.0:1788391180.023572:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103469696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391180.023649:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391180.023689:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788391180.024822:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103469696 00000100:00100000:0.0:1788391180.024836:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103469696 00000100:00100000:0.0:1788391180.024928:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788391180.024956:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103469696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391180.025094:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103469696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 131us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.025100:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788391180.025139:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094175616:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2622us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.025150:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1788391180.025558:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103469696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788391180.026282:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771277 00000100:00100000:2.0:1788391180.026387:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103469824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391180.026450:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391180.026535:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391180.027049:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103469824 00000100:00100000:0.0:1788391180.027057:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103469824 00000100:00100000:0.0:1788391180.027223:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788391180.027236:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103469824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391180.027449:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103469824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 216us (999us total) trans 30064771094 rc 0/0 00000100:00100000:0.0:1788391180.027456:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788391180.027685:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103469824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788391180.027771:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771278 00010000:00010000:3.0:1788391180.027828:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027842:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027873:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027878:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391180.027884:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027892:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027912:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.027915:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788391180.027921:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.027928:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3755a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391180.028342:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788391180.028460:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].8, 64 off8752 00000004:00080000:3.0:1788391180.028474:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 997135512228ns, next at 998135509573ns, rc = 0 00000001:00080000:3.0:1788391180.028480:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771279 00010000:00010000:3.0:1788391180.028520:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.028523:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391180.028531:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37545 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0005d expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391180.030025:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:35599:x1875263094175488:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 15136us (15632us total) trans 30064771280 rc 0/0 00000100:00100000:3.0:1788391180.030063:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000020:00080000:3.0:1788391180.030071:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788391180.033207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.033270:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094175744 00000100:00100000:2.0:1788391180.033283:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094175744 00000100:00100000:2.0:1788391180.033362:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:2.0:1788391180.033373:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:35599:x1875263094175744:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391180.033404:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391180.033428:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37561 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00064 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.033509:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37561 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00064 expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.033521:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37561 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00064 expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.033548:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391180.033551:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391180.033555:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391180.033615:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:35599:x1875263094175744:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.033630:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:0.0:1788391180.036396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.036454:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094176000 00000100:00100000:2.0:1788391180.036466:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094176000 00000100:00100000:2.0:1788391180.036530:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1788391180.036539:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:35599:x1875263094176000:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391180.036938:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:35599:x1875263094176000:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 399us (555us total) trans 30064771281 rc 0/0 00000100:00100000:2.0:1788391180.036944:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1788391180.100761:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.100919:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094176128 00000100:00100000:2.0:1788391180.100933:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094176128 00000100:00100000:2.0:1788391180.101031:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:2.0:1788391180.101043:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:35609:x1875263094176128:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391180.101144:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101195:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101208:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101226:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101233:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101239:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101357:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101364:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101371:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391180.101423:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101436:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101443:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101460:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101466:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.101471:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101478:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101492:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2e00) 00010000:00010000:2.0:1788391180.101495:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.101500:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101507:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd37568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101521:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101528:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101533:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101537:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.101540:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101556:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101563:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6830d2900) 00010000:00010000:2.0:1788391180.101565:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.101568:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101573:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd3756f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101588:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101593:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101598:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101602:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.101604:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101609:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101614:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391180.101628:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.101630:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.101644:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37576 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391180.101752:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:35609:x1875263094176128:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 709us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.101759:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:1.0:1788391180.156330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.156385:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094176384 00000100:00100000:2.0:1788391180.156400:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094176384 00000100:00100000:2.0:1788391180.156543:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:2.0:1788391180.156555:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:35615:x1875263094176384:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391180.156582:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391180.156585:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788391180.156629:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd374ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00041 expref: 30 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156654:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2e00) 00010000:00010000:2.0:1788391180.156665:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391180.156682:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3757d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0006b expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156868:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156884:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156895:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156934:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156942:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.156950:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157087:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37592 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157097:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37592 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157104:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37592 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391180.157114:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1788391180.157238:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157246:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157253:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157258:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.157264:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157283:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157293:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391180.157296:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.157300:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157306:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157318:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157324:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157329:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157335:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.157337:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157343:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157351:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6830d2200) 00010000:00010000:2.0:1788391180.157354:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.157356:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157372:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd3758b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157436:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd3757d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0006b expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157452:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37592 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0006b expref: 31 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.157459:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391180.157461:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391180.157464:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788391180.157547:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094176384:12345-192.168.202.1@tcp:101:dd.0 Request processed in 993us (1229us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1788391180.157555:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:1.0:1788391180.161395:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.161507:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094176640 00000100:00100000:2.0:1788391180.161520:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094176640 00000100:00100000:2.0:1788391180.161599:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:2.0:1788391180.161610:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094176640:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:2.0:1788391180.161697:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391180.161731:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37592 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0006b expref: 31 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.161752:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391180.162100:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391180.162375:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.162411:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.162422:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391180.162482:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771283 00000004:00010000:2.0:1788391180.162506:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ffce6f9 reply state 000000009c23d804 transno 30064771284 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391180.162517:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391180.162647:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:35615:x1875263094176640:12345-192.168.202.1@tcp:36:dd.0 Request processed in 1037us (1265us total) trans 30064771284 rc 0/0 00000100:00100000:2.0:1788391180.162656:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00000020:00080000:2.0:1788391180.162662:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391180.172018:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172044:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172053:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172061:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391180.172068:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172077:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172138:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:2.0:1788391180.172141:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391180.172147:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.172155:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd375a0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.237217:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391180.237744:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391180.237785:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103469952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391180.237882:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391180.238228:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103469952 00000100:00100000:2.0:1788391180.238240:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103469952 00000100:00100000:2.0:1788391180.238340:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788391180.238353:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103469952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391180.238402:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391180.238466:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103469952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.238474:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788391180.238560:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103469952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391180.563054:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.563138:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094176896 00000100:00100000:3.0:1788391180.563221:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094176896 00000100:00100000:3.0:1788391180.563310:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1788391180.563324:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692292c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35615:x1875263094176896:12345-192.168.202.1@tcp:103:dd.0 00010000:00010000:3.0:1788391180.563343:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391180.563373:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37561 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00064 expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.563398:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6830d2a00) 00010000:00010000:3.0:1788391180.563411:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391180.563494:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692292c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094176896:12345-192.168.202.1@tcp:103:dd.0 Request processed in 174us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.563502:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1788391180.565367:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.565455:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177024 00000100:00100000:0.0:1788391180.565465:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177024 00000100:00100000:0.0:1788391180.565530:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:0.0:1788391180.565541:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094177024:12345-192.168.202.1@tcp:58:dd.0 00010000:00010000:0.0:1788391180.566122:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.566143:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.566157:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391180.567856:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].7, 136 off9144 00000100:00100000:0.0:1788391180.568203:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094177024:12345-192.168.202.1@tcp:58:dd.0 Request processed in 2656us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.568238:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:1.0:1788391180.573356:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.573464:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177152 00000100:00100000:0.0:1788391180.573477:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177152 00000100:00100000:0.0:1788391180.573577:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:0.0:1788391180.573589:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:35615:x1875263094177152:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391180.573625:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391180.573661:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00072 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573740:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573750:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573774:0:42644:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573789:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573806:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:0.0:1788391180.573810:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391180.573814:0:42644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.573823:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6bc79b400, rc 0) 00000100:00100000:0.0:1788391180.573916:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35615:x1875263094177152:12345-192.168.202.1@tcp:101:dd.0 Request processed in 328us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.573923:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 243 00000040:00080000:1.0:1788391180.749304:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391180.749318:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391180.749366:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:1.0:1788391180.749373:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391180.749537:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103470080:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788391180.749795:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391180.759688:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103470080:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788391180.760483:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.760841:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177280 00000100:00100000:3.0:1788391180.760852:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177280 00000100:00100000:3.0:1788391180.762228:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:3.0:1788391180.762253:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35616:x1875263094177280:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391180.762298:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391180.762441:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35616:x1875263094177280:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 198us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.762468:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:1.0:1788391180.771379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.772095:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177408 00000100:00100000:0.0:1788391180.772112:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177408 00000100:00100000:0.0:1788391180.772232:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:0.0:1788391180.772245:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35616:x1875263094177408:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.772345:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772366:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772381:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772402:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772408:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772414:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772443:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772452:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772458:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391180.772529:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:0.0:1788391180.772535:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391180.772550:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772563:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772571:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772578:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772583:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391180.772588:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772596:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772621:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391180.772624:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391180.772630:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772641:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79a400/0x9aafc5f04cd375b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772659:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772676:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772682:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772687:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391180.772690:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772696:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772705:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1989a751 (ffff95d6a704ca00) 00010000:00010000:0.0:1788391180.772707:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391180.772710:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772716:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b200/0x9aafc5f04cd375bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772732:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772739:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772745:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772750:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391180.772762:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772769:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772777:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:0.0:1788391180.772779:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391180.772782:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.772788:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd375c3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.772898:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35616:x1875263094177408:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 653us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.772908:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:1.0:1788391180.776326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.776435:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177664 00000100:00100000:0.0:1788391180.776448:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177664 00000100:00100000:0.0:1788391180.776517:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:0.0:1788391180.776526:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:35616:x1875263094177664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.776553:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391180.776581:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd375ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00079 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.776796:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.776814:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.776851:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391180.776867:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1788391180.778455:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778469:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778475:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778478:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64faa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391180.778483:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778489:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778505:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:0.0:1788391180.778507:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391180.778510:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778515:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd375d1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778581:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd375ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00079 expref: 34 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778626:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391180.778629:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391180.778982:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd375ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00079 expref: 34 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.778998:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788391180.779092:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:35616:x1875263094177664:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2564us (2780us total) trans 30064771285 rc 301/301 00000100:00100000:0.0:1788391180.779102:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:1.0:1788391180.782645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.782738:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177792 00000100:00100000:0.0:1788391180.782752:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177792 00000100:00100000:0.0:1788391180.782836:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:0.0:1788391180.782849:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:35616:x1875263094177792:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788391180.782923:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788391180.783074:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:35616:x1875263094177792:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 229us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.783084:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:1.0:1788391180.785438:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.785698:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094177920 00000100:00100000:3.0:1788391180.785722:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094177920 00000100:00100000:3.0:1788391180.785795:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:3.0:1788391180.785807:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:35616:x1875263094177920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391180.785831:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391180.785856:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd375df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00080 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.785933:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.785951:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.785995:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391180.786045:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391180.786048:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391180.786068:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.786098:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd375df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00080 expref: 35 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.786113:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00080 expref: 34 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.786142:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.786145:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391180.786147:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391180.786201:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:35616:x1875263094177920:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 398us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.786207:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:1.0:1788391180.789496:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.789788:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094178176 00000100:00100000:3.0:1788391180.789801:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094178176 00000100:00100000:3.0:1788391180.789880:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:3.0:1788391180.789892:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:35616:x1875263094178176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391180.789920:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391180.789924:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391180.789990:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd375e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00080 expref: 34 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790013:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.790026:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391180.790044:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd375ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00087 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391180.790580:0:42646:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc6:0x0], index 1: 0 00010000:00010000:3.0:1788391180.790807:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd375f4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790820:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd375f4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790850:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd375f4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790902:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd375ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00087 expref: 36 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790923:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd375f4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00087 expref: 35 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.790932:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391180.790935:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391180.790938:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391180.791053:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:35616:x1875263094178176:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1163us (1572us total) trans 30064771286 rc 0/0 00000100:00100000:3.0:1788391180.791060:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:1.0:1788391180.794184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.794389:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094178304 00000100:00100000:0.0:1788391180.794403:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094178304 00000100:00100000:0.0:1788391180.794683:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:0.0:1788391180.794696:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:35616:x1875263094178304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.794729:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391180.794757:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0008e expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.794869:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.794885:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.794897:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391180.794941:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391180.794944:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391180.795008:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.795037:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0008e expref: 37 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.795059:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0008e expref: 36 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.795067:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:0.0:1788391180.795070:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391180.795074:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64faa00, rc 0) 00000100:00100000:1.0:1788391180.795439:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:35616:x1875263094178304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 744us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391180.795448:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:1.0:1788391180.800940:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.801071:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094178560 00000100:00100000:3.0:1788391180.801085:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094178560 00000100:00100000:3.0:1788391180.801163:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:3.0:1788391180.801175:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:35616:x1875263094178560:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391180.801247:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788391180.801283:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd375f4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00087 expref: 36 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801306:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391180.801325:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37609 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0008e expref: 35 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801363:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704ca00) 00010000:00010000:3.0:1788391180.801371:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391180.801401:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801416:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801427:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801439:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801445:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801451:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801545:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801554:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801561:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801567:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391180.801572:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801587:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801596:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d686a70100) 00010000:00010000:3.0:1788391180.801598:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391180.801603:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801624:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1a00/0x9aafc5f04cd37610 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801637:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801643:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801649:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801654:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391180.801657:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801663:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801670:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x192ba886 (ffff95d686a70800) 00010000:00010000:3.0:1788391180.801672:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391180.801675:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.801690:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37617 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x192ba886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391180.802212:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:35616:x1875263094178560:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1035us (1282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788391180.802221:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1788391180.804227:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.804325:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094178688 00000100:00100000:3.0:1788391180.804338:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094178688 00000100:00100000:3.0:1788391180.804454:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1788391180.804467:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:35616:x1875263094178688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391180.804494:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391180.804531:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3761e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00095 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804576:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804591:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804603:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804756:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3761e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 36 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804778:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 35 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.804800:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:3.0:1788391180.804804:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391180.804808:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391180.804926:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:35616:x1875263094178688:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 460us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.804934:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:1.0:1788391180.808373:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.808637:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094178944 00000100:00100000:0.0:1788391180.808650:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094178944 00000100:00100000:0.0:1788391180.808727:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:0.0:1788391180.808740:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:35616:x1875263094178944:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.808856:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.808873:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.808884:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391180.809411:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].8, 88 off8824 00000004:00080000:0.0:1788391180.809427:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 997916464885ns, next at 998916461949ns, rc = 0 00000004:00010000:0.0:1788391180.809699:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094281ae6 reply state 00000000348b9a5e transno 30064771287 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.809710:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391180.809849:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:35616:x1875263094178944:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1109us (1485us total) trans 30064771287 rc 0/0 00000100:00100000:0.0:1788391180.809858:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:1.0:1788391180.813059:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.813272:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179072 00000100:00100000:0.0:1788391180.813285:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179072 00000100:00100000:0.0:1788391180.813356:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:0.0:1788391180.813366:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:35616:x1875263094179072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.813396:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391180.813419:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0009c expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.813491:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.813543:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.813569:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391180.813572:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391180.813577:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb800, rc 0) 00000100:00100000:0.0:1788391180.813653:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:35616:x1875263094179072:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 289us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391180.813661:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00010000:00010000:3.0:1788391180.814318:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814329:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814337:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814343:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391180.814349:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814357:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814373:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:3.0:1788391180.814376:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788391180.814380:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391180.814386:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd3762c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391180.817797:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.817903:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179200 00000100:00100000:3.0:1788391180.817926:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179200 00000100:00100000:3.0:1788391180.818042:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788391180.818055:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094179200:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391180.818509:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094179200:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 455us (725us total) trans 30064771099 rc 0/0 00000100:00100000:3.0:1788391180.818660:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00080000:0.0:1788391180.820033:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391180.821121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.821231:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179456 00000100:00100000:3.0:1788391180.821244:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179456 00000100:00100000:3.0:1788391180.821311:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788391180.821321:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:35616:x1875263094179456:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391180.821764:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:35616:x1875263094179456:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 444us (650us total) trans 30064771288 rc 0/0 00000100:00100000:3.0:1788391180.821771:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1788391180.825868:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.826799:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179712 00000100:00100000:0.0:1788391180.826814:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179712 00000100:00100000:1.0:1788391180.827046:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:1.0:1788391180.827060:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:35616:x1875263094179712:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391180.827233:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:35616:x1875263094179712:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 175us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391180.827242:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1788391180.830626:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391180.830801:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179840 00000100:00100000:1.0:1788391180.830815:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179840 00000100:00100000:1.0:1788391180.830896:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:1.0:1788391180.830908:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:35616:x1875263094179840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391180.830937:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391180.831000:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3763a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000a3 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831131:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831148:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831162:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391180.831208:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391180.831231:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831266:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd3763a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000a3 expref: 40 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831289:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000a3 expref: 39 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.831298:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391180.831301:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788391180.831306:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7000, rc 0) 00000100:00100000:1.0:1788391180.831379:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:35616:x1875263094179840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 473us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391180.831387:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:0.0:1788391180.835136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.835255:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094179968 00000100:00100000:2.0:1788391180.835269:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094179968 00000100:00100000:2.0:1788391180.835349:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391180.835361:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094179968:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391180.835385:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391180.835412:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000aa expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391180.835448:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af0d, blocks: 0x1 00010000:00010000:2.0:1788391180.835533:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=997s v=(0 0) 00010000:00010000:2.0:1788391180.835540:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391180.835551:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 9 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.835573:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 9 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.835591:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fe00, rc 0) 00000100:00100000:2.0:1788391180.835718:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094179968:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 358us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.835725:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391180.839446:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.839694:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180224 00000100:00100000:2.0:1788391180.839706:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180224 00000100:00100000:2.0:1788391180.839799:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:2.0:1788391180.839810:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:35616:x1875263094180224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.839940:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:35616:x1875263094180224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 131us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.839948:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:1.0:1788391180.847024:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.847137:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180352 00000100:00100000:0.0:1788391180.847152:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180352 00000100:00100000:0.0:1788391180.847234:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1788391180.847247:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:35616:x1875263094180352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391180.847272:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391180.847296:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000b1 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.847337:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 10 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.847348:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391180.847372:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391180.847379:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.847423:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 10 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391180.847438:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 10 pid: 43328 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391180.847455:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103470208:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391180.847598:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788391180.853019:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391180.853080:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180480 00000100:00100000:1.0:1788391180.853100:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180480 00010000:00010000:1.0:1788391180.853151:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 11 pid: 43328 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391180.853243:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788391180.853255:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094180480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391180.853276:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391180.853306:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 11 pid: 43328 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.853322:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 11 pid: 43328 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.853355:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391180.853360:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391180.853371:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.853383:0:45446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391180.853432:0:45446:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391180.853449:0:45446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45446:1875263103470336:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391180.853554:0:45446:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788391180.853737:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784c046b/0x9aafc5f04cd37648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000aa expref: 11 pid: 43328 timeout: 1097 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391180.853756:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103470208:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391180.853796:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391180.853822:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fae00, rc 0) 00000100:00100000:2.0:1788391180.853857:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:35616:x1875263094180352:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 6613us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391180.853866:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788391180.858253:0:45446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45446:1875263103470336:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391180.858296:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391180.858373:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094180480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 5118us (5422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.858387:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1788391180.871416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.871530:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180608 00000100:00100000:3.0:1788391180.871541:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180608 00002000:00100000:3.0:1788391180.871596:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff95d58b1c5500 x1875263094180608/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391180.871641:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5500 with x1875263094180608 ext(0->1048575) 00002000:00010000:3.0:1788391180.871648:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5500 00000100:00100000:3.0:1788391180.871741:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1788391180.871753:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094180608:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391180.893415:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.893459:0:43331:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788391180.893468:0:43331:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788391180.894005:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180736 00000100:00100000:0.0:1788391180.894015:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180736 00002000:00100000:0.0:1788391180.894062:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff95d58b1c7480 x1875263094180736/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.894073:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7480 with x1875263094180736 ext(1048576->2097151) 00002000:00010000:0.0:1788391180.894079:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7480 00000100:00100000:2.0:1788391180.896170:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1788391180.896186:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094180736:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.900510:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094180608:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 28750us (29095us total) trans 30064771100 rc 0/0 00000100:00100000:2.0:1788391180.900535:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00002000:00100000:2.0:1788391180.900547:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff95d58b1c5500 x1875263094180608/t30064771100(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.900567:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5500 with x1875263094180608 ext(0->1048575) 00002000:00010000:2.0:1788391180.900573:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5500 00000100:00100000:3.0:1788391180.908041:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094180736:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 11849us (14627us total) trans 30064771101 rc 0/0 00000100:00100000:3.0:1788391180.908054:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00002000:00100000:3.0:1788391180.908065:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff95d58b1c7480 x1875263094180736/t30064771101(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391180.908075:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7480 with x1875263094180736 ext(1048576->2097151) 00002000:00010000:3.0:1788391180.908082:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7480 00000100:00100000:0.0:1788391180.915120:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.915241:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180864 00000100:00100000:2.0:1788391180.915252:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180864 00002000:00100000:2.0:1788391180.915303:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff95d58b1c7b80 x1875263094180864/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.915314:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7b80 with x1875263094180864 ext(2097152->3145727) 00002000:00010000:2.0:1788391180.915321:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7b80 00000100:00100000:2.0:1788391180.915391:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:2.0:1788391180.915402:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094180864:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.917952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.918170:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.918208:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391180.918279:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181120 00000100:00100000:1.0:1788391180.918287:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181120 00000100:00100000:1.0:1788391180.918332:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788391180.918341:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094181120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391180.918397:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094181120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391180.918404:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1788391180.918465:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181248 00000100:00100000:1.0:1788391180.918468:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181248 00000100:00100000:1.0:1788391180.918490:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788391180.918496:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094181248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391180.918519:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094181248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391180.918525:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1788391180.918593:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094180992 00000100:00100000:3.0:1788391180.918597:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094180992 00000100:00100000:3.0:1788391180.918643:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1788391180.918656:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094180992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391180.918682:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094180992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391180.918687:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1788391180.928667:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094180864:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 13256us (13547us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1788391180.928682:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00002000:00100000:0.0:1788391180.928709:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff95d58b1c7b80 x1875263094180864/t30064771102(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.928720:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7b80 with x1875263094180864 ext(2097152->3145727) 00002000:00010000:0.0:1788391180.928726:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7b80 00000100:00100000:1.0:1788391180.936942:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.941577:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181376 00000100:00100000:2.0:1788391180.941594:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181376 00002000:00100000:2.0:1788391180.941676:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff95d58b15ce00 x1875263094181376/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.941688:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ce00 with x1875263094181376 ext(3145728->4194303) 00002000:00010000:2.0:1788391180.941694:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ce00 00000100:00100000:2.0:1788391180.941735:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1788391180.941747:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094181376:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.943068:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391180.944398:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181504 00000100:00100000:0.0:1788391180.944410:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181504 00002000:00100000:0.0:1788391180.944459:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff95d69111b800 x1875263094181504/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.944470:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111b800 with x1875263094181504 ext(4194304->5242879) 00002000:00010000:0.0:1788391180.944476:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111b800 00000100:00100000:0.0:1788391180.944553:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1788391180.944564:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094181504:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.958146:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094181376:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 16391us (21203us total) trans 30064771103 rc 0/0 00000100:00100000:2.0:1788391180.958160:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00002000:00100000:2.0:1788391180.958174:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff95d58b15ce00 x1875263094181376/t30064771103(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.958185:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ce00 with x1875263094181376 ext(3145728->4194303) 00002000:00010000:2.0:1788391180.958192:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ce00 00000100:00100000:3.0:1788391180.965745:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391180.965915:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181632 00000100:00100000:2.0:1788391180.965925:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181632 00002000:00100000:2.0:1788391180.966051:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff95d691830700 x1875263094181632/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.966062:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691830700 with x1875263094181632 ext(5242880->6291455) 00002000:00010000:2.0:1788391180.966068:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691830700 00000100:00100000:2.0:1788391180.966142:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:2.0:1788391180.966163:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094181632:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391180.966494:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094181504:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 21931us (23430us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1788391180.966503:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00002000:00100000:1.0:1788391180.966510:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff95d69111b800 x1875263094181504/t30064771104(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391180.966519:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111b800 with x1875263094181504 ext(4194304->5242879) 00002000:00010000:1.0:1788391180.966522:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111b800 00000100:00100000:0.0:1788391180.975660:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094181632:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9487us (9914us total) trans 30064771105 rc 0/0 00000100:00100000:0.0:1788391180.975674:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00002000:00100000:0.0:1788391180.975688:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff95d691830700 x1875263094181632/t30064771105(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391180.975698:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691830700 with x1875263094181632 ext(5242880->6291455) 00002000:00010000:0.0:1788391180.975705:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691830700 00000100:00100000:2.0:1788391180.978837:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391180.978885:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181760 00000100:00100000:3.0:1788391180.978897:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181760 00002000:00100000:3.0:1788391180.978946:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff95d691119c00 x1875263094181760/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391180.979016:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119c00 with x1875263094181760 ext(6291456->7340031) 00002000:00010000:3.0:1788391180.979021:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691119c00 00000100:00100000:3.0:1788391180.979043:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788391180.979052:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094181760:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391180.988173:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2356:x1875263094181760:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9113us (9343us total) trans 30064771106 rc 0/0 00000100:00100000:2.0:1788391180.988184:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00002000:00100000:2.0:1788391180.988195:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff95d691119c00 x1875263094181760/t30064771106(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391180.988203:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119c00 with x1875263094181760 ext(6291456->7340031) 00002000:00010000:2.0:1788391180.988216:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691119c00 00000100:00100000:3.0:1788391180.989449:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391180.989509:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094181888 00000100:00100000:1.0:1788391180.989518:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094181888 00002000:00100000:1.0:1788391180.989559:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff95d691831880 x1875263094181888/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/0 e 0 to 0 dl 1788391191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391180.989602:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831880 with x1875263094181888 ext(7340032->8388607) 00002000:00010000:1.0:1788391180.989620:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691831880 00000100:00100000:1.0:1788391180.989652:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1788391180.989662:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094181888:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391181.001001:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.001832:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182016 00000100:00100000:2.0:1788391181.001847:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182016 00002000:00100000:2.0:1788391181.001916:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff95d58b1c5f80 x1875263094182016/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.001929:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5f80 with x1875263094182016 ext(8388608->9437183) 00002000:00010000:2.0:1788391181.001936:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5f80 00000100:00100000:2.0:1788391181.002021:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1788391181.002032:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2358:x1875263094182016:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.003215:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094181888:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 13536us (13752us total) trans 30064771107 rc 0/0 00000100:00100000:1.0:1788391181.003229:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00002000:00100000:1.0:1788391181.003247:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff95d691831880 x1875263094181888/t30064771107(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:41/0 lens 488/448 e 0 to 0 dl 1788391191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.003258:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691831880 with x1875263094181888 ext(7340032->8388607) 00002000:00010000:1.0:1788391181.003264:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691831880 00000100:00100000:3.0:1788391181.014704:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2358:x1875263094182016:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 12656us (13742us total) trans 30064771108 rc 0/0 00000100:00100000:3.0:1788391181.014722:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00002000:00100000:3.0:1788391181.014738:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff95d58b1c5f80 x1875263094182016/t30064771108(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.014751:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5f80 with x1875263094182016 ext(8388608->9437183) 00002000:00010000:3.0:1788391181.014759:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5f80 00000100:00100000:0.0:1788391181.015299:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.016007:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182144 00000100:00100000:2.0:1788391181.016020:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182144 00002000:00100000:2.0:1788391181.016077:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff95d58b1c6300 x1875263094182144/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.016087:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6300 with x1875263094182144 ext(9437184->10485759) 00002000:00010000:2.0:1788391181.016092:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6300 00000100:00100000:2.0:1788391181.016118:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1788391181.016149:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094182144:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.023750:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2359:x1875263094182144:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7593us (8444us total) trans 30064771109 rc 0/0 00000100:00100000:3.0:1788391181.023763:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00002000:00100000:3.0:1788391181.023775:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff95d58b1c6300 x1875263094182144/t30064771109(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.023786:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6300 with x1875263094182144 ext(9437184->10485759) 00002000:00010000:3.0:1788391181.023792:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6300 00000100:00100000:2.0:1788391181.029401:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.029478:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182272 00000100:00100000:1.0:1788391181.029491:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182272 00002000:00100000:1.0:1788391181.029535:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff95d691118700 x1875263094182272/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.029543:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691118700 with x1875263094182272 ext(10485760->11534335) 00002000:00010000:1.0:1788391181.029547:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691118700 00000100:00100000:1.0:1788391181.029587:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1788391181.029597:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2358:x1875263094182272:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.041081:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2358:x1875263094182272:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 11478us (11687us total) trans 30064771110 rc 0/0 00000100:00100000:2.0:1788391181.041092:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00002000:00100000:2.0:1788391181.041102:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff95d691118700 x1875263094182272/t30064771110(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.041110:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691118700 with x1875263094182272 ext(10485760->11534335) 00002000:00010000:2.0:1788391181.041116:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691118700 00000100:00100000:3.0:1788391181.041537:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.041708:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182400 00000100:00100000:2.0:1788391181.041716:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182400 00002000:00100000:2.0:1788391181.041752:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff95d58b146300 x1875263094182400/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.041761:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b146300 with x1875263094182400 ext(11534336->12582911) 00002000:00010000:2.0:1788391181.041765:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b146300 00000100:00100000:2.0:1788391181.041789:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1788391181.041795:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094182400:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.056372:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094182400:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 14567us (14826us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1788391181.056383:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00002000:00100000:2.0:1788391181.056395:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff95d58b146300 x1875263094182400/t30064771111(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.056403:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b146300 with x1875263094182400 ext(11534336->12582911) 00002000:00010000:2.0:1788391181.056421:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b146300 00000100:00100000:2.0:1788391181.056596:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.056894:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182528 00000100:00100000:3.0:1788391181.056902:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182528 00002000:00100000:3.0:1788391181.056937:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff95d69111b480 x1875263094182528/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.056943:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111b480 with x1875263094182528 ext(12582912->13631487) 00002000:00010000:3.0:1788391181.056946:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111b480 00000100:00100000:3.0:1788391181.056986:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1788391181.056996:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2356:x1875263094182528:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.063814:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094182528:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6812us (7210us total) trans 30064771112 rc 0/0 00000100:00100000:3.0:1788391181.063825:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00002000:00100000:3.0:1788391181.063839:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff95d69111b480 x1875263094182528/t30064771112(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.063846:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111b480 with x1875263094182528 ext(12582912->13631487) 00002000:00010000:3.0:1788391181.063852:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111b480 00000100:00100000:0.0:1788391181.071748:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.071853:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182656 00000100:00100000:3.0:1788391181.071862:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182656 00002000:00100000:3.0:1788391181.071904:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff95d58b1c5880 x1875263094182656/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.071912:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5880 with x1875263094182656 ext(13631488->14680063) 00002000:00010000:3.0:1788391181.071917:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5880 00000100:00100000:3.0:1788391181.071943:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788391181.071950:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094182656:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.078412:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2356:x1875263094182656:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6454us (6663us total) trans 30064771113 rc 0/0 00000100:00100000:3.0:1788391181.078434:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00002000:00100000:3.0:1788391181.078444:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff95d58b1c5880 x1875263094182656/t30064771113(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.078451:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5880 with x1875263094182656 ext(13631488->14680063) 00002000:00010000:3.0:1788391181.078456:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5880 00000100:00100000:1.0:1788391181.082105:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.082177:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182784 00000100:00100000:2.0:1788391181.082186:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182784 00002000:00100000:2.0:1788391181.082227:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff95d58b15c380 x1875263094182784/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.082234:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15c380 with x1875263094182784 ext(14680064->15728639) 00002000:00010000:2.0:1788391181.082239:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15c380 00000100:00100000:2.0:1788391181.082264:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788391181.082270:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2359:x1875263094182784:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.089675:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094182784:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7392us (7566us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1788391181.089685:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00002000:00100000:2.0:1788391181.089694:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff95d58b15c380 x1875263094182784/t30064771114(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.089702:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15c380 with x1875263094182784 ext(14680064->15728639) 00002000:00010000:2.0:1788391181.089707:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15c380 00000100:00100000:1.0:1788391181.100111:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.100908:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094182912 00000100:00100000:2.0:1788391181.100926:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094182912 00002000:00100000:2.0:1788391181.101037:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff95d58b15ea00 x1875263094182912/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.101047:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ea00 with x1875263094182912 ext(15728640->16777215) 00002000:00010000:2.0:1788391181.101053:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ea00 00000100:00100000:2.0:1788391181.101084:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391181.101117:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094182912:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.116253:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.116400:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183040 00000100:00100000:3.0:1788391181.116411:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183040 00002000:00100000:3.0:1788391181.116454:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff95d58b15c000 x1875263094183040/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.116463:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15c000 with x1875263094183040 ext(16777216->17825791) 00002000:00010000:3.0:1788391181.116467:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15c000 00000100:00100000:3.0:1788391181.116497:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1788391181.116508:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094183040:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.123625:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2358:x1875263094182912:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 22484us (23491us total) trans 30064771115 rc 0/0 00000100:00100000:3.0:1788391181.123640:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00002000:00100000:3.0:1788391181.123654:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff95d58b15ea00 x1875263094182912/t30064771115(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.123664:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ea00 with x1875263094182912 ext(15728640->16777215) 00002000:00010000:3.0:1788391181.123670:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ea00 00000100:00100000:1.0:1788391181.127163:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.128071:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183168 00000100:00100000:3.0:1788391181.128091:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183168 00002000:00100000:3.0:1788391181.128220:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff95d58b15ca80 x1875263094183168/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.128234:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ca80 with x1875263094183168 ext(17825792->18874367) 00002000:00010000:3.0:1788391181.128239:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ca80 00000100:00100000:3.0:1788391181.128268:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1788391181.128275:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2357:x1875263094183168:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.130249:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2356:x1875263094183040:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 13731us (13991us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1788391181.130261:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00002000:00100000:2.0:1788391181.130287:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff95d58b15c000 x1875263094183040/t30064771116(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.130297:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15c000 with x1875263094183040 ext(16777216->17825791) 00002000:00010000:2.0:1788391181.130302:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15c000 00000100:00100000:3.0:1788391181.136359:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2357:x1875263094183168:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8068us (9188us total) trans 30064771117 rc 0/0 00000100:00100000:3.0:1788391181.136375:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00002000:00100000:3.0:1788391181.136388:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff95d58b15ca80 x1875263094183168/t30064771117(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.136400:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15ca80 with x1875263094183168 ext(17825792->18874367) 00002000:00010000:3.0:1788391181.136406:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15ca80 00000100:00100000:2.0:1788391181.145849:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.146266:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183296 00000100:00100000:3.0:1788391181.146280:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183296 00002000:00100000:2.0:1788391181.146454:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff95d691119500 x1875263094183296/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.146598:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119500 with x1875263094183296 ext(18874368->19922943) 00002000:00010000:2.0:1788391181.146615:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691119500 00000100:00100000:2.0:1788391181.146659:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391181.146672:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2357:x1875263094183296:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.156803:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094183296:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10117us (10954us total) trans 30064771118 rc 0/0 00000100:00100000:3.0:1788391181.156821:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00002000:00100000:3.0:1788391181.156838:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff95d691119500 x1875263094183296/t30064771118(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.156850:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119500 with x1875263094183296 ext(18874368->19922943) 00002000:00010000:3.0:1788391181.156858:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d691119500 00000100:00100000:0.0:1788391181.167486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.167644:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183424 00000100:00100000:2.0:1788391181.167658:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183424 00002000:00100000:2.0:1788391181.167729:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff95d58b1c5c00 x1875263094183424/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.167743:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5c00 with x1875263094183424 ext(19922944->20971519) 00002000:00010000:2.0:1788391181.167751:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5c00 00000100:00100000:2.0:1788391181.167790:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788391181.167801:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2359:x1875263094183424:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.175865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.177078:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:2359:x1875263094183424:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9266us (9607us total) trans 30064771119 rc 0/0 00000100:00100000:0.0:1788391181.177110:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00002000:00100000:0.0:1788391181.177127:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff95d58b1c5c00 x1875263094183424/t30064771119(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.177138:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5c00 with x1875263094183424 ext(19922944->20971519) 00002000:00010000:0.0:1788391181.177147:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5c00 00000100:00100000:0.0:1788391181.177566:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183552 00000100:00100000:0.0:1788391181.177577:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183552 00002000:00100000:0.0:1788391181.177644:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff95d58b15d500 x1875263094183552/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.177654:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15d500 with x1875263094183552 ext(20971520->22020095) 00002000:00010000:0.0:1788391181.177659:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15d500 00000100:00100000:2.0:1788391181.177954:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788391181.177976:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:2356:x1875263094183552:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.185648:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:2356:x1875263094183552:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7658us (9780us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1788391181.185668:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00002000:00100000:1.0:1788391181.185685:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff95d58b15d500 x1875263094183552/t30064771120(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.185697:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15d500 with x1875263094183552 ext(20971520->22020095) 00002000:00010000:1.0:1788391181.185705:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15d500 00000100:00100000:2.0:1788391181.195867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.196015:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183680 00000100:00100000:3.0:1788391181.196028:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183680 00002000:00100000:3.0:1788391181.196098:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff95d58af8d880 x1875263094183680/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.196119:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8d880 with x1875263094183680 ext(22020096->23068671) 00002000:00010000:3.0:1788391181.196127:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58af8d880 00000100:00100000:3.0:1788391181.196159:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788391181.196170:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:2356:x1875263094183680:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.209995:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094183680:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 13787us (14102us total) trans 30064771121 rc 0/0 00000100:00100000:3.0:1788391181.210018:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00002000:00100000:3.0:1788391181.210038:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff95d58af8d880 x1875263094183680/t30064771121(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.210050:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8d880 with x1875263094183680 ext(22020096->23068671) 00002000:00010000:3.0:1788391181.210059:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58af8d880 00000100:00100000:0.0:1788391181.210570:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.210830:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183808 00000100:00100000:3.0:1788391181.210843:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183808 00002000:00100000:3.0:1788391181.210896:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff95d58b1c5180 x1875263094183808/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.210906:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5180 with x1875263094183808 ext(23068672->24117247) 00002000:00010000:3.0:1788391181.210911:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5180 00000100:00100000:3.0:1788391181.211026:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788391181.211038:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2357:x1875263094183808:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391181.229399:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.230381:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094183936 00000100:00100000:1.0:1788391181.230392:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094183936 00002000:00100000:1.0:1788391181.230443:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff95d58b1c6d80 x1875263094183936/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.230455:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6d80 with x1875263094183936 ext(24117248->25165823) 00002000:00010000:1.0:1788391181.230460:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6d80 00000100:00100000:1.0:1788391181.230497:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1788391181.230509:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2357:x1875263094183936:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.240460:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2357:x1875263094183808:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 29413us (29941us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788391181.240475:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00002000:00100000:2.0:1788391181.240488:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff95d58b1c5180 x1875263094183808/t30064771123(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.240500:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c5180 with x1875263094183808 ext(23068672->24117247) 00002000:00010000:2.0:1788391181.240506:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c5180 00000100:00100000:3.0:1788391181.241527:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2357:x1875263094183936:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 11006us (12166us total) trans 30064771122 rc 0/0 00000100:00100000:3.0:1788391181.241538:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00002000:00100000:3.0:1788391181.241563:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff95d58b1c6d80 x1875263094183936/t30064771122(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.241573:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6d80 with x1875263094183936 ext(24117248->25165823) 00002000:00010000:3.0:1788391181.241578:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6d80 00000100:00100000:1.0:1788391181.254998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.255695:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184064 00000100:00100000:2.0:1788391181.255705:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184064 00002000:00100000:2.0:1788391181.255807:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff95d58b15f480 x1875263094184064/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.255819:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15f480 with x1875263094184064 ext(25165824->26214399) 00002000:00010000:2.0:1788391181.255826:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15f480 00000100:00100000:2.0:1788391181.255863:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788391181.255874:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2358:x1875263094184064:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00010000:00010000:2.0:1788391181.263968:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391181.268110:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:2358:x1875263094184064:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 12229us (13151us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1788391181.268125:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00002000:00100000:2.0:1788391181.268138:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff95d58b15f480 x1875263094184064/t30064771124(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.268157:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15f480 with x1875263094184064 ext(25165824->26214399) 00002000:00010000:2.0:1788391181.268164:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15f480 00000100:00100000:2.0:1788391181.272348:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.272591:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184192 00000100:00100000:3.0:1788391181.272602:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184192 00002000:00100000:3.0:1788391181.272659:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff95d5872e9f80 x1875263094184192/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.272671:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e9f80 with x1875263094184192 ext(26214400->27262975) 00002000:00010000:3.0:1788391181.272676:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e9f80 00000100:00100000:3.0:1788391181.272714:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1788391181.272725:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:2356:x1875263094184192:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.285211:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:2356:x1875263094184192:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 12479us (12862us total) trans 30064771125 rc 0/0 00000100:00100000:3.0:1788391181.285227:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00002000:00100000:3.0:1788391181.285240:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff95d5872e9f80 x1875263094184192/t30064771125(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.285251:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e9f80 with x1875263094184192 ext(26214400->27262975) 00002000:00010000:3.0:1788391181.285258:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e9f80 00000100:00100000:2.0:1788391181.289863:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.289949:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184320 00000100:00100000:3.0:1788391181.290031:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184320 00002000:00100000:2.0:1788391181.290144:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff95d58afd6300 x1875263094184320/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.290157:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd6300 with x1875263094184320 ext(27262976->28311551) 00002000:00010000:2.0:1788391181.290163:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd6300 00000100:00100000:2.0:1788391181.290225:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788391181.290236:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:2356:x1875263094184320:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.299804:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:2356:x1875263094184320:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9559us (9937us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1788391181.299819:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00002000:00100000:3.0:1788391181.299846:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff95d58afd6300 x1875263094184320/t30064771126(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.299858:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd6300 with x1875263094184320 ext(27262976->28311551) 00002000:00010000:3.0:1788391181.299865:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd6300 00000001:00080000:3.0:1788391181.300875:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771094 is committed 00000001:00080000:3.0:1788391181.300889:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771093 is committed 00000100:00100000:1.0:1788391181.317507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.317588:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184448 00000100:00100000:3.0:1788391181.317600:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184448 00002000:00100000:3.0:1788391181.317664:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff95d58b15fb80 x1875263094184448/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.317679:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15fb80 with x1875263094184448 ext(28311552->29360127) 00002000:00010000:3.0:1788391181.317685:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15fb80 00000100:00100000:2.0:1788391181.318104:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788391181.318116:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:2359:x1875263094184448:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.327830:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:2359:x1875263094184448:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9702us (10316us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788391181.327845:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00002000:00100000:2.0:1788391181.327859:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff95d58b15fb80 x1875263094184448/t30064771127(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.327870:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15fb80 with x1875263094184448 ext(28311552->29360127) 00002000:00010000:2.0:1788391181.327877:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15fb80 00000100:00100000:1.0:1788391181.336192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.336561:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184576 00000100:00100000:3.0:1788391181.336572:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184576 00002000:00100000:3.0:1788391181.336631:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff95d58b15df80 x1875263094184576/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.336644:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15df80 with x1875263094184576 ext(29360128->30408703) 00002000:00010000:3.0:1788391181.336650:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15df80 00000100:00100000:3.0:1788391181.336688:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391181.336699:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:2359:x1875263094184576:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.357223:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:2359:x1875263094184576:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 20514us (21030us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1788391181.357253:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00002000:00100000:2.0:1788391181.357273:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff95d58b15df80 x1875263094184576/t30064771128(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.357285:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15df80 with x1875263094184576 ext(29360128->30408703) 00002000:00010000:2.0:1788391181.357292:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15df80 00000100:00100000:0.0:1788391181.361779:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.362038:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184704 00000100:00100000:2.0:1788391181.362048:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184704 00002000:00100000:2.0:1788391181.362094:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff95d58b1c4700 x1875263094184704/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.362105:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4700 with x1875263094184704 ext(30408704->31457279) 00002000:00010000:2.0:1788391181.362111:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4700 00000100:00100000:2.0:1788391181.362146:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391181.362155:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:2357:x1875263094184704:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.372757:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:2357:x1875263094184704:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10591us (10976us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1788391181.372771:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00002000:00100000:2.0:1788391181.372783:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff95d58b1c4700 x1875263094184704/t30064771129(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.372796:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4700 with x1875263094184704 ext(30408704->31457279) 00002000:00010000:2.0:1788391181.372802:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4700 00000100:00100000:1.0:1788391181.377567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.377654:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184832 00000100:00100000:2.0:1788391181.377664:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184832 00002000:00100000:2.0:1788391181.377713:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff95d58b15e300 x1875263094184832/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.377734:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15e300 with x1875263094184832 ext(31457280->32505855) 00002000:00010000:2.0:1788391181.377738:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15e300 00000100:00100000:2.0:1788391181.377773:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391181.377780:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:2356:x1875263094184832:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.386178:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:2356:x1875263094184832:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8385us (8607us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788391181.386193:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00002000:00100000:2.0:1788391181.386205:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff95d58b15e300 x1875263094184832/t30064771130(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.386215:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15e300 with x1875263094184832 ext(31457280->32505855) 00002000:00010000:2.0:1788391181.386221:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15e300 00000100:00100000:0.0:1788391181.401814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.401867:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094184960 00000100:00100000:3.0:1788391181.401876:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094184960 00002000:00100000:3.0:1788391181.401927:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff95d58b1c7100 x1875263094184960/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.401939:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7100 with x1875263094184960 ext(32505856->33554431) 00002000:00010000:3.0:1788391181.401998:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7100 00000100:00100000:3.0:1788391181.402033:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788391181.402045:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:2357:x1875263094184960:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.412381:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:2357:x1875263094184960:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10328us (10565us total) trans 30064771131 rc 0/0 00000100:00100000:3.0:1788391181.412396:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00002000:00100000:3.0:1788391181.412408:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff95d58b1c7100 x1875263094184960/t30064771131(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.412420:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7100 with x1875263094184960 ext(32505856->33554431) 00002000:00010000:3.0:1788391181.412425:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7100 00000100:00100000:0.0:1788391181.422009:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.422108:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185088 00000100:00100000:2.0:1788391181.422119:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185088 00002000:00100000:2.0:1788391181.422166:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff95d58b1c7800 x1875263094185088/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.422177:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7800 with x1875263094185088 ext(33554432->34603007) 00002000:00010000:2.0:1788391181.422183:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7800 00000100:00100000:2.0:1788391181.422215:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1788391181.422225:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:2359:x1875263094185088:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.435192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.435579:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185216 00000100:00100000:0.0:1788391181.435589:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185216 00002000:00100000:0.0:1788391181.435648:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff95d58b15d880 x1875263094185216/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.435659:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15d880 with x1875263094185216 ext(34603008->35651583) 00002000:00010000:0.0:1788391181.435665:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15d880 00000100:00100000:0.0:1788391181.435707:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1788391181.435718:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:2358:x1875263094185216:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.457657:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:2359:x1875263094185088:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 35423us (35647us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1788391181.457671:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00002000:00100000:2.0:1788391181.457694:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff95d58b1c7800 x1875263094185088/t30064771132(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.457704:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c7800 with x1875263094185088 ext(33554432->34603007) 00002000:00010000:2.0:1788391181.457711:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c7800 00000100:00100000:0.0:1788391181.465950:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.466060:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185344 00000100:00100000:3.0:1788391181.466070:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185344 00002000:00100000:3.0:1788391181.466115:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff95d58b1c6680 x1875263094185344/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.466126:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6680 with x1875263094185344 ext(35651584->36700159) 00002000:00010000:3.0:1788391181.466132:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6680 00000100:00100000:3.0:1788391181.466168:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391181.466179:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:2356:x1875263094185344:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.466919:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:2358:x1875263094185216:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 31200us (31737us total) trans 30064771133 rc 0/0 00000100:00100000:3.0:1788391181.466928:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00002000:00100000:3.0:1788391181.466936:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff95d58b15d880 x1875263094185216/t30064771133(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.466992:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15d880 with x1875263094185216 ext(34603008->35651583) 00002000:00010000:3.0:1788391181.466997:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15d880 00000100:00100000:1.0:1788391181.475386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.475472:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185472 00000100:00100000:0.0:1788391181.475483:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185472 00002000:00100000:0.0:1788391181.475541:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff95d58b15dc00 x1875263094185472/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.475552:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15dc00 with x1875263094185472 ext(36700160->37748735) 00002000:00010000:0.0:1788391181.475558:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15dc00 00000100:00100000:0.0:1788391181.475584:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788391181.475594:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:2357:x1875263094185472:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.479770:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:2356:x1875263094185344:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 13582us (13821us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1788391181.479783:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00002000:00100000:3.0:1788391181.479795:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff95d58b1c6680 x1875263094185344/t30064771134(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.479807:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6680 with x1875263094185344 ext(35651584->36700159) 00002000:00010000:3.0:1788391181.479812:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6680 00000100:00100000:2.0:1788391181.484817:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:2357:x1875263094185472:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9213us (9429us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1788391181.484836:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00002000:00100000:2.0:1788391181.484852:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff95d58b15dc00 x1875263094185472/t30064771135(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.484862:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15dc00 with x1875263094185472 ext(36700160->37748735) 00002000:00010000:2.0:1788391181.484868:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b15dc00 00000100:00100000:0.0:1788391181.501369:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.501419:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185600 00000100:00100000:3.0:1788391181.501430:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185600 00002000:00100000:3.0:1788391181.501473:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff95d58b1c4e00 x1875263094185600/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.501482:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4e00 with x1875263094185600 ext(37748736->38797311) 00002000:00010000:3.0:1788391181.501487:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4e00 00000100:00100000:3.0:1788391181.501686:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:3.0:1788391181.501701:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:2356:x1875263094185600:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391181.510578:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:2356:x1875263094185600:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8870us (9207us total) trans 30064771136 rc 0/0 00000100:00100000:2.0:1788391181.510601:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00002000:00100000:2.0:1788391181.510622:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff95d58b1c4e00 x1875263094185600/t30064771136(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.510632:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4e00 with x1875263094185600 ext(37748736->38797311) 00002000:00010000:2.0:1788391181.510638:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4e00 00000100:00100000:0.0:1788391181.514888:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.514939:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185728 00000100:00100000:3.0:1788391181.514950:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185728 00002000:00100000:3.0:1788391181.515030:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff95d58b1c4380 x1875263094185728/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.515039:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4380 with x1875263094185728 ext(38797312->39845887) 00002000:00010000:3.0:1788391181.515044:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4380 00000100:00100000:3.0:1788391181.515094:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:3.0:1788391181.515104:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:2356:x1875263094185728:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.520200:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:2356:x1875263094185728:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 5086us (5311us total) trans 30064771137 rc 0/0 00000100:00100000:3.0:1788391181.520215:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00002000:00100000:3.0:1788391181.520229:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff95d58b1c4380 x1875263094185728/t30064771137(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.520242:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4380 with x1875263094185728 ext(38797312->39845887) 00002000:00010000:3.0:1788391181.520249:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4380 00000100:00100000:2.0:1788391181.526894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.527072:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185856 00000100:00100000:0.0:1788391181.527081:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185856 00002000:00100000:0.0:1788391181.527133:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff95d58afd4380 x1875263094185856/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.527144:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd4380 with x1875263094185856 ext(39845888->40894463) 00002000:00010000:0.0:1788391181.527149:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd4380 00000100:00100000:0.0:1788391181.527182:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1788391181.527192:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:2358:x1875263094185856:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391181.542575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.542782:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094185984 00000100:00100000:2.0:1788391181.542794:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094185984 00002000:00100000:2.0:1788391181.542843:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff95d58b1c6a00 x1875263094185984/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391181.542855:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6a00 with x1875263094185984 ext(40894464->41943039) 00002000:00010000:2.0:1788391181.542874:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6a00 00000100:00100000:2.0:1788391181.542909:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788391181.542919:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+87:2358:x1875263094185984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391181.557407:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+89:2358:x1875263094185984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 14471us (14825us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1788391181.557426:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00002000:00100000:3.0:1788391181.557443:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff95d58b1c6a00 x1875263094185984/t30064771138(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.557456:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c6a00 with x1875263094185984 ext(40894464->41943039) 00002000:00010000:3.0:1788391181.557465:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c6a00 00000100:00100000:1.0:1788391181.557645:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+89:2358:x1875263094185856:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 30452us (30759us total) trans 30064771139 rc 0/0 00000100:00100000:1.0:1788391181.557675:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00002000:00100000:1.0:1788391181.557683:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff95d58afd4380 x1875263094185856/t30064771139(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.557691:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd4380 with x1875263094185856 ext(39845888->40894463) 00002000:00010000:1.0:1788391181.557695:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd4380 00000100:00100000:0.0:1788391181.566512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.567707:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094186112 00000100:00100000:3.0:1788391181.567726:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094186112 00002000:00100000:3.0:1788391181.567797:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff95d58b1c4000 x1875263094186112/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.567810:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4000 with x1875263094186112 ext(41943040->42811391) 00002000:00010000:3.0:1788391181.567817:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4000 00000100:00100000:3.0:1788391181.567865:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391181.567875:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+89:2357:x1875263094186112:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.582987:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+91:2357:x1875263094186112:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 15073us (16450us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1788391181.583006:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00002000:00100000:1.0:1788391181.583023:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff95d58b1c4000 x1875263094186112/t30064771140(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.583034:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b1c4000 with x1875263094186112 ext(41943040->42811391) 00002000:00010000:1.0:1788391181.583042:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b1c4000 00000100:00100000:3.0:1788391181.586385:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391181.587752:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094186240 00000100:00100000:2.0:1788391181.587770:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094186240 00000100:00100000:2.0:1788391181.587886:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:2.0:1788391181.587902:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:35616:x1875263094186240:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788391181.588089:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788391181.626342:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771287 is committed 00000004:00080000:0.0:1788391181.626355:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788391181.626425:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803904 batchid updated 00000020:00080000:0.0:1788391181.626469:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a9d180 refcount 2 committed 0 result 0 batchid 25769803905 00000020:00080000:0.0:1788391181.626475:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d682eb5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a9d9c0 00000020:00080000:0.0:1788391181.626478:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d682eb5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58ac2b400 00000020:00080000:3.0:1788391181.626493:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803905 committed batchid 25769803904 00000001:00080000:0.0:1788391181.626494:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771288 is committed 00000004:00080000:0.0:1788391181.626504:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:1.0:1788391181.626616:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788391181.626652:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103470592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788391181.626706:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788391181.626721:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:0.0:1788391181.626746:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103470464 00000100:00100000:0.0:1788391181.626754:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103470464 00000100:00080000:3.0:1788391181.626811:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391181.626828:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788391181.626839:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103470464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788391181.627114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391181.627163:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35616:x1875263094186240:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 39263us (40787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391181.627174:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103470592 00000100:00100000:2.0:1788391181.627174:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:3.0:1788391181.627181:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103470592 00002000:00010000:0.0:1788391181.627307:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 0 -> 42811392 00002000:00010000:0.0:1788391181.627311:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 0 -> 1788391181 00002000:00010000:0.0:1788391181.627314:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391181.627316:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1788391181 -> 1788391181 00002000:00010000:0.0:1788391181.627319:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391181.627361:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103470464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 523us (656us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1788391181.627370:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788391181.627386:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788391181.627397:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103470592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788391181.627413:0:43327:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:198 count 1 00002000:00010000:1.0:1788391181.627437:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6a98af0c, atime: 0x6a98af0c, ctime: 0x6a98af0c, blocks: 0x1 00010000:00010000:1.0:1788391181.627445:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.627459:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=998s v=(0 0) 00010000:00010000:1.0:1788391181.627470:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391181.627477:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.627492:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.627502:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.627510:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.627526:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391181.627981:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103470592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 585us (866us total) trans 30064771095 rc 0/0 00000100:00080000:2.0:1788391181.631085:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391181.632424:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391181.632436:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.632450:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391181.632455:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.632477:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.632497:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.632502:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.632540:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391181.632542:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391181.632543:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391181.632581:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771094 gen 2 00000004:00080000:2.0:1788391181.632587:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771094 00000100:00100000:2.0:1788391181.632621:0:3286:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d58c3eb800 x1875263103470592/t30064771095(30064771095) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391197 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788391181.632633:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58c3eb800/2, rc 0, transno 30064771095 00000100:00100000:2.0:1788391181.632637:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103470592:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788391181.632666:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58b15d180/2, rc 0, transno 30064771141 00000100:00100000:2.0:1788391181.632671:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391181.633201:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.633309:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094186368 00000100:00100000:3.0:1788391181.633317:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094186368 00000100:00100000:3.0:1788391181.633418:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391181.633429:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+91:2356:x1875263094186368:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788391181.633826:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000001:00080000:1.0:1788391181.724937:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771141 is committed 00000001:00080000:1.0:1788391181.724950:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771119 is committed 00000001:00080000:1.0:1788391181.725006:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771140 is committed 00000100:00100000:2.0:1788391181.725397:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094186368:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 91964us (92191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391181.725409:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1788391181.733910:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.734160:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094186624 00000100:00100000:1.0:1788391181.734171:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094186624 00000100:00100000:1.0:1788391181.734274:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:1.0:1788391181.734285:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35616:x1875263094186624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391181.734334:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391181.734356:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37641 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000a3 expref: 16 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.734385:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391181.734389:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391181.734458:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.734472:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.734481:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391181.734675:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000155a08be reply state 00000000ff24bf3a transno 30064771289 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.734685:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391181.734783:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:35616:x1875263094186624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 499us (881us total) trans 30064771289 rc 0/0 00000100:00100000:1.0:1788391181.734789:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:3.0:1788391181.739007:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.739070:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094186752 00000100:00100000:0.0:1788391181.739078:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094186752 00000100:00100000:0.0:1788391181.739124:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788391181.739132:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094186752:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788391181.739351:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 42811392 -> 42811392 00002000:00010000:0.0:1788391181.739354:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 1788391181 -> 1788391180 00002000:00010000:0.0:1788391181.739356:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 1788391180 00002000:00010000:0.0:1788391181.739370:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1788391181 -> 1788391180 00002000:00010000:0.0:1788391181.739372:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 83975 00000100:00100000:0.0:1788391181.739422:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094186752:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 291us (423us total) trans 30064771142 rc 0/0 00000100:00100000:0.0:1788391181.739428:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00010000:00010000:2.0:1788391181.739903:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.739914:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.739922:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.739928:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391181.739941:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.739949:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.740118:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:2.0:1788391181.740123:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391181.740127:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.740135:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3765d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391181.740829:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.740894:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187008 00000100:00100000:1.0:1788391181.740901:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187008 00000100:00100000:1.0:1788391181.740953:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:1.0:1788391181.740991:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:35616:x1875263094187008:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788391181.741085:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.741099:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.741120:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.741152:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 16 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.741165:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 16 pid: 43348 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.741180:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103470720:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391181.741266:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402900 going to sleep for 11 seconds 00000100:00100000:1.0:1788391181.742835:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103470720:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391181.742859:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391181.743269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.743426:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187136 00000100:00100000:1.0:1788391181.743433:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187136 00010000:00010000:1.0:1788391181.743463:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 17 pid: 43348 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.743493:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788391181.743508:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094187136:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391181.743521:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391181.743528:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 17 pid: 43348 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743553:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 17 pid: 43348 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743573:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37625 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00095 expref: 17 pid: 43348 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743588:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391181.743593:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743611:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743619:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.743644:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391181.743860:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094187136:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 359us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391181.743867:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00010000:00010000:2.0:1788391181.743918:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.743925:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.743948:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.743954:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.743996:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.744002:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391181.744005:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.744019:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.744029:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:2.0:1788391181.744031:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391181.744035:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.744039:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37664 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391181.744076:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35616:x1875263094187008:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3115us (3250us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391181.744083:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:2.0:1788391181.745523:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391181.745592:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187264 00000100:00100000:0.0:1788391181.745598:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187264 00000100:00100000:0.0:1788391181.745660:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391181.745671:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094187264:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788391181.745707:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.745726:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 9 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.745734:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788391181.745738:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391181.745743:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.745772:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 9 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.745786:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 9 pid: 43698 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391181.745800:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103470848:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391181.745874:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788391181.747481:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103470848:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391181.747503:0:43326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391181.774434:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391181.774443:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391181.774577:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:2.0:1788391181.774586:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391181.795646:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.795746:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187392 00000100:00100000:3.0:1788391181.795760:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187392 00010000:00010000:3.0:1788391181.795811:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391181.795854:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1788391181.795863:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094187392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391181.795877:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391181.795901:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.795914:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.795936:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a316226/0x9aafc5f04cd3764f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b1 expref: 10 pid: 43698 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.795994:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391181.795998:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391181.796005:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.796014:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.796041:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391181.796060:0:43326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796094:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391181.796108:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094187392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 244us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391181.796117:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:2.0:1788391181.796357:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796367:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796376:0:43326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796383:0:43326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391181.796387:0:43326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796396:0:43326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796417:0:43326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.796424:0:43326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd3766b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391181.797157:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094187264:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 51482us (51633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391181.797168:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788391181.802626:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.802708:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187648 00000100:00100000:3.0:1788391181.802725:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187648 00000100:00100000:3.0:1788391181.802801:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:3.0:1788391181.802814:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:35616:x1875263094187648:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788391181.802921:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.802942:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.802956:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.803303:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.803326:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 16 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.803334:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.803379:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 16 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.803394:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 16 pid: 42645 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391181.803412:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b145180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103470976:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391181.804079:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138540 going to sleep for 11 seconds 00000100:00100000:0.0:1788391181.807917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.808276:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b145180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103470976:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391181.808313:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.808365:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187776 00000100:00100000:1.0:1788391181.808373:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187776 00010000:00010000:1.0:1788391181.808415:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 17 pid: 42645 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.808584:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1788391181.808596:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094187776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391181.808642:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391181.808651:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 17 pid: 42645 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808665:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 17 pid: 42645 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808692:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37633 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0009c expref: 17 pid: 42645 timeout: 1098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808719:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:1.0:1788391181.808724:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808732:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808739:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.808763:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391181.808805:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.808824:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391181.808825:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094187776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 231us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391181.808847:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000001:00080000:2.0:1788391181.810154:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771290 00000001:00080000:2.0:1788391181.810333:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771291 00000001:00080000:2.0:1788391181.810371:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771292 00000100:00100000:2.0:1788391181.810458:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103471104:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788391181.810554:0:43348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391181.810586:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391181.810624:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471104 00000100:00100000:3.0:1788391181.810638:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471104 00000100:00100000:0.0:1788391181.810779:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788391181.810800:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103471104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788391181.810885:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103471104:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391181.810893:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788391181.811108:0:43348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771141 gen 2 00000004:00080000:2.0:1788391181.811115:0:43348:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58b15d180, transno 30064771141 00000100:00100000:2.0:1788391181.811183:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103471104:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788391181.811800:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771293 00000100:00100000:2.0:1788391181.811860:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103471232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788391181.811897:0:43348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391181.811921:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a6a9d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391181.812463:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471232 00000100:00100000:3.0:1788391181.812477:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471232 00000100:00100000:3.0:1788391181.812550:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788391181.812562:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103471232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788391181.812941:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43348:x1875263103471232:12345-0@lo:1000:mdt00_003.0 Request processed in 380us (1041us total) trans 30064771143 rc 0/0 00000100:00100000:3.0:1788391181.812953:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788391181.813181:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103471232:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788391181.813219:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813231:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813239:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813246:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391181.813250:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813257:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813272:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d686a70b00) 00010000:00010000:0.0:1788391181.813276:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391181.813281:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813287:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37679 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813327:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813334:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813340:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813345:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6bc79b600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391181.813348:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813355:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813363:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:0.0:1788391181.813366:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391181.813373:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813384:0:43348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813393:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.813423:0:43348:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b400/0x9aafc5f04cd375ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00072 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391181.813446:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103471360:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391181.813536:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6b3c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391181.817182:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103471360:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391181.817224:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817251:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6bc79b600/0x9aafc5f04cd375a7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817285:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817298:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817310:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817321:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817327:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817333:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817338:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391181.817342:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391181.817614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788391181.817840:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817854:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:2.0:1788391181.817858:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391181.817861:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817884:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37680 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817896:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817902:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817908:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817914:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391181.817917:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817923:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817931:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:2.0:1788391181.817934:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391181.817937:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391181.817942:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37672 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391181.818186:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35616:x1875263094187648:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 15373us (15568us total) trans 30064771294 rc 0/0 00000100:00100000:2.0:1788391181.818197:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00000020:00080000:2.0:1788391181.818208:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788391181.819014:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391181.819020:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391181.819049:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:1.0:1788391181.819055:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391181.819389:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094187904 00000100:00100000:3.0:1788391181.819398:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094187904 00000100:00100000:1.0:1788391181.819735:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1788391181.819758:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35615:x1875263094187904:12345-192.168.202.1@tcp:49:dd.0 00000100:00100000:1.0:1788391181.819874:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35615:x1875263094187904:12345-192.168.202.1@tcp:49:dd.0 Request processed in 120us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391181.819882:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391181.823727:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.823802:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188032 00000100:00100000:3.0:1788391181.823812:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188032 00000100:00100000:3.0:1788391181.823871:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1788391181.823882:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:35615:x1875263094188032:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391181.823899:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391181.823917:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd37687 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000b8 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391181.823943:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 42811392, mtime: 0x6a98af0c, atime: 0x6a98af0c, ctime: 0x6a98af0c, blocks: 0x14807 00010000:00010000:3.0:1788391181.823990:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=998s v=(0 0) 00010000:00010000:3.0:1788391181.823995:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391181.824004:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd37687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b8 expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.824020:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b2a5238/0x9aafc5f04cd37687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000b8 expref: 9 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391181.824033:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1a00, rc 0) 00000100:00100000:3.0:1788391181.824085:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:35615:x1875263094188032:12345-192.168.202.1@tcp:101:dd.0 Request processed in 205us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391181.824092:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788391181.825239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.825312:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188288 00000100:00100000:1.0:1788391181.825319:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188288 00000100:00100000:1.0:1788391181.825359:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788391181.825365:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:35616:x1875263094188288:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788391181.826082:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788391181.826205:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771295 00010000:00010000:1.0:1788391181.826241:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826255:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826266:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826274:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826281:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826287:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391181.826303:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391181.826362:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:35616:x1875263094188288:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 996us (1127us total) trans 30064771296 rc 0/0 00000100:00100000:1.0:1788391181.826375:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000020:00080000:1.0:1788391181.826379:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788391181.826495:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391181.826501:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.826506:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391181.826509:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.826518:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.826529:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff95d6a0d29700) 00010000:00010000:0.0:1788391181.826532:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788391181.826547:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.826554:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd3768e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391181.826570:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391181.826572:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391181.826574:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391181.857326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.857441:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188416 00000100:00100000:3.0:1788391181.857460:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188416 00002000:00100000:3.0:1788391181.857507:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff95d68fc5bb80 x1875263094188416/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.857545:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5bb80 with x1875263094188416 ext(42991616->44040191) 00002000:00010000:3.0:1788391181.857551:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5bb80 00000100:00100000:3.0:1788391181.857584:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1788391181.857594:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094188416:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.873113:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094188416:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15510us (15786us total) trans 30064771144 rc 0/0 00000100:00100000:1.0:1788391181.873127:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00002000:00100000:1.0:1788391181.873140:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff95d68fc5bb80 x1875263094188416/t30064771144(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.873151:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5bb80 with x1875263094188416 ext(42991616->44040191) 00002000:00010000:1.0:1788391181.873157:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5bb80 00000100:00100000:2.0:1788391181.873906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.873936:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188544 00000100:00100000:3.0:1788391181.873947:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188544 00002000:00100000:3.0:1788391181.874027:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff95d68fc5a300 x1875263094188544/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.874038:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5a300 with x1875263094188544 ext(44040192->45088767) 00002000:00010000:3.0:1788391181.874042:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5a300 00000100:00100000:3.0:1788391181.874062:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788391181.874073:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094188544:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391181.881847:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094188544:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7764us (7931us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1788391181.881862:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00002000:00100000:3.0:1788391181.881875:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff95d68fc5a300 x1875263094188544/t30064771145(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.881885:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5a300 with x1875263094188544 ext(44040192->45088767) 00002000:00010000:3.0:1788391181.881893:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5a300 00000100:00100000:2.0:1788391181.887433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.887526:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188672 00000100:00100000:1.0:1788391181.887535:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188672 00002000:00100000:1.0:1788391181.887655:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff95d68fc59c00 x1875263094188672/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.887665:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59c00 with x1875263094188672 ext(45088768->46137343) 00002000:00010000:1.0:1788391181.887671:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59c00 00000100:00100000:1.0:1788391181.887708:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1788391181.887891:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094188672:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.899627:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094188672:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11899us (12191us total) trans 30064771146 rc 0/0 00000100:00100000:1.0:1788391181.899640:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00002000:00100000:1.0:1788391181.899653:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff95d68fc59c00 x1875263094188672/t30064771146(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.899664:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59c00 with x1875263094188672 ext(45088768->46137343) 00002000:00010000:1.0:1788391181.899685:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59c00 00000100:00100000:3.0:1788391181.908317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.908407:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188800 00000100:00100000:1.0:1788391181.908419:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188800 00002000:00100000:1.0:1788391181.908466:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff95d58b145180 x1875263094188800/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.908478:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b145180 with x1875263094188800 ext(46137344->47185919) 00002000:00010000:1.0:1788391181.908484:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b145180 00000100:00100000:1.0:1788391181.908520:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:1.0:1788391181.908531:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094188800:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.924703:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094188800:12345-192.168.202.1@tcp:4:dd.0 Request processed in 16164us (16386us total) trans 30064771147 rc 0/0 00000100:00100000:1.0:1788391181.924714:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00002000:00100000:1.0:1788391181.924728:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff95d58b145180 x1875263094188800/t30064771147(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.924738:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b145180 with x1875263094188800 ext(46137344->47185919) 00002000:00010000:1.0:1788391181.924745:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b145180 00000100:00100000:1.0:1788391181.927840:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.927912:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094188928 00000100:00100000:3.0:1788391181.927921:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094188928 00002000:00100000:3.0:1788391181.927980:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff95d58c3ec380 x1875263094188928/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.928004:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ec380 with x1875263094188928 ext(47185920->48234495) 00002000:00010000:3.0:1788391181.928009:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ec380 00000100:00100000:3.0:1788391181.928100:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788391181.928112:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094188928:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391181.938934:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094188928:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10814us (11091us total) trans 30064771148 rc 0/0 00000100:00100000:3.0:1788391181.938949:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00002000:00100000:3.0:1788391181.938994:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff95d58c3ec380 x1875263094188928/t30064771148(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391181.939005:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ec380 with x1875263094188928 ext(47185920->48234495) 00002000:00010000:3.0:1788391181.939024:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ec380 00000100:00100000:1.0:1788391181.948001:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391181.948386:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189056 00000100:00100000:3.0:1788391181.948396:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189056 00002000:00100000:0.0:1788391181.948512:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff95d58c3eea00 x1875263094189056/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391181.948544:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eea00 with x1875263094189056 ext(48234496->49283071) 00002000:00010000:0.0:1788391181.948550:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eea00 00000100:00100000:0.0:1788391181.948580:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788391181.948591:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2359:x1875263094189056:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.959367:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2359:x1875263094189056:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10768us (11406us total) trans 30064771149 rc 0/0 00000100:00100000:1.0:1788391181.959380:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00002000:00100000:1.0:1788391181.959393:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff95d58c3eea00 x1875263094189056/t30064771149(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.959403:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eea00 with x1875263094189056 ext(48234496->49283071) 00002000:00010000:1.0:1788391181.959424:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eea00 00000100:00100000:2.0:1788391181.963920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.964071:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189184 00000100:00100000:1.0:1788391181.964080:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189184 00002000:00100000:1.0:1788391181.964130:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff95d68fc5ad80 x1875263094189184/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.964152:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5ad80 with x1875263094189184 ext(49283072->50331647) 00002000:00010000:1.0:1788391181.964158:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5ad80 00000100:00100000:1.0:1788391181.964190:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:1.0:1788391181.964201:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094189184:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.974082:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2356:x1875263094189184:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9870us (10160us total) trans 30064771150 rc 0/0 00000100:00100000:1.0:1788391181.974096:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00002000:00100000:1.0:1788391181.974109:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff95d68fc5ad80 x1875263094189184/t30064771150(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.974120:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5ad80 with x1875263094189184 ext(49283072->50331647) 00002000:00010000:1.0:1788391181.974126:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5ad80 00000100:00100000:2.0:1788391181.979796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391181.979865:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189312 00000100:00100000:1.0:1788391181.979875:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189312 00002000:00100000:1.0:1788391181.979922:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff95d68fc58700 x1875263094189312/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/0 e 0 to 0 dl 1788391192 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.979930:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc58700 with x1875263094189312 ext(50331648->51380223) 00002000:00010000:1.0:1788391181.979935:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc58700 00000100:00100000:1.0:1788391181.980231:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1788391181.980240:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2358:x1875263094189312:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391181.990387:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2358:x1875263094189312:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10136us (10589us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788391181.990401:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00002000:00100000:1.0:1788391181.990414:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff95d68fc58700 x1875263094189312/t30064771151(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:42/0 lens 488/448 e 0 to 0 dl 1788391192 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391181.990423:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc58700 with x1875263094189312 ext(50331648->51380223) 00002000:00010000:1.0:1788391181.990428:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc58700 00000100:00100000:0.0:1788391182.002353:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391182.002655:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189440 00000100:00100000:3.0:1788391182.002666:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189440 00002000:00100000:3.0:1788391182.002763:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff95d58c3e8a80 x1875263094189440/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391182.002771:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8a80 with x1875263094189440 ext(51380224->52428799) 00002000:00010000:3.0:1788391182.002776:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3e8a80 00000100:00100000:3.0:1788391182.002806:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:3.0:1788391182.002816:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094189440:12345-192.168.202.1@tcp:4:dd.0 00000100:00080000:2.0:1788391182.005989:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391182.011889:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2356:x1875263094189440:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9065us (9537us total) trans 30064771152 rc 0/0 00000100:00100000:3.0:1788391182.011919:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00002000:00100000:3.0:1788391182.011933:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff95d58c3e8a80 x1875263094189440/t30064771152(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391182.011944:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8a80 with x1875263094189440 ext(51380224->52428799) 00002000:00010000:3.0:1788391182.011950:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3e8a80 00000100:00100000:1.0:1788391182.016955:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391182.017090:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189568 00000100:00100000:0.0:1788391182.017105:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189568 00002000:00100000:0.0:1788391182.017161:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff95d58c3ec000 x1875263094189568/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.017175:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ec000 with x1875263094189568 ext(52428800->53477375) 00002000:00010000:0.0:1788391182.017180:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ec000 00000100:00100000:0.0:1788391182.017302:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788391182.017313:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094189568:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391182.025085:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2359:x1875263094189568:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7764us (8130us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1788391182.025098:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00002000:00100000:1.0:1788391182.025116:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff95d58c3ec000 x1875263094189568/t30064771153(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391182.025124:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ec000 with x1875263094189568 ext(52428800->53477375) 00002000:00010000:1.0:1788391182.025128:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ec000 00000100:00100000:2.0:1788391182.040628:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391182.040723:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189696 00000100:00100000:1.0:1788391182.040734:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189696 00002000:00100000:1.0:1788391182.040779:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff95d68fc5aa00 x1875263094189696/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391182.040791:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5aa00 with x1875263094189696 ext(53477376->54525951) 00002000:00010000:1.0:1788391182.040796:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5aa00 00000100:00100000:1.0:1788391182.040834:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788391182.040844:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094189696:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391182.056134:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094189696:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15280us (15505us total) trans 30064771154 rc 0/0 00000100:00100000:0.0:1788391182.056148:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00002000:00100000:0.0:1788391182.056162:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff95d68fc5aa00 x1875263094189696/t30064771154(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.056172:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5aa00 with x1875263094189696 ext(53477376->54525951) 00002000:00010000:0.0:1788391182.056179:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5aa00 00000100:00100000:2.0:1788391182.063362:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391182.063468:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189824 00000100:00100000:1.0:1788391182.063479:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189824 00002000:00100000:1.0:1788391182.063528:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff95d68fc59880 x1875263094189824/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391182.063539:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59880 with x1875263094189824 ext(54525952->55574527) 00002000:00010000:1.0:1788391182.063544:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59880 00000100:00100000:1.0:1788391182.063582:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:1.0:1788391182.063592:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094189824:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391182.072538:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2356:x1875263094189824:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8937us (9174us total) trans 30064771155 rc 0/0 00000100:00100000:3.0:1788391182.072552:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00002000:00100000:3.0:1788391182.072564:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff95d68fc59880 x1875263094189824/t30064771155(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391182.072571:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59880 with x1875263094189824 ext(54525952->55574527) 00002000:00010000:3.0:1788391182.072585:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59880 00000100:00100000:2.0:1788391182.082786:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391182.083505:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094189952 00000100:00100000:3.0:1788391182.083515:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094189952 00002000:00100000:3.0:1788391182.083568:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff95d68fc59180 x1875263094189952/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391182.083580:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59180 with x1875263094189952 ext(55574528->56623103) 00002000:00010000:3.0:1788391182.083585:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59180 00000100:00100000:3.0:1788391182.083648:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:3.0:1788391182.083660:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094189952:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391182.095466:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094189952:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11792us (12674us total) trans 30064771156 rc 0/0 00000100:00100000:0.0:1788391182.095494:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00002000:00100000:0.0:1788391182.095507:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff95d68fc59180 x1875263094189952/t30064771156(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.095517:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59180 with x1875263094189952 ext(55574528->56623103) 00002000:00010000:0.0:1788391182.095523:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc59180 00000100:00100000:3.0:1788391182.096101:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391182.096759:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190080 00000100:00100000:0.0:1788391182.096768:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190080 00002000:00100000:0.0:1788391182.096815:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff95d58b146d80 x1875263094190080/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.096825:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b146d80 with x1875263094190080 ext(56623104->57671679) 00002000:00010000:0.0:1788391182.096830:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b146d80 00000100:00100000:0.0:1788391182.097050:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788391182.097061:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094190080:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391182.107201:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391182.107381:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190208 00000100:00100000:3.0:1788391182.107390:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190208 00002000:00100000:3.0:1788391182.107446:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff95d58c3eca80 x1875263094190208/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391182.107457:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eca80 with x1875263094190208 ext(57671680->58720255) 00002000:00010000:3.0:1788391182.107463:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eca80 00000100:00100000:3.0:1788391182.107492:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1788391182.107507:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2356:x1875263094190208:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391182.109209:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094190080:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12143us (13102us total) trans 30064771157 rc 0/0 00000100:00100000:0.0:1788391182.109221:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00002000:00100000:0.0:1788391182.109230:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff95d58b146d80 x1875263094190080/t30064771157(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.109240:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b146d80 with x1875263094190080 ext(56623104->57671679) 00002000:00010000:0.0:1788391182.109246:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b146d80 00000100:00100000:2.0:1788391182.121222:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391182.121615:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190336 00000100:00100000:0.0:1788391182.121634:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190336 00002000:00100000:0.0:1788391182.121685:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff95d68fc5b100 x1875263094190336/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.121711:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b100 with x1875263094190336 ext(58720256->59768831) 00002000:00010000:0.0:1788391182.121717:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5b100 00000100:00100000:0.0:1788391182.121786:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788391182.121798:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094190336:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391182.122822:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094190208:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15159us (15469us total) trans 30064771158 rc 0/0 00000100:00100000:0.0:1788391182.122834:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00002000:00100000:0.0:1788391182.122844:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff95d58c3eca80 x1875263094190208/t30064771158(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.122853:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eca80 with x1875263094190208 ext(57671680->58720255) 00002000:00010000:0.0:1788391182.122857:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eca80 00000100:00100000:2.0:1788391182.126901:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391182.126956:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190464 00000100:00100000:0.0:1788391182.126991:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190464 00002000:00100000:0.0:1788391182.127047:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff95d68fc5b800 x1875263094190464/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.127058:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b800 with x1875263094190464 ext(59768832->60817407) 00002000:00010000:0.0:1788391182.127064:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5b800 00000100:00100000:0.0:1788391182.127096:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1788391182.127106:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094190464:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391182.131590:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2356:x1875263094190336:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9784us (10368us total) trans 30064771159 rc 0/0 00000100:00100000:1.0:1788391182.131612:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00002000:00100000:1.0:1788391182.131731:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff95d68fc5b100 x1875263094190336/t30064771159(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391182.131742:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b100 with x1875263094190336 ext(58720256->59768831) 00002000:00010000:1.0:1788391182.131748:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5b100 00000100:00100000:3.0:1788391182.143351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391182.144123:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190592 00000100:00100000:0.0:1788391182.144135:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190592 00002000:00100000:0.0:1788391182.144191:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff95d58b144700 x1875263094190592/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.144220:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144700 with x1875263094190592 ext(60817408->61865983) 00002000:00010000:0.0:1788391182.144226:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b144700 00000100:00100000:0.0:1788391182.144260:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1788391182.144269:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2357:x1875263094190592:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391182.145888:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2357:x1875263094190464:12345-192.168.202.1@tcp:4:dd.0 Request processed in 18779us (18991us total) trans 30064771160 rc 0/0 00000100:00100000:0.0:1788391182.145904:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00002000:00100000:0.0:1788391182.145911:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff95d68fc5b800 x1875263094190464/t30064771160(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.145918:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b800 with x1875263094190464 ext(59768832->60817407) 00002000:00010000:0.0:1788391182.145922:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68fc5b800 00000100:00100000:0.0:1788391182.151720:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2357:x1875263094190592:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7442us (8370us total) trans 30064771161 rc 0/0 00000100:00100000:0.0:1788391182.151733:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00002000:00100000:0.0:1788391182.151744:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff95d58b144700 x1875263094190592/t30064771161(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.151755:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144700 with x1875263094190592 ext(60817408->61865983) 00002000:00010000:0.0:1788391182.151762:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b144700 00000100:00100000:0.0:1788391182.154849:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391182.154923:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190848 00000100:00100000:1.0:1788391182.154934:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190848 00000100:00100000:0.0:1788391182.155028:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391182.155035:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788391182.155049:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:35615:x1875263094190848:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:0.0:1788391182.155079:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094190976 00000100:00100000:0.0:1788391182.155084:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094190976 00002000:00100000:0.0:1788391182.155117:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff95d58c3eb480 x1875263094190976/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/0 e 0 to 0 dl 1788391193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391182.155140:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eb480 with x1875263094190976 ext(61865984->62914559) 00002000:00010000:0.0:1788391182.155145:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eb480 00000100:00100000:0.0:1788391182.155166:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391182.155174:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2356:x1875263094190976:12345-192.168.202.1@tcp:4:dd.0 00000001:00080000:1.0:1788391182.155315:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771297 00000001:00080000:1.0:1788391182.155425:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771298 00000100:00100000:1.0:1788391182.155529:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:35615:x1875263094190848:12345-192.168.202.1@tcp:35:dd.0 Request processed in 483us (688us total) trans 30064771299 rc 0/0 00000100:00100000:1.0:1788391182.155547:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000020:00080000:1.0:1788391182.155552:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788391182.168591:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2356:x1875263094190976:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13406us (13552us total) trans 30064771162 rc 0/0 00000100:00100000:1.0:1788391182.168615:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00002000:00100000:1.0:1788391182.168629:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff95d58c3eb480 x1875263094190976/t30064771162(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:43/0 lens 488/448 e 0 to 0 dl 1788391193 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391182.168639:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eb480 with x1875263094190976 ext(61865984->62914559) 00002000:00010000:1.0:1788391182.168645:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eb480 00000100:00100000:0.0:1788391182.232758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391182.232909:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191104 00000100:00100000:2.0:1788391182.232920:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191104 00000100:00100000:1.0:1788391182.233055:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:1.0:1788391182.233068:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:35626:x1875263094191104:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391182.233093:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391182.233117:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000bf expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233180:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233193:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233206:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391182.233237:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391182.233239:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391182.233255:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233295:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000bf expref: 26 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233314:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000bf expref: 25 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.233323:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391182.233326:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391182.233330:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:1.0:1788391182.235363:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:35626:x1875263094191104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2287us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391182.235376:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:0.0:1788391182.236918:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391182.237153:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191232 00000100:00100000:1.0:1788391182.237163:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191232 00000100:00100000:1.0:1788391182.237225:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00100000:1.0:1788391182.237235:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:35626:x1875263094191232:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391182.237301:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237316:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237327:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237342:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237367:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237373:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237700:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237709:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237715:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391182.237754:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237766:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237772:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237779:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237784:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391182.237789:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237796:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237815:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391182.237817:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391182.237823:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237828:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd376a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237840:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237846:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237851:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237856:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391182.237858:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237864:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237870:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391182.237872:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391182.237874:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237879:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd376aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237900:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237906:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237911:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237916:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391182.237919:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237924:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237930:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:1.0:1788391182.237933:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391182.237935:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391182.237941:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd376b1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391182.239641:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:35626:x1875263094191232:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 2400us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391182.239654:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 263 00010000:00010000:2.0:1788391182.285253:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391182.317676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391182.319466:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191360 00000100:00100000:2.0:1788391182.319479:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191360 00000100:00100000:2.0:1788391182.319546:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 264 00000100:00100000:2.0:1788391182.319554:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:35633:x1875263094191360:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:2.0:1788391182.319572:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391182.319591:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd376b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000c6 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319664:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319676:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319699:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319713:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319721:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.319727:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320020:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320026:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320031:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391182.320057:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 62914560 00000004:00200000:2.0:1788391182.320061:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391182.320088:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320096:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320101:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320112:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320117:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320120:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391182.320123:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320127:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320135:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391182.320137:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391182.320139:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320143:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd376bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320151:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320155:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320159:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320161:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391182.320166:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320170:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320174:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff95d6830d2900) 00010000:00010000:2.0:1788391182.320175:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391182.320177:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320180:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd376c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320200:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd376b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000c6 expref: 27 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320208:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e600/0x9aafc5f04cd376cd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000c6 expref: 26 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391182.320212:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff95d6a704c000) 00010000:00010000:2.0:1788391182.320213:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391182.320215:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e600, rc 0) 00000100:00100000:2.0:1788391182.320270:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:35633:x1875263094191360:12345-192.168.202.1@tcp:101:stat.0 Request processed in 717us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391182.320275:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 264 00010000:00010000:1.0:1788391183.310011:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391184.333834:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103471488:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.333908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.333990:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103472000:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334022:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.334053:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391184.334059:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103471872:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334081:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.334107:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103471616:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334134:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.334152:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103472128:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334178:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.334197:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391184.334203:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103471744:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391184.334252:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472000 00000100:00100000:1.0:1788391184.334259:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472000 00000100:00100000:1.0:1788391184.334311:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471872 00000100:00100000:1.0:1788391184.334314:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471872 00000100:00100000:1.0:1788391184.334328:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472128 00000100:00100000:1.0:1788391184.334330:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472128 00000100:00100000:1.0:1788391184.334346:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391184.334355:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103472000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334410:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103472000:12345-0@lo:400:kworker.0 Request processed in 56us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391184.334418:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391184.334436:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788391184.334443:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103471872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.334473:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103471872:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391184.334638:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471488 00000100:00100000:3.0:1788391184.334643:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471488 00000100:00100000:3.0:1788391184.334676:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788391184.334684:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391184.334722:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103471488:12345-0@lo:400:kworker.0 Request processed in 39us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391184.334728:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788391184.334764:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391184.334772:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103472256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391184.334797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391184.334825:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472256 00000100:00100000:3.0:1788391184.334829:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472256 00000100:00100000:3.0:1788391184.334860:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788391184.334867:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103472256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391184.334897:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 185663488 pending 32374784 free 3816816640 avail 3814719488 00000100:00100000:3.0:1788391184.334935:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103472256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391184.334942:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788391184.335018:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103472256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391184.335091:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788391184.335106:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788391184.335113:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.335191:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103472128:12345-0@lo:400:kworker.0 Request processed in 78us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391184.335197:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788391184.335267:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471616 00000100:00100000:1.0:1788391184.335271:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471616 00000100:00100000:1.0:1788391184.335306:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103471744 00000100:00100000:1.0:1788391184.335310:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103471744 00000100:00100000:1.0:1788391184.335328:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788391184.335334:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103471616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.335368:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103471616:12345-0@lo:400:kworker.0 Request processed in 34us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391184.335374:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788391184.335385:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391184.335391:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103471744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.335417:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103471744:12345-0@lo:400:kworker.0 Request processed in 26us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391184.335422:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788391184.335451:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391184.335455:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391184.335458:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391184.335498:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103471872:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.335510:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103471488:0@lo:400:kworker.0 00000100:00100000:1.0:1788391184.335536:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103472000:0@lo:400:kworker.0 00010000:00010000:2.0:1788391184.335541:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391184.335646:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103472128:0@lo:400:kworker.0 00000100:00100000:3.0:1788391184.335662:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103471744:0@lo:400:kworker.0 00000100:00100000:3.0:1788391184.335670:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103471616:0@lo:400:kworker.0 00010000:00010000:0.0:1788391185.358174:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391185.358396:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103472384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391185.358464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391185.358655:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472384 00000100:00100000:0.0:1788391185.358664:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472384 00000100:00100000:0.0:1788391185.358721:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788391185.358732:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103472384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391185.358765:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788391185.358811:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103472384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391185.358819:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788391185.358952:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103472384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391186.039212:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391186.039256:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.039292:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191488 00000100:00100000:1.0:1788391186.039301:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191488 00000100:00100000:3.0:1788391186.039351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.039366:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1788391186.039375:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.039377:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094191488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391186.039397:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391186.039476:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192000 00000100:00100000:2.0:1788391186.039481:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192000 00000100:00100000:1.0:1788391186.039616:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094191488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 174us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391186.039629:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00080000:3.0:1788391186.039750:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391186.039780:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191744 00000100:00100000:0.0:1788391186.039785:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191744 00000100:00100000:2.0:1788391186.039799:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191616 00000100:00100000:2.0:1788391186.039803:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191616 00000100:00100000:0.0:1788391186.039817:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094191872 00000100:00100000:0.0:1788391186.039820:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094191872 00000100:00100000:0.0:1788391186.039847:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788391186.039855:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2358:x1875263094191744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391186.039894:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2358:x1875263094191744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391186.039901:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1788391186.040107:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1788391186.040143:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2358:x1875263094191872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391186.040172:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2358:x1875263094191872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391186.040178:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00080000:3.0:1788391186.040643:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391186.040796:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391186.040799:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391186.041140:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788391186.041153:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094192000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391186.041224:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094192000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391186.041231:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1788391186.041249:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:1.0:1788391186.041256:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094191616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391186.041280:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094191616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391186.041342:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1788391186.055354:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.055531:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192128 00000100:00100000:1.0:1788391186.055541:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192128 00000100:00100000:1.0:1788391186.055610:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:1.0:1788391186.055621:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:35578:x1875263094192128:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788391186.056196:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:35578:x1875263094192128:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 575us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391186.056218:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:3.0:1788391186.058049:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.058140:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192384 00000100:00100000:1.0:1788391186.058149:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192384 00000100:00100000:1.0:1788391186.058199:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1788391186.058209:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585262c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:35578:x1875263094192384:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391186.058510:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585262c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:35578:x1875263094192384:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 302us (469us total) trans 30064771300 rc 0/0 00000100:00100000:1.0:1788391186.058518:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391186.283488:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391186.283714:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192512 00000100:00100000:1.0:1788391186.283725:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192512 00000100:00100000:1.0:1788391186.283778:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:1.0:1788391186.283786:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:36073:x1875263094192512:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1788391186.283802:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391186.283819:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd376d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000cd expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.283869:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.283878:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.283887:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391186.283914:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391186.283916:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391186.283953:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.284000:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd376d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 7 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.284013:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 6 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391186.284018:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391186.284020:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391186.284022:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:1.0:1788391186.284065:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:36073:x1875263094192512:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 281us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391186.284070:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 266 00010000:00010000:2.0:1788391186.381121:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788391186.405812:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771095 is committed 00000001:00080000:0.0:1788391186.978732:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771300 is committed 00000020:00080000:0.0:1788391186.978775:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a6a9dc00 refcount 2 committed 0 result 0 batchid 25769803906 00000020:00080000:0.0:1788391186.978781:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d69f421000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a6a9dcc0 00000020:00080000:0.0:1788391186.978784:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d69f421a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58bb82800 00000020:00080000:3.0:1788391186.978871:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803906 committed batchid 25769803904 00000020:00080000:3.0:1788391186.979152:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000020:00080000:0.0:1788391186.979215:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803905 batchid updated 00000001:00080000:1.0:1788391186.980706:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771161 is committed 00000001:00080000:1.0:1788391186.980831:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771162 is committed 00000001:00080000:1.0:1788391186.981109:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771143 is committed 00010000:00010000:0.0:1788391187.405355:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391188.433113:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788391188.768754:0:45840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 19:19:47 (1788391187) 00000100:00100000:2.0:1788391189.453183:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391189.453209:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103472512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391189.453279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391189.453445:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391189.453518:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472512 00000100:00100000:0.0:1788391189.453526:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472512 00000100:00100000:0.0:1788391189.453610:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788391189.453625:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103472512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391189.453660:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 153288704 pending 0 free 3796893696 avail 3794796544 00000100:00080000:3.0:1788391189.453705:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391189.453713:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103472512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391189.453722:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788391189.453753:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771143 gen 2 00000004:00080000:3.0:1788391189.453759:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771143 committed transno 30064771143 00000100:00100000:3.0:1788391189.453786:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103472512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391189.455772:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103472640:0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.455831:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391189.455882:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103473152:0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.455925:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391189.455946:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391189.455952:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103472768:0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.455989:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391189.456016:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472768 00000100:00100000:3.0:1788391189.456022:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472768 00000100:00100000:3.0:1788391189.456075:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788391189.456084:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103472768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.456134:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103472768:12345-0@lo:400:kworker.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391189.456140:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788391189.456163:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391189.456173:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103473152 00000100:00100000:0.0:1788391189.456179:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103473152 00000100:00100000:3.0:1788391189.456192:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771095 gen 2 00000004:00080000:3.0:1788391189.456199:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58c3eb800, transno 30064771095 00000100:00100000:3.0:1788391189.456215:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103472768:0@lo:400:kworker.0 00000100:00100000:0.0:1788391189.456220:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788391189.456233:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103473152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391189.456272:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103473152:12345-0@lo:400:kworker.0 Request processed in 45us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391189.456277:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788391189.456705:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391189.456727:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103473152:0@lo:400:kworker.0 00000100:00100000:1.0:1788391189.456787:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103473024:0@lo:400:kworker.0 00000100:00100000:1.0:1788391189.456816:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391189.456888:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391189.456894:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103472896:0@lo:400:kworker.0 00000100:00100000:1.0:1788391189.456917:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391189.456927:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472640 00000100:00100000:2.0:1788391189.456932:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472640 00000100:00100000:2.0:1788391189.457000:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788391189.457010:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.457038:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103473024 00000100:00100000:3.0:1788391189.457044:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103473024 00000100:00100000:0.0:1788391189.457070:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103472896 00000100:00100000:0.0:1788391189.457075:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103472896 00000100:00100000:3.0:1788391189.457083:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788391189.457094:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103473024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391189.457099:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788391189.457106:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103472896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391189.457139:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103473024:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391189.457145:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103472896:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391189.457151:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788391189.457168:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391189.457197:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103472640:12345-0@lo:400:kworker.0 Request processed in 191us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391189.457203:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788391189.457225:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103472640:0@lo:400:kworker.0 00000100:00100000:1.0:1788391189.457295:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103472896:0@lo:400:kworker.0 00000100:00100000:1.0:1788391189.457303:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103473024:0@lo:400:kworker.0 00000100:00100000:0.0:1788391189.457419:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788391190.358757:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.359001:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192768 00000100:00100000:3.0:1788391190.359012:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192768 00000100:00100000:3.0:1788391190.359093:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:3.0:1788391190.359103:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:36354:x1875263094192768:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1788391190.359225:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788391190.359294:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391190.359318:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd376e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000d4 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359393:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359408:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359422:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359435:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359442:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.359448:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360444:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd376f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360459:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd376f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360482:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd376f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391190.360495:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788391190.360696:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360705:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360712:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360717:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391190.360722:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360728:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360740:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:3.0:1788391190.360742:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.360747:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360753:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd376e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360764:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360770:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360783:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360788:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391190.360791:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360797:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360805:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d686a70500) 00010000:00010000:3.0:1788391190.360807:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.360810:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.360816:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd376f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.361696:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd376e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000d4 expref: 18 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.361714:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd376f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000d4 expref: 17 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.361721:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391190.361724:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.361727:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1000, rc 0) 00000100:00100000:3.0:1788391190.361798:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:36354:x1875263094192768:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2695us (3050us total) trans 30064771301 rc 0/0 00000100:00100000:3.0:1788391190.361817:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:3.0:1788391190.365029:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.365078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391190.365161:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193024 00000100:00100000:2.0:1788391190.365170:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193024 00000100:00100000:1.0:1788391190.365219:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094192896 00000100:00100000:1.0:1788391190.365224:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094192896 00000100:00100000:2.0:1788391190.365237:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1788391190.365252:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2359:x1875263094193024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391190.365266:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788391190.365271:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 268 00000100:00100000:1.0:1788391190.365279:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:36354:x1875263094192896:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00010000:00010000:2.0:1788391190.365294:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd376f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000d4 expref: 18 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.365324:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391190.365330:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391190.365358:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:36354:x1875263094192896:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391190.365364:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 268 00000100:00100000:2.0:1788391190.365370:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094193024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391190.365383:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:2.0:1788391190.477998:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391190.478005:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103473280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391190.478060:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391190.478354:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103473280 00000100:00100000:2.0:1788391190.478361:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103473280 00000100:00100000:2.0:1788391190.478401:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788391190.478411:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103473280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391190.478446:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788391190.478488:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103473280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391190.478493:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788391190.478543:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103473280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391190.496274:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.496397:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193280 00000100:00100000:1.0:1788391190.496407:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193280 00000100:00100000:1.0:1788391190.496498:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:1.0:1788391190.496506:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:36369:x1875263094193280:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:1.0:1788391190.496593:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391190.496622:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3769c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000bf expref: 16 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.496642:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391190.496647:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391190.496951:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.497012:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.497021:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.497056:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 5 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.497069:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 5 pid: 43348 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391190.497092:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103473408:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391190.497188:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6811ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391190.500683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.500773:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103473408:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391190.500797:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391190.500828:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193408 00000100:00100000:2.0:1788391190.500838:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193408 00010000:00010000:2.0:1788391190.500947:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 6 pid: 43348 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391190.501006:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391190.501017:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094193408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391190.501032:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391190.501039:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 6 pid: 43348 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501065:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 6 pid: 43348 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501087:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd376db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000cd expref: 6 pid: 43348 timeout: 1107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501103:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391190.501108:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501117:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501124:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.501156:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391190.501182:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.501189:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391190.501211:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094193408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 194us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391190.501219:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00010000:00010000:1.0:1788391190.501249:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.501261:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.501270:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391190.502276:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:1.0:1788391190.502289:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502297:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502302:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502307:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391190.502310:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502322:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502335:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391190.502338:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391190.502342:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.502347:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37705 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391190.502364:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095585c99 reply state 0000000061990c34 transno 30064771302 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391190.502373:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391190.502443:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:36369:x1875263094193280:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 5935us (6175us total) trans 30064771302 rc 0/0 00000100:00100000:1.0:1788391190.502448:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 269 00010000:00010000:2.0:1788391190.504332:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504347:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504353:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504376:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391190.504380:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504386:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504399:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff95d6a0d29c00) 00010000:00010000:2.0:1788391190.504401:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391190.504403:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.504408:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd3770c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788391190.504623:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391190.515339:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.515455:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193536 00000100:00100000:1.0:1788391190.515465:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193536 00000100:00100000:1.0:1788391190.515537:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 270 00000100:00100000:1.0:1788391190.515548:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:36370:x1875263094193536:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391190.515574:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391190.515598:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000db expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515666:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515703:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515715:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391190.515753:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391190.515757:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391190.515778:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515803:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000db expref: 18 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515820:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000db expref: 17 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.515829:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391190.515832:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391190.515835:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7a00, rc 0) 00000100:00100000:1.0:1788391190.515901:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:36370:x1875263094193536:12345-192.168.202.1@tcp:101:dd.0 Request processed in 355us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391190.515908:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 270 00000100:00100000:1.0:1788391190.519099:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.519200:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193664 00000100:00100000:3.0:1788391190.519211:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193664 00000100:00100000:3.0:1788391190.519304:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:3.0:1788391190.519315:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:36370:x1875263094193664:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391190.519336:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391190.519355:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000e2 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519434:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519448:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519460:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519475:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519481:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519501:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519618:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37736 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519636:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37736 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519645:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37736 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391190.519670:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00000004:00200000:3.0:1788391190.519673:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391190.519693:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37736 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519704:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519711:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519718:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519723:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391190.519727:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519734:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519751:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:3.0:1788391190.519753:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.519757:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519763:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519776:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519782:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519787:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519792:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391190.519794:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519800:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519807:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff95d686a70500) 00010000:00010000:3.0:1788391190.519809:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.519812:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519818:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd3772f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519857:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000e2 expref: 19 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519869:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1c00/0x9aafc5f04cd37736 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000e2 expref: 18 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.519877:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391190.519879:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788391190.519882:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1c00, rc 0) 00000100:00100000:3.0:1788391190.519942:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:36370:x1875263094193664:12345-192.168.202.1@tcp:101:dd.0 Request processed in 630us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391190.519949:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:3.0:1788391190.524034:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.524186:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094193920 00000100:00100000:0.0:1788391190.524196:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094193920 00000100:00100000:0.0:1788391190.524250:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 272 00000100:00100000:0.0:1788391190.524262:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:36370:x1875263094193920:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391190.524285:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391190.524303:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3773d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000e9 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524451:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524466:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524478:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524493:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524511:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.524519:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391190.525102:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc7:0x0], index 0: 0 00010000:00010000:0.0:1788391190.525251:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37752 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525261:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37752 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525268:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37752 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525298:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525303:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525309:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525314:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391190.525318:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525324:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525347:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391190.525349:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391190.525354:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525360:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37744 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391190.525374:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c216e08a reply state 000000003421344e transno 30064771303 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391190.525382:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391190.525410:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3773d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000e9 expref: 21 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525422:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37752 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000e9 expref: 20 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391190.525429:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391190.525431:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391190.525433:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa000, rc 0) 00000100:00100000:0.0:1788391190.525498:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:36370:x1875263094193920:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1239us (1475us total) trans 30064771303 rc 0/0 00000100:00100000:0.0:1788391190.525506:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 272 00010000:00010000:1.0:1788391190.531914:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.531932:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.532066:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.532075:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391190.532080:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.532088:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.532105:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff95d6a704cc00) 00010000:00010000:1.0:1788391190.532109:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391190.532113:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.532119:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd3774b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391190.537133:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.537561:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194048 00000100:00100000:1.0:1788391190.537571:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194048 00000100:00100000:1.0:1788391190.537698:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:1.0:1788391190.537710:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:36370:x1875263094194048:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391190.537729:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391190.537752:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000f0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391190.537780:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391190.537802:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=1007s v=(0 0) 00010000:00010000:1.0:1788391190.537823:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391190.537833:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.537852:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 6 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391190.537865:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:1.0:1788391190.537930:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:36370:x1875263094194048:12345-192.168.202.1@tcp:101:dd.0 Request processed in 221us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391190.537937:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00080000:0.0:1788391190.539863:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391190.557270:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.557379:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194176 00000100:00100000:0.0:1788391190.557390:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194176 00002000:00100000:0.0:1788391190.557447:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff95d68fc5b480 x1875263094194176/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.557476:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b480 with x1875263094194176 ext(0->1048575) 00002000:00010000:0.0:1788391190.557482:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc5b480 00000100:00100000:0.0:1788391190.557518:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788391190.557553:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094194176:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391190.585268:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094194176:12345-192.168.202.1@tcp:4:dd.0 Request processed in 27712us (27997us total) trans 30064771096 rc 0/0 00000100:00100000:1.0:1788391190.585281:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00002000:00100000:1.0:1788391190.585292:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff95d68fc5b480 x1875263094194176/t30064771096(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.585304:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc5b480 with x1875263094194176 ext(0->1048575) 00002000:00010000:1.0:1788391190.585310:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc5b480 00000100:00100000:3.0:1788391190.592767:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.592843:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194304 00000100:00100000:1.0:1788391190.592854:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194304 00002000:00100000:1.0:1788391190.592909:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff95d58b145c00 x1875263094194304/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.592921:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b145c00 with x1875263094194304 ext(1048576->2097151) 00002000:00010000:1.0:1788391190.592927:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b145c00 00000100:00100000:1.0:1788391190.593083:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1788391190.593093:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094194304:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391190.602227:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391190.602317:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194432 00000100:00100000:2.0:1788391190.602328:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194432 00002000:00100000:2.0:1788391190.602378:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff95d58c3edf80 x1875263094194432/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.602389:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3edf80 with x1875263094194432 ext(2097152->3145727) 00002000:00010000:2.0:1788391190.602395:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3edf80 00000100:00100000:2.0:1788391190.602470:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788391190.602481:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094194432:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.610022:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094194304:12345-192.168.202.1@tcp:4:dd.0 Request processed in 16921us (17257us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1788391190.610033:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00002000:00100000:0.0:1788391190.610044:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff95d58b145c00 x1875263094194304/t30064771097(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.610052:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b145c00 with x1875263094194304 ext(1048576->2097151) 00002000:00010000:0.0:1788391190.610058:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b145c00 00000100:00100000:2.0:1788391190.619244:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2358:x1875263094194432:12345-192.168.202.1@tcp:4:dd.0 Request processed in 16753us (17018us total) trans 30064771098 rc 0/0 00000100:00100000:2.0:1788391190.619276:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00002000:00100000:2.0:1788391190.619289:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff95d58c3edf80 x1875263094194432/t30064771098(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.619299:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3edf80 with x1875263094194432 ext(2097152->3145727) 00002000:00010000:2.0:1788391190.619305:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3edf80 00000100:00100000:3.0:1788391190.630066:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.630173:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194560 00000100:00100000:0.0:1788391190.630184:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194560 00002000:00100000:0.0:1788391190.630239:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff95d685dc4700 x1875263094194560/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.630251:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc4700 with x1875263094194560 ext(3145728->4194303) 00002000:00010000:0.0:1788391190.630257:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc4700 00000100:00100000:0.0:1788391190.630294:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1788391190.630305:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2359:x1875263094194560:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.650526:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2359:x1875263094194560:12345-192.168.202.1@tcp:4:dd.0 Request processed in 20194us (20441us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788391190.650541:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00002000:00100000:0.0:1788391190.650565:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff95d685dc4700 x1875263094194560/t30064771099(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.650577:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc4700 with x1875263094194560 ext(3145728->4194303) 00002000:00010000:0.0:1788391190.650583:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc4700 00000100:00100000:3.0:1788391190.661488:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.661684:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194688 00000100:00100000:0.0:1788391190.661695:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194688 00002000:00100000:0.0:1788391190.661753:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff95d69225d180 x1875263094194688/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.661765:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225d180 with x1875263094194688 ext(4194304->5242879) 00002000:00010000:0.0:1788391190.661772:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225d180 00000100:00100000:0.0:1788391190.661811:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788391190.661821:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094194688:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391190.665693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.665770:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194816 00000100:00100000:1.0:1788391190.665780:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194816 00002000:00100000:1.0:1788391190.665827:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff95d69225c000 x1875263094194816/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.665838:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225c000 with x1875263094194816 ext(5242880->6291455) 00002000:00010000:1.0:1788391190.665843:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225c000 00000100:00100000:1.0:1788391190.665879:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:1.0:1788391190.665889:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2359:x1875263094194816:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.675493:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094194688:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13662us (14004us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1788391190.675517:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00002000:00100000:0.0:1788391190.675538:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff95d69225d180 x1875263094194688/t30064771100(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.675548:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225d180 with x1875263094194688 ext(4194304->5242879) 00002000:00010000:0.0:1788391190.675554:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225d180 00000100:00100000:1.0:1788391190.683427:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2359:x1875263094194816:12345-192.168.202.1@tcp:4:dd.0 Request processed in 17529us (17735us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1788391190.683440:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00002000:00100000:1.0:1788391190.683452:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff95d69225c000 x1875263094194816/t30064771101(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.683462:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225c000 with x1875263094194816 ext(5242880->6291455) 00002000:00010000:1.0:1788391190.683469:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225c000 00000100:00100000:3.0:1788391190.684664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.684750:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094194944 00000100:00100000:1.0:1788391190.684760:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094194944 00002000:00100000:1.0:1788391190.684801:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff95d69225dc00 x1875263094194944/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.684811:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225dc00 with x1875263094194944 ext(6291456->7340031) 00002000:00010000:1.0:1788391190.684816:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225dc00 00000100:00100000:1.0:1788391190.684844:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:1.0:1788391190.684853:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094194944:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391190.694318:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094194944:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9456us (9650us total) trans 30064771102 rc 0/0 00000100:00100000:1.0:1788391190.694329:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00002000:00100000:1.0:1788391190.694339:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff95d69225dc00 x1875263094194944/t30064771102(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.694346:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225dc00 with x1875263094194944 ext(6291456->7340031) 00002000:00010000:1.0:1788391190.694352:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225dc00 00000100:00100000:3.0:1788391190.695535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.695589:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195072 00000100:00100000:0.0:1788391190.695598:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195072 00002000:00100000:0.0:1788391190.695644:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff95d69225df80 x1875263094195072/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.695651:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225df80 with x1875263094195072 ext(7340032->8388607) 00002000:00010000:0.0:1788391190.695674:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225df80 00000100:00100000:0.0:1788391190.695705:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788391190.695717:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2356:x1875263094195072:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.704003:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2356:x1875263094195072:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8238us (8434us total) trans 30064771103 rc 0/0 00000100:00100000:0.0:1788391190.704019:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00002000:00100000:0.0:1788391190.704034:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff95d69225df80 x1875263094195072/t30064771103(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.704045:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225df80 with x1875263094195072 ext(7340032->8388607) 00002000:00010000:0.0:1788391190.704052:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d69225df80 00000100:00100000:3.0:1788391190.718289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.718405:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195200 00000100:00100000:0.0:1788391190.718414:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195200 00002000:00100000:0.0:1788391190.718577:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff95d6bc68e680 x1875263094195200/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.718591:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68e680 with x1875263094195200 ext(8388608->9437183) 00002000:00010000:0.0:1788391190.718596:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68e680 00000100:00100000:0.0:1788391190.718633:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788391190.718645:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2356:x1875263094195200:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.730669:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2356:x1875263094195200:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12014us (12377us total) trans 30064771104 rc 0/0 00000100:00100000:0.0:1788391190.730684:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00002000:00100000:0.0:1788391190.730699:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff95d6bc68e680 x1875263094195200/t30064771104(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.730732:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68e680 with x1875263094195200 ext(8388608->9437183) 00002000:00010000:0.0:1788391190.730738:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68e680 00000100:00100000:3.0:1788391190.738269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.738343:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195328 00000100:00100000:1.0:1788391190.738354:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195328 00002000:00100000:1.0:1788391190.738408:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff95d6bc68d880 x1875263094195328/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.738420:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68d880 with x1875263094195328 ext(9437184->10485759) 00002000:00010000:1.0:1788391190.738426:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68d880 00000100:00100000:1.0:1788391190.738503:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:1.0:1788391190.738514:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2357:x1875263094195328:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.747761:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2357:x1875263094195328:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9237us (9491us total) trans 30064771105 rc 0/0 00000100:00100000:0.0:1788391190.747776:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00002000:00100000:0.0:1788391190.747788:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff95d6bc68d880 x1875263094195328/t30064771105(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.747799:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68d880 with x1875263094195328 ext(9437184->10485759) 00002000:00010000:0.0:1788391190.747806:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68d880 00000100:00100000:1.0:1788391190.760779:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391190.760925:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195456 00000100:00100000:2.0:1788391190.760935:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195456 00002000:00100000:2.0:1788391190.761027:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff95d58c3ece00 x1875263094195456/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.761038:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ece00 with x1875263094195456 ext(10485760->11534335) 00002000:00010000:2.0:1788391190.761044:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ece00 00000100:00100000:2.0:1788391190.761067:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:2.0:1788391190.761078:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094195456:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391190.777708:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094195456:12345-192.168.202.1@tcp:4:dd.0 Request processed in 16617us (16924us total) trans 30064771106 rc 0/0 00000100:00100000:2.0:1788391190.777723:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00002000:00100000:2.0:1788391190.777738:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff95d58c3ece00 x1875263094195456/t30064771106(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.777749:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ece00 with x1875263094195456 ext(10485760->11534335) 00002000:00010000:2.0:1788391190.777761:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ece00 00000100:00100000:2.0:1788391190.780619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.780728:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195584 00000100:00100000:0.0:1788391190.780739:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195584 00002000:00100000:0.0:1788391190.780792:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff95d68fc59f80 x1875263094195584/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.780803:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59f80 with x1875263094195584 ext(11534336->12582911) 00002000:00010000:0.0:1788391190.780808:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc59f80 00000100:00100000:0.0:1788391190.780884:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788391190.780896:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2358:x1875263094195584:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.795509:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2358:x1875263094195584:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14605us (14888us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788391190.795534:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00002000:00100000:0.0:1788391190.795546:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff95d68fc59f80 x1875263094195584/t30064771107(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.795577:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68fc59f80 with x1875263094195584 ext(11534336->12582911) 00002000:00010000:0.0:1788391190.795583:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68fc59f80 00000100:00100000:2.0:1788391190.802792:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.802887:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195712 00000100:00100000:0.0:1788391190.802896:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195712 00002000:00100000:0.0:1788391190.802949:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff95d58ac65180 x1875263094195712/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.802992:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65180 with x1875263094195712 ext(12582912->13631487) 00002000:00010000:0.0:1788391190.802999:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ac65180 00000100:00100000:0.0:1788391190.803027:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1788391190.803038:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2356:x1875263094195712:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391190.815235:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2356:x1875263094195712:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12187us (12441us total) trans 30064771108 rc 0/0 00000100:00100000:2.0:1788391190.815264:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00002000:00100000:2.0:1788391190.815277:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff95d58ac65180 x1875263094195712/t30064771108(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.815288:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65180 with x1875263094195712 ext(12582912->13631487) 00002000:00010000:2.0:1788391190.815293:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ac65180 00000100:00100000:0.0:1788391190.829334:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.829677:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195840 00000100:00100000:1.0:1788391190.829687:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195840 00002000:00100000:1.0:1788391190.829736:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff95d58c3e9180 x1875263094195840/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.829748:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e9180 with x1875263094195840 ext(13631488->14680063) 00002000:00010000:1.0:1788391190.829754:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e9180 00000100:00100000:1.0:1788391190.829827:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788391190.829838:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2356:x1875263094195840:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391190.839929:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2356:x1875263094195840:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10080us (10594us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1788391190.839943:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00002000:00100000:1.0:1788391190.839955:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff95d58c3e9180 x1875263094195840/t30064771109(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391190.839987:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e9180 with x1875263094195840 ext(13631488->14680063) 00002000:00010000:1.0:1788391190.839994:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e9180 00000100:00100000:3.0:1788391190.859551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.859612:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391190.860181:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196224 00000100:00100000:1.0:1788391190.860193:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196224 00000100:00100000:1.0:1788391190.860253:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1788391190.860263:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:36370:x1875263094196224:12345-192.168.202.1@tcp:35:dd.0 00000001:00080000:1.0:1788391190.860753:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771304 00000100:00100000:1.0:1788391190.860925:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36370:x1875263094196224:12345-192.168.202.1@tcp:35:dd.0 Request processed in 661us (1382us total) trans 30064771305 rc 0/0 00000100:00100000:1.0:1788391190.860934:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00080000:1.0:1788391190.860939:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788391190.861029:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094195968 00000100:00100000:2.0:1788391190.861035:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094195968 00002000:00100000:2.0:1788391190.861067:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff95d6bc68d500 x1875263094195968/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391190.861076:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68d500 with x1875263094195968 ext(14680064->15728639) 00002000:00010000:2.0:1788391190.861081:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68d500 00000100:00100000:2.0:1788391190.861113:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391190.861121:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2357:x1875263094195968:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391190.877312:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2357:x1875263094195968:12345-192.168.202.1@tcp:4:dd.0 Request processed in 16178us (17687us total) trans 30064771110 rc 0/0 00000100:00100000:3.0:1788391190.877344:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00002000:00100000:3.0:1788391190.877358:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff95d6bc68d500 x1875263094195968/t30064771110(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391190.877514:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68d500 with x1875263094195968 ext(14680064->15728639) 00002000:00010000:3.0:1788391190.877532:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68d500 00000100:00100000:1.0:1788391190.877886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.878571:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196480 00000100:00100000:3.0:1788391190.878581:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196480 00000100:00100000:3.0:1788391190.878691:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:3.0:1788391190.878702:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36372:x1875263094196480:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391190.878726:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391190.878746:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37767 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000f7 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878869:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878883:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878895:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878910:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878918:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.878942:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391190.879557:0:42646:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc7:0x0], index 1: 0 00010000:00010000:3.0:1788391190.879721:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3777c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879732:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3777c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879741:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3777c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879774:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879781:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879788:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879794:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391190.879798:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879805:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879818:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391190.879821:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391190.879834:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879840:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3776e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391190.879854:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000684b56df reply state 00000000da8a4607 transno 30064771306 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391190.879862:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391190.879894:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1400/0x9aafc5f04cd37767 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f7 expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879907:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3777c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f7 expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.879915:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391190.879917:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391190.879920:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391190.880040:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:36372:x1875263094196480:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1338us (2154us total) trans 30064771306 rc 0/0 00000100:00100000:3.0:1788391190.880048:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 273 00010000:00010000:2.0:1788391190.882098:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882116:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882123:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882130:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391190.882135:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882155:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882170:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff95d686a70500) 00010000:00010000:2.0:1788391190.882173:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391190.882178:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391190.882184:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37775 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391190.890656:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.890805:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196608 00000100:00100000:3.0:1788391190.890814:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196608 00000100:00100000:3.0:1788391190.890934:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1788391190.890947:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:36372:x1875263094196608:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391190.890998:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391190.891020:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3778a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc000fe expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391190.891070:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391190.891092:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=1007s v=(0 0) 00010000:00010000:3.0:1788391190.891097:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391190.891106:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3778a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000fe expref: 9 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.891123:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006148567/0x9aafc5f04cd3778a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000fe expref: 9 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391190.891138:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1400, rc 0) 00000100:00100000:3.0:1788391190.891208:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:36372:x1875263094196608:12345-192.168.202.1@tcp:101:dd.0 Request processed in 264us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391190.891215:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00080000:0.0:1788391190.891542:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391190.904600:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.904705:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196736 00000100:00100000:0.0:1788391190.904716:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196736 00002000:00100000:0.0:1788391190.904786:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff95d58c3ef100 x1875263094196736/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.904798:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ef100 with x1875263094196736 ext(0->1048575) 00002000:00010000:0.0:1788391190.904805:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ef100 00000100:00100000:0.0:1788391190.904840:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788391190.904851:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2359:x1875263094196736:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391190.926805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.926898:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196864 00000100:00100000:3.0:1788391190.926906:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196864 00002000:00100000:3.0:1788391190.926958:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff95d58ac64380 x1875263094196864/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391190.926986:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac64380 with x1875263094196864 ext(1048576->2097151) 00002000:00010000:3.0:1788391190.926997:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac64380 00000100:00100000:3.0:1788391190.927030:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1788391190.927036:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094196864:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391190.931378:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2359:x1875263094196736:12345-192.168.202.1@tcp:4:dd.0 Request processed in 26517us (26777us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1788391190.931406:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00002000:00100000:0.0:1788391190.931418:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff95d58c3ef100 x1875263094196736/t30064771163(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.931427:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ef100 with x1875263094196736 ext(0->1048575) 00002000:00010000:0.0:1788391190.931433:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ef100 00000100:00100000:1.0:1788391190.932932:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.933003:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094196992 00000100:00100000:0.0:1788391190.933014:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094196992 00002000:00100000:0.0:1788391190.933068:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff95d58c3ef480 x1875263094196992/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.933079:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ef480 with x1875263094196992 ext(2097152->3145727) 00002000:00010000:0.0:1788391190.933084:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ef480 00000100:00100000:0.0:1788391190.933157:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1788391190.933167:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094196992:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391190.954925:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094196864:12345-192.168.202.1@tcp:4:dd.0 Request processed in 27875us (28115us total) trans 30064771164 rc 0/0 00000100:00100000:3.0:1788391190.954940:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00002000:00100000:3.0:1788391190.954989:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff95d58ac64380 x1875263094196864/t30064771164(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391190.954999:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac64380 with x1875263094196864 ext(1048576->2097151) 00002000:00010000:3.0:1788391190.955005:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ac64380 00000100:00100000:0.0:1788391190.958321:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094196992:12345-192.168.202.1@tcp:4:dd.0 Request processed in 25146us (25387us total) trans 30064771165 rc 0/0 00000100:00100000:0.0:1788391190.958334:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00002000:00100000:0.0:1788391190.958345:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff95d58c3ef480 x1875263094196992/t30064771165(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.958356:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ef480 with x1875263094196992 ext(2097152->3145727) 00002000:00010000:0.0:1788391190.958361:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ef480 00000100:00100000:2.0:1788391190.958749:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391190.958796:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197120 00000100:00100000:0.0:1788391190.958805:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197120 00002000:00100000:0.0:1788391190.958845:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff95d6bc7c9f80 x1875263094197120/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391190.958875:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9f80 with x1875263094197120 ext(3145728->4194303) 00002000:00010000:0.0:1788391190.958880:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c9f80 00000100:00100000:0.0:1788391190.958953:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1788391190.958984:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094197120:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391190.972527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391190.972897:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197248 00000100:00100000:3.0:1788391190.972908:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197248 00002000:00100000:3.0:1788391190.972956:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff95d6bc7cb800 x1875263094197248/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391190.973256:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cb800 with x1875263094197248 ext(4194304->5242879) 00002000:00010000:3.0:1788391190.973262:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7cb800 00000100:00100000:2.0:1788391190.973394:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1788391190.973406:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094197248:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391190.998395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391191.004711:0:43333:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788391191.004735:0:43333:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788391191.008535:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197376 00000100:00100000:1.0:1788391191.008547:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197376 00002000:00100000:1.0:1788391191.008600:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff95d58c3efb80 x1875263094197376/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/0 e 0 to 0 dl 1788391201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.008611:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3efb80 with x1875263094197376 ext(5242880->6291455) 00002000:00010000:1.0:1788391191.008625:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3efb80 00000100:00100000:2.0:1788391191.010629:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1788391191.010655:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094197376:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391191.011897:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094197120:12345-192.168.202.1@tcp:4:dd.0 Request processed in 52926us (53139us total) trans 30064771166 rc 0/0 00000100:00100000:0.0:1788391191.011918:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00002000:00100000:0.0:1788391191.011937:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff95d6bc7c9f80 x1875263094197120/t30064771166(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.011951:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c9f80 with x1875263094197120 ext(3145728->4194303) 00002000:00010000:0.0:1788391191.013167:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c9f80 00000100:00100000:3.0:1788391191.018862:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094197248:12345-192.168.202.1@tcp:4:dd.0 Request processed in 45447us (46345us total) trans 30064771167 rc 0/0 00000100:00100000:3.0:1788391191.018876:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00002000:00100000:3.0:1788391191.018889:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff95d6bc7cb800 x1875263094197248/t30064771167(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391191.018899:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7cb800 with x1875263094197248 ext(4194304->5242879) 00002000:00010000:3.0:1788391191.018905:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7cb800 00000100:00100000:1.0:1788391191.023536:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.023602:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197504 00000100:00100000:1.0:1788391191.023614:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197504 00002000:00100000:1.0:1788391191.023677:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff95d58c3ed880 x1875263094197504/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.023692:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ed880 with x1875263094197504 ext(6291456->7340031) 00002000:00010000:1.0:1788391191.023700:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ed880 00000100:00100000:1.0:1788391191.023738:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1788391191.023752:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2357:x1875263094197504:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391191.031993:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2357:x1875263094197504:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8235us (8569us total) trans 30064771169 rc 0/0 00000100:00100000:1.0:1788391191.032007:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00002000:00100000:1.0:1788391191.032020:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff95d58c3ed880 x1875263094197504/t30064771169(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.032030:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ed880 with x1875263094197504 ext(6291456->7340031) 00002000:00010000:1.0:1788391191.032036:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3ed880 00000100:00100000:2.0:1788391191.032198:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094197376:12345-192.168.202.1@tcp:4:dd.0 Request processed in 21552us (33810us total) trans 30064771168 rc 0/0 00000100:00100000:2.0:1788391191.032206:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00002000:00100000:2.0:1788391191.032212:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff95d58c3efb80 x1875263094197376/t30064771168(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:51/0 lens 488/448 e 0 to 0 dl 1788391201 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391191.032221:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3efb80 with x1875263094197376 ext(5242880->6291455) 00002000:00010000:2.0:1788391191.032240:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3efb80 00000100:00100000:2.0:1788391191.032931:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.033128:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197632 00000100:00100000:0.0:1788391191.033136:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197632 00002000:00100000:0.0:1788391191.033175:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff95d6bc7c8000 x1875263094197632/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.033184:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8000 with x1875263094197632 ext(7340032->8388607) 00002000:00010000:0.0:1788391191.033188:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8000 00000100:00100000:0.0:1788391191.033243:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1788391191.033253:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094197632:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391191.045911:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094197632:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12648us (12970us total) trans 30064771170 rc 0/0 00000100:00100000:2.0:1788391191.045926:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00002000:00100000:2.0:1788391191.045939:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff95d6bc7c8000 x1875263094197632/t30064771170(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391191.045949:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8000 with x1875263094197632 ext(7340032->8388607) 00002000:00010000:2.0:1788391191.045956:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8000 00000100:00100000:3.0:1788391191.047395:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.047607:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197760 00000100:00100000:1.0:1788391191.047620:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197760 00002000:00100000:1.0:1788391191.047898:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff95d584a0d180 x1875263094197760/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.047908:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0d180 with x1875263094197760 ext(8388608->9437183) 00002000:00010000:1.0:1788391191.047914:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0d180 00000100:00100000:1.0:1788391191.048072:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391191.048082:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094197760:12345-192.168.202.1@tcp:4:dd.0 00000040:00080000:0.0:1788391191.053612:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391191.053621:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391191.059291:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:1.0:1788391191.059309:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391191.061070:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.061249:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094197888 00000100:00100000:1.0:1788391191.061261:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094197888 00002000:00100000:1.0:1788391191.061321:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff95d687861f80 x1875263094197888/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.061333:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861f80 with x1875263094197888 ext(9437184->10485759) 00002000:00010000:1.0:1788391191.061340:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687861f80 00000100:00100000:1.0:1788391191.061457:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:1.0:1788391191.061469:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094197888:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391191.063372:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094197760:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15280us (15993us total) trans 30064771171 rc 0/0 00000100:00100000:2.0:1788391191.063388:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00002000:00100000:2.0:1788391191.063403:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff95d584a0d180 x1875263094197760/t30064771171(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391191.063414:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0d180 with x1875263094197760 ext(8388608->9437183) 00002000:00010000:2.0:1788391191.063420:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0d180 00000100:00100000:1.0:1788391191.071756:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094197888:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10277us (10686us total) trans 30064771172 rc 0/0 00000100:00100000:1.0:1788391191.071771:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00002000:00100000:1.0:1788391191.071785:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff95d687861f80 x1875263094197888/t30064771172(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.071796:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687861f80 with x1875263094197888 ext(9437184->10485759) 00002000:00010000:1.0:1788391191.071803:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d687861f80 00000100:00100000:2.0:1788391191.073346:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.073433:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198016 00000100:00100000:0.0:1788391191.073442:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198016 00002000:00100000:0.0:1788391191.073501:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff95d6bc7c8a80 x1875263094198016/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.073508:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8a80 with x1875263094198016 ext(10485760->11534335) 00002000:00010000:0.0:1788391191.073511:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8a80 00000100:00100000:0.0:1788391191.073581:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1788391191.073592:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094198016:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391191.079880:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094198016:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6279us (6531us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1788391191.079894:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00002000:00100000:2.0:1788391191.079907:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff95d6bc7c8a80 x1875263094198016/t30064771173(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391191.079916:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc7c8a80 with x1875263094198016 ext(10485760->11534335) 00002000:00010000:2.0:1788391191.079922:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc7c8a80 00000100:00100000:0.0:1788391191.086120:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.086694:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198144 00000100:00100000:3.0:1788391191.086705:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198144 00002000:00100000:1.0:1788391191.086841:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff95d58c3e8700 x1875263094198144/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.086853:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8700 with x1875263094198144 ext(11534336->12582911) 00002000:00010000:1.0:1788391191.086860:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3e8700 00000100:00100000:1.0:1788391191.086896:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:1.0:1788391191.086909:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094198144:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391191.095485:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094198144:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8563us (9358us total) trans 30064771174 rc 0/0 00000100:00100000:3.0:1788391191.095504:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00002000:00100000:3.0:1788391191.095534:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff95d58c3e8700 x1875263094198144/t30064771174(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391191.095567:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8700 with x1875263094198144 ext(11534336->12582911) 00002000:00010000:3.0:1788391191.095576:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3e8700 00000100:00100000:2.0:1788391191.110169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.110264:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198272 00000100:00100000:1.0:1788391191.110273:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198272 00002000:00100000:1.0:1788391191.110321:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff95d5872e8700 x1875263094198272/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.110332:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e8700 with x1875263094198272 ext(12582912->13631487) 00002000:00010000:1.0:1788391191.110338:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e8700 00000100:00100000:1.0:1788391191.110406:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:1.0:1788391191.110416:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2356:x1875263094198272:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391191.129263:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094198272:12345-192.168.202.1@tcp:4:dd.0 Request processed in 18835us (19091us total) trans 30064771175 rc 0/0 00000100:00100000:1.0:1788391191.129279:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00002000:00100000:1.0:1788391191.129292:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff95d5872e8700 x1875263094198272/t30064771175(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391191.129303:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e8700 with x1875263094198272 ext(12582912->13631487) 00002000:00010000:1.0:1788391191.129309:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e8700 00000100:00100000:2.0:1788391191.139489:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.139614:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198400 00000100:00100000:0.0:1788391191.139632:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198400 00002000:00100000:0.0:1788391191.139693:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff95d5872e8000 x1875263094198400/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.139705:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e8000 with x1875263094198400 ext(13631488->14680063) 00002000:00010000:0.0:1788391191.139711:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e8000 00000100:00100000:0.0:1788391191.139746:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1788391191.139758:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2358:x1875263094198400:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391191.155324:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2358:x1875263094198400:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15555us (15833us total) trans 30064771176 rc 0/0 00000100:00100000:0.0:1788391191.155340:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00002000:00100000:0.0:1788391191.155357:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff95d5872e8000 x1875263094198400/t30064771176(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.155367:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5872e8000 with x1875263094198400 ext(13631488->14680063) 00002000:00010000:0.0:1788391191.155374:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5872e8000 00000100:00100000:3.0:1788391191.167824:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.167939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.167992:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198784 00000100:00100000:3.0:1788391191.168002:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198784 00000100:00100000:3.0:1788391191.168058:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391191.168069:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36372:x1875263094198784:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:3.0:1788391191.168409:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:36372:x1875263094198784:12345-192.168.202.1@tcp:35:dd.0 Request processed in 341us (468us total) trans 30064771307 rc 0/0 00000100:00100000:3.0:1788391191.168424:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391191.168468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.169029:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198528 00000100:00100000:0.0:1788391191.169036:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198528 00002000:00100000:0.0:1788391191.169095:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff95d69111aa00 x1875263094198528/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/0 e 0 to 0 dl 1788391202 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391191.169105:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111aa00 with x1875263094198528 ext(14680064->15728639) 00002000:00010000:0.0:1788391191.169112:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111aa00 00000100:00100000:0.0:1788391191.169144:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1788391191.169154:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2358:x1875263094198528:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391191.169375:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094198912 00000100:00100000:0.0:1788391191.169379:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094198912 00000100:00100000:0.0:1788391191.169409:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1788391191.169417:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094198912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391191.169457:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094198912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.169464:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:3.0:1788391191.178012:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094198528:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8848us (10186us total) trans 30064771177 rc 0/0 00000100:00100000:3.0:1788391191.178028:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00002000:00100000:3.0:1788391191.178042:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff95d69111aa00 x1875263094198528/t30064771177(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:52/0 lens 488/448 e 0 to 0 dl 1788391202 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391191.178053:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111aa00 with x1875263094198528 ext(14680064->15728639) 00002000:00010000:3.0:1788391191.178060:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111aa00 00000100:00100000:0.0:1788391191.192388:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.192507:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199040 00000100:00100000:1.0:1788391191.192740:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199040 00000100:00100000:1.0:1788391191.192802:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 274 00000100:00100000:1.0:1788391191.192812:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:36373:x1875263094199040:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391191.192835:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391191.192854:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37791 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00105 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.192887:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.192915:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.192927:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.193291:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37791 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.193309:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.193318:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.193321:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391191.193324:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6600, rc 0) 00000100:00100000:0.0:1788391191.193421:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36373:x1875263094199040:12345-192.168.202.1@tcp:101:chown.0 Request processed in 609us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.193429:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 274 00000100:00100000:2.0:1788391191.196343:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.196429:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199296 00000100:00100000:3.0:1788391191.196440:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199296 00000100:00100000:3.0:1788391191.196498:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:3.0:1788391191.196508:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36373:x1875263094199296:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:3.0:1788391191.196574:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391191.196636:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37752 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000e9 expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.196657:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:3.0:1788391191.196662:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391191.196693:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.196707:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.196717:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391191.197184:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].9, 88 off8840 00000004:00080000:3.0:1788391191.197195:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1008304233744ns, next at 1009304231507ns, rc = 0 00000004:00010000:3.0:1788391191.197279:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e49de1f0 reply state 00000000a3e7c7fd transno 30064771308 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.197288:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391191.197379:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36373:x1875263094199296:12345-192.168.202.1@tcp:36:chown.0 Request processed in 871us (1043us total) trans 30064771308 rc 0/0 00000100:00100000:3.0:1788391191.197387:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 275 00010000:00010000:2.0:1788391191.199859:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199876:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199884:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199890:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391191.199896:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199903:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199921:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:2.0:1788391191.199924:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391191.199929:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.199935:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3779f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391191.207607:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.209159:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199424 00000100:00100000:3.0:1788391191.209173:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199424 00000100:00100000:3.0:1788391191.209281:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:3.0:1788391191.209292:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36373:x1875263094199424:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788391191.209319:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391191.209341:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0010c expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.209425:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 27 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.209441:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 27 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.209463:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:3.0:1788391191.209466:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391191.209471:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:3.0:1788391191.209551:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6a0da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36373:x1875263094199424:12345-192.168.202.1@tcp:101:chown.0 Request processed in 260us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391191.209558:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:1.0:1788391191.214279:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.214369:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199552 00000100:00100000:0.0:1788391191.214379:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199552 00000100:00100000:0.0:1788391191.214443:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788391191.214454:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2356:x1875263094199552:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:0.0:1788391191.214672:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:0.0:1788391191.214676:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788391191 00002000:00010000:0.0:1788391191.214679:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391191.214681:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788391191 00002000:00010000:0.0:1788391191.214683:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391191.214745:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2356:x1875263094199552:12345-192.168.202.1@tcp:2:chown.0 Request processed in 292us (475us total) trans 30064771111 rc 0/0 00000100:00100000:0.0:1788391191.214753:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788391191.234107:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.234227:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199680 00000100:00100000:3.0:1788391191.234248:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199680 00000100:00100000:2.0:1788391191.235476:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:2.0:1788391191.235490:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36374:x1875263094199680:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391191.235545:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391191.235566:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd377ad lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00113 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235607:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd377b4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235622:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd377b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235633:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd377b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235737:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd377ad lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00113 expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235757:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f800/0x9aafc5f04cd377b4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00113 expref: 28 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.235766:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:2.0:1788391191.235769:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391191.235772:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f800, rc 0) 00000100:00100000:2.0:1788391191.235846:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36374:x1875263094199680:12345-192.168.202.1@tcp:101:chown.0 Request processed in 358us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391191.235853:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:2.0:1788391191.246363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.246478:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094199936 00000100:00100000:0.0:1788391191.246488:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094199936 00000100:00100000:0.0:1788391191.246829:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 278 00000100:00100000:0.0:1788391191.246841:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36374:x1875263094199936:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:0.0:1788391191.246897:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391191.246924:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd3777c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f7 expref: 28 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.246944:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:0.0:1788391191.246948:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391191.247036:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.247051:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.247081:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391191.247945:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].9, 88 off8912 00000004:00080000:0.0:1788391191.247957:0:43348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1008354995656ns, next at 1009354993483ns, rc = 0 00000004:00010000:0.0:1788391191.248069:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008679e498 reply state 00000000ccf6d1ed transno 30064771309 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.248080:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391191.248184:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:36374:x1875263094199936:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1343us (1829us total) trans 30064771309 rc 0/0 00000100:00100000:0.0:1788391191.248193:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 278 00000100:00100000:2.0:1788391191.251130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.251266:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200064 00000100:00100000:3.0:1788391191.251287:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200064 00000100:00100000:3.0:1788391191.251350:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:3.0:1788391191.251359:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:36374:x1875263094200064:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788391191.251389:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391191.251410:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd377c2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0011a expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.251480:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd377c2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0011a expref: 30 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.251493:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0800/0x9aafc5f04cd377c2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0011a expref: 30 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.251543:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391191.251546:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391191.251549:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0800, rc 0) 00000100:00100000:3.0:1788391191.251619:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:36374:x1875263094200064:12345-192.168.202.1@tcp:101:chown.0 Request processed in 259us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391191.251626:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 279 00010000:00010000:1.0:1788391191.253884:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.253903:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.253912:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.253918:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391191.253923:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.253932:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.253952:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:1.0:1788391191.253955:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788391191.254094:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788391191.254158:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.254167:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd377bb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.254189:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200192 00000100:00100000:3.0:1788391191.254205:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200192 00000100:00100000:3.0:1788391191.254269:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391191.254278:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094200192:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:3.0:1788391191.254640:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1788391191.254644:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788391191 00002000:00010000:3.0:1788391191.254646:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391191.254648:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788391191 00002000:00010000:3.0:1788391191.254651:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391191.254790:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094200192:12345-192.168.202.1@tcp:2:chown.0 Request processed in 511us (701us total) trans 30064771178 rc 0/0 00000100:00100000:3.0:1788391191.254800:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788391191.293875:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.294012:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200320 00000100:00100000:3.0:1788391191.294029:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200320 00000100:00100000:3.0:1788391191.294106:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:3.0:1788391191.294120:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:36380:x1875263094200320:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391191.294151:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391191.294225:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd377c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00121 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391191.297069:0:42645:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2770us 00010000:00010000:3.0:1788391191.321951:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.322038:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.322048:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391191.322091:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00000004:00200000:3.0:1788391191.322094:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391191.322167:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.322194:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd377c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00121 expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.322206:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00121 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.322213:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391191.322214:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391191.322217:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391191.322273:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:36380:x1875263094200320:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 28158us (28409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391191.322280:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:0.0:1788391191.324221:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.324260:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200448 00000100:00100000:1.0:1788391191.324269:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200448 00000100:00100000:3.0:1788391191.324329:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:3.0:1788391191.324340:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:36380:x1875263094200448:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391191.324358:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391191.324381:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd377d7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00128 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324427:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324436:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324442:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324451:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324455:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324459:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324549:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324555:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324559:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391191.324581:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00000004:00200000:3.0:1788391191.324584:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391191.324595:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324608:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324613:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324618:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324622:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324626:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391191.324629:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324634:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324642:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391191.324644:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391191.324646:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324650:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd377de lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324657:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324661:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324667:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324670:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391191.324672:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324675:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324679:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff95d686a70200) 00010000:00010000:3.0:1788391191.324680:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391191.324682:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324685:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd377e5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324704:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd377d7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 32 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324711:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 31 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.324715:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:3.0:1788391191.324716:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391191.324717:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:3.0:1788391191.324759:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:36380:x1875263094200448:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 423us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391191.324770:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:2.0:1788391191.327181:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.327315:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200704 00000100:00100000:0.0:1788391191.327322:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200704 00000100:00100000:0.0:1788391191.327369:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:0.0:1788391191.327376:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:36380:x1875263094200704:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391191.327391:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391191.327403:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd377f3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0012f expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.327489:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd377fa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.327500:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd377fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.327528:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd377fa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391191.327538:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:0.0:1788391191.327640:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd377f3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0012f expref: 34 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.327652:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd377fa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0012f expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.327658:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.327660:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391191.327662:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:0.0:1788391191.327708:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:36380:x1875263094200704:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 332us (533us total) trans 30064771310 rc 0/0 00000100:00100000:0.0:1788391191.327714:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:2.0:1788391191.333547:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391191.333635:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.333738:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201088 00000100:00100000:0.0:1788391191.333748:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201088 00000100:00100000:0.0:1788391191.333803:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:0.0:1788391191.333813:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:36380:x1875263094201088:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391191.333836:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391191.333856:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37808 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00136 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.333945:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.334015:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.334027:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391191.334040:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:0.0:1788391191.334159:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37808 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00136 expref: 36 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.334177:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00136 expref: 35 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.334185:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.334188:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391191.334191:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788391191.334235:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:36380:x1875263094201088:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 424us (600us total) trans 30064771311 rc 0/0 00000100:00100000:0.0:1788391191.334242:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:1.0:1788391191.334753:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094200832 00000100:00100000:1.0:1788391191.334760:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094200832 00000100:00100000:1.0:1788391191.334838:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1788391191.334846:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094200832:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391191.334857:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391191.334869:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd377fa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0012f expref: 35 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.334882:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:1.0:1788391191.334886:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391191.334917:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2357:x1875263094200832:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 72us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391191.334923:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1788391191.455327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.455406:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201216 00000100:00100000:3.0:1788391191.455416:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201216 00000100:00100000:3.0:1788391191.455479:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1788391191.455492:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2359:x1875263094201216:12345-192.168.202.1@tcp:1:lfs.500 00010000:00010000:3.0:1788391191.455545:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.455566:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 37 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.455575:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788391191.455579:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391191.455583:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.455616:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 37 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.455630:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 37 pid: 44885 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.455644:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103473536:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391191.455726:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391191.459226:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103473536:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391191.459259:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391191.476382:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.476657:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201344 00000100:00100000:1.0:1788391191.476667:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201344 00010000:00010000:1.0:1788391191.476707:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 38 pid: 44885 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391191.476749:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1788391191.476759:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2357:x1875263094201344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391191.476772:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391191.476801:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 38 pid: 44885 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.476815:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 38 pid: 44885 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.476838:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea5407ef/0x9aafc5f04cd37760 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000f0 expref: 38 pid: 44885 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.476855:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391191.476860:0:42630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391191.476866:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.476876:0:42630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.476912:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391191.477056:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2357:x1875263094201344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 297us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391191.477063:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00010000:00010000:2.0:1788391191.477160:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477170:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477193:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477201:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477209:0:43327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477216:0:43327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391191.477220:0:43327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477228:0:43327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477240:0:43327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.477256:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd3781d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391191.477320:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2359:x1875263094201216:12345-192.168.202.1@tcp:1:lfs.500 Request processed in 21832us (22003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391191.477328:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788391191.482214:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.482297:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201600 00000100:00100000:3.0:1788391191.482308:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201600 00000100:00100000:3.0:1788391191.482374:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788391191.482385:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:36380:x1875263094201600:12345-192.168.202.1@tcp:35:lfs.500 00000004:00010000:3.0:1788391191.482457:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00136 expref: 34 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391191.482783:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771312 00000001:00080000:3.0:1788391191.482845:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771313 00000001:00080000:3.0:1788391191.484088:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771314 00010000:00010000:3.0:1788391191.484148:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484167:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 38 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484175:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 38 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484183:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484191:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484224:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484245:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 38 pid: 42645 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.484260:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473664:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391191.484442:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 38 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484451:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 38 pid: 42644 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.484460:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69111ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473792:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391191.484491:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 38 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.484500:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 38 pid: 43348 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.484509:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473920:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391191.484543:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b5138900 going to sleep for 11 seconds 00000100:00100000:3.0:1788391191.487130:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69111ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473792:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391191.487147:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473664:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391191.489291:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103473920:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391191.489325:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.491124:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.491164:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.491198:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.491322:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201728 00000100:00100000:1.0:1788391191.491331:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201728 00010000:00010000:1.0:1788391191.491372:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 39 pid: 42645 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391191.491408:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201984 00000100:00100000:1.0:1788391191.491411:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201984 00010000:00010000:1.0:1788391191.491440:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 40 pid: 42644 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.491449:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094201856 00000100:00100000:0.0:1788391191.491455:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094201856 00000100:00100000:1.0:1788391191.491459:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1788391191.491470:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094201728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391191.491483:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 41 pid: 43348 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.491484:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391191.491495:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 41 pid: 42645 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.491511:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00010000:00010000:1.0:1788391191.491525:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 41 pid: 42645 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.491531:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094201984:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391191.491553:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391191.491557:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd377a6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0010c expref: 41 pid: 42645 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.491561:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 41 pid: 42644 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.491580:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 40 pid: 42644 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391191.491624:0:42631:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788391191.491632:0:42631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1788391191.491672:0:42630:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788391191.491679:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1788391191.491684:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094201856:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391191.491690:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391191.491694:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 40 pid: 43348 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.491755:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:1.0:1788391191.491761:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.491769:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.491775:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391191.491823:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094201728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 355us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391191.491831:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00010000:00010000:0.0:1788391191.492771:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd377ec lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00128 expref: 39 pid: 42644 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.492786:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.492790:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.492798:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.492804:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391191.492875:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2356:x1875263094201984:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1348us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.492883:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00010000:00010000:3.0:1788391191.493019:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 37 pid: 43348 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.493034:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37798 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00105 expref: 37 pid: 43348 timeout: 1108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.493045:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:3.0:1788391191.493048:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.493056:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.493063:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.493169:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391191.493193:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2357:x1875263094201856:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1507us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391191.493201:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00010000:00010000:3.0:1788391191.493286:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.493294:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391191.493582:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771315 00000001:00080000:3.0:1788391191.493790:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771316 00000100:00100000:3.0:1788391191.493894:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103474048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391191.494009:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391191.494033:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788391191.494201:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103474048 00000100:00100000:2.0:1788391191.494208:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103474048 00000100:00100000:2.0:1788391191.494279:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788391191.494288:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103474048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391191.494361:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103474048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391191.494377:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788391191.494610:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103474048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788391191.495174:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771317 00000100:00100000:3.0:1788391191.495228:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103474176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391191.495256:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391191.495267:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d691559480 going to sleep for 11 seconds 00000100:00080000:0.0:1788391191.495334:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391191.495503:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103474176 00000100:00100000:2.0:1788391191.495508:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103474176 00000100:00100000:2.0:1788391191.495548:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788391191.495557:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103474176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391191.495685:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103474176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (427us total) trans 30064771112 rc 0/0 00000100:00100000:2.0:1788391191.495691:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788391191.495750:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103474176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788391191.495801:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771318 00010000:00010000:0.0:1788391191.495834:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495843:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495858:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495863:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.495867:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495873:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495888:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.495890:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788391191.495894:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.495900:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37824 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391191.496136:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788391191.496196:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].10, 64 off8904 00000001:00080000:0.0:1788391191.496203:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771319 00010000:00010000:0.0:1788391191.496229:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.496232:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391191.496238:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3780f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00136 expref: 40 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.496319:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:36380:x1875263094201600:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 13935us (14113us total) trans 30064771320 rc 0/0 00000100:00100000:0.0:1788391191.496341:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000020:00080000:0.0:1788391191.496352:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788391191.498756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.498827:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094202112 00000100:00100000:0.0:1788391191.498837:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094202112 00000100:00100000:0.0:1788391191.498898:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:0.0:1788391191.498910:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:36380:x1875263094202112:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391191.498934:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391191.498956:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3782b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0013d expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.499055:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3782b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0013d expref: 40 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.499069:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3782b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0013d expref: 40 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.499087:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391191.499090:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391191.499093:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fae00, rc 0) 00000100:00100000:0.0:1788391191.499147:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:36380:x1875263094202112:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 240us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.499155:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 284 00010000:00010000:3.0:1788391191.501362:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391191.508621:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.511982:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094202368 00000100:00100000:0.0:1788391191.511996:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094202368 00000100:00100000:0.0:1788391191.512057:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1788391191.512069:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:36380:x1875263094202368:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:0.0:1788391191.512303:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:36380:x1875263094202368:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 235us (3690us total) trans 30064771321 rc 0/0 00000100:00100000:0.0:1788391191.512479:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000001:00080000:1.0:1788391191.558398:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771111 is committed 00000001:00080000:1.0:1788391191.558475:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771112 is committed 00000100:00100000:1.0:1788391191.578688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.578756:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094202496 00000100:00100000:0.0:1788391191.578767:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094202496 00000100:00100000:0.0:1788391191.578896:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:0.0:1788391191.578909:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:36387:x1875263094202496:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391191.578933:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391191.579007:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37832 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00144 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579076:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579092:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579105:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579122:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579141:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579149:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579245:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579272:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579279:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391191.579307:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00000004:00200000:0.0:1788391191.579311:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391191.579345:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579357:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579365:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579371:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579378:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579384:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.579389:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579396:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579408:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391191.579416:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391191.579421:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579427:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd37839 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579442:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579448:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579466:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579471:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.579475:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579481:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579489:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.579491:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391191.579494:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579500:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37840 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579542:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37832 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00144 expref: 43 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579564:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb800/0x9aafc5f04cd37847 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00144 expref: 42 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.579572:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:0.0:1788391191.579574:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391191.579577:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb800, rc 0) 00000100:00100000:0.0:1788391191.579660:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:36387:x1875263094202496:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 754us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.579668:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:0.0:1788391191.587058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391191.587133:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094202752 00000100:00100000:2.0:1788391191.587157:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094202752 00000100:00100000:2.0:1788391191.587208:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:2.0:1788391191.587216:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:36387:x1875263094202752:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391191.587233:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391191.587249:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd3784e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0014b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.587341:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd37855 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.587355:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd37855 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.587366:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd37855 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391191.587375:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:2.0:1788391191.587506:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd3784e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0014b expref: 45 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.587533:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd37855 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0014b expref: 44 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.587543:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:2.0:1788391191.587546:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391191.587550:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391191.587647:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:36387:x1875263094202752:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 431us (597us total) trans 30064771322 rc 0/0 00000100:00100000:2.0:1788391191.587655:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:1.0:1788391191.590612:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.590708:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094202880 00000100:00100000:3.0:1788391191.590719:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094202880 00000100:00100000:3.0:1788391191.590785:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1788391191.590795:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2358:x1875263094202880:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391191.590809:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391191.590832:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd37855 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0014b expref: 44 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.590851:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391191.590869:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391191.590924:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2358:x1875263094202880:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 130us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391191.590932:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1788391191.592843:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.593016:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094203136 00000100:00100000:3.0:1788391191.593025:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094203136 00000100:00100000:3.0:1788391191.593082:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:3.0:1788391191.593092:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:36387:x1875263094203136:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391191.593115:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391191.593137:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd37863 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00152 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.593230:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3786a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.593245:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3786a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.593256:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3786a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391191.593269:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:3.0:1788391191.593560:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd37863 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00152 expref: 46 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.593577:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3786a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00152 expref: 45 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.593587:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:3.0:1788391191.593603:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391191.593608:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:3.0:1788391191.593664:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:36387:x1875263094203136:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 573us (826us total) trans 30064771323 rc 0/0 00000100:00100000:3.0:1788391191.593672:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:0.0:1788391191.637254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.637457:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094203264 00000100:00100000:1.0:1788391191.637467:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094203264 00000100:00100000:1.0:1788391191.637549:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788391191.637561:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:36387:x1875263094203264:12345-192.168.202.1@tcp:103:lfs.500 00010000:00010000:1.0:1788391191.637577:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391191.637602:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3786a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00152 expref: 45 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.637711:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff95d686a70000) 00010000:00010000:1.0:1788391191.637716:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391191.637780:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:36387:x1875263094203264:12345-192.168.202.1@tcp:103:lfs.500 Request processed in 220us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391191.637786:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1788391191.644130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.644223:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094203520 00000100:00100000:0.0:1788391191.644234:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094203520 00000100:00100000:0.0:1788391191.644298:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1788391191.644308:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:36387:x1875263094203520:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:0.0:1788391191.644541:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:36387:x1875263094203520:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 234us (421us total) trans 30064771324 rc 0/0 00000100:00100000:0.0:1788391191.644548:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1788391191.676546:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.676700:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094203776 00000100:00100000:0.0:1788391191.676711:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094203776 00000100:00100000:0.0:1788391191.676771:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:0.0:1788391191.676782:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:36387:x1875263094203776:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:0.0:1788391191.677037:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:36387:x1875263094203776:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 256us (500us total) trans 30064771325 rc 0/0 00000100:00100000:0.0:1788391191.677063:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1788391191.751324:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391191.751454:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094204032 00000100:00100000:1.0:1788391191.751463:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094204032 00000100:00100000:1.0:1788391191.751579:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 288 00000100:00100000:1.0:1788391191.751591:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:36397:x1875263094204032:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391191.751618:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391191.751639:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00159 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391191.751735:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:1.0:1788391191.751868:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37878 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00159 expref: 48 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.751881:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391191.751884:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391191.751889:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00159 expref: 48 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391191.751902:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7000, rc 0) 00000100:00100000:1.0:1788391191.752003:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:36397:x1875263094204032:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 415us (689us total) trans 30064771326 rc 301/301 00000100:00100000:1.0:1788391191.752010:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 288 00000100:00100000:1.0:1788391191.759687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.759794:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094204160 00000100:00100000:0.0:1788391191.759803:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094204160 00000100:00100000:0.0:1788391191.759894:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:0.0:1788391191.759904:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:36397:x1875263094204160:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391191.760007:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760025:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760038:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760054:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760061:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760068:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760154:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760163:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760170:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391191.760229:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760243:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760250:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760257:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760263:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.760268:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760275:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760288:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391191.760292:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391191.760296:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760303:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37886 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760318:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760324:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760337:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760342:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.760346:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760353:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760361:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff95d6a704c300) 00010000:00010000:0.0:1788391191.760363:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391191.760367:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760373:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb600/0x9aafc5f04cd3788d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760388:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760395:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760401:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760406:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391191.760409:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760425:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760433:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391191.760436:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391191.760439:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391191.760445:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37894 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391191.761439:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:36397:x1875263094204160:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1530us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391191.761451:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:3.0:1788391191.766838:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391191.767407:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094204416 00000100:00100000:0.0:1788391191.767418:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094204416 00000100:00100000:0.0:1788391191.767482:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1788391191.767494:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:36397:x1875263094204416:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788391191.767806:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:36397:x1875263094204416:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 316us (979us total) trans 30064771327 rc 0/0 00000100:00100000:0.0:1788391191.767811:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1788391191.843913:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391191.844048:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094204672 00000100:00100000:2.0:1788391191.844058:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094204672 00000100:00100000:2.0:1788391191.844120:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:2.0:1788391191.844131:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:36407:x1875263094204672:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391191.844155:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391191.844175:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3789b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00160 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.844281:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd378a2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.844296:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd378a2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.844307:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd378a2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391191.844318:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:2.0:1788391191.844573:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd3789b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00160 expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.844591:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fe00/0x9aafc5f04cd378a2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00160 expref: 50 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.844599:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:2.0:1788391191.844601:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391191.844604:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fe00, rc 0) 00000100:00100000:2.0:1788391191.844663:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:36407:x1875263094204672:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 533us (759us total) trans 30064771328 rc 0/0 00000100:00100000:2.0:1788391191.844685:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:1.0:1788391191.960838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391191.960945:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094204928 00000100:00100000:3.0:1788391191.960954:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094204928 00000100:00100000:3.0:1788391191.961077:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:3.0:1788391191.961088:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:36413:x1875263094204928:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:3.0:1788391191.961112:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391191.961131:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378b0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00167 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961199:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961213:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961225:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961240:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961245:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961270:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961385:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd378c5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961392:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd378c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961399:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd378c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391191.961408:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:3.0:1788391191.961502:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961539:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961546:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961551:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391191.961555:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961562:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961575:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391191.961578:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391191.961591:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961596:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378b7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961608:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961614:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961619:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961623:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391191.961626:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961631:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961638:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff95d686a70200) 00010000:00010000:3.0:1788391191.961640:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391191.961642:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961647:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378be lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961706:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378b0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00167 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961733:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd378c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00167 expref: 52 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391191.961740:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:3.0:1788391191.961742:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391191.961744:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:3.0:1788391191.961808:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:36413:x1875263094204928:12345-192.168.202.1@tcp:101:dd.500 Request processed in 722us (980us total) trans 30064771329 rc 0/0 00000100:00100000:3.0:1788391191.961815:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:3.0:1788391191.972295:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391191.973589:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205184 00000100:00100000:2.0:1788391191.973603:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205184 00000100:00100000:2.0:1788391191.973682:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:2.0:1788391191.973693:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:36413:x1875263094205184:12345-192.168.202.1@tcp:36:dd.500 00010000:00010000:2.0:1788391191.973753:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391191.973780:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd378c5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00167 expref: 52 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.973800:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391191.973805:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391191.974061:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.974076:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.974086:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391191.974135:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771330 00000004:00010000:2.0:1788391191.974163:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7e18851 reply state 00000000d2ddca68 transno 30064771331 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391191.974171:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391191.974271:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:36413:x1875263094205184:12345-192.168.202.1@tcp:36:dd.500 Request processed in 579us (1984us total) trans 30064771331 rc 0/0 00000100:00100000:2.0:1788391191.974278:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 292 00000020:00080000:2.0:1788391191.974298:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391191.982120:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982140:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982147:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982154:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391191.982159:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982167:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982184:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391191.982187:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391191.982192:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391191.982198:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd378d3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391192.066188:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771327 is committed 00000004:00080000:0.0:1788391192.066215:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:0.0:1788391192.066246:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771331 is committed 00000020:00080000:0.0:1788391192.066268:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d69054e240 refcount 2 committed 0 result 0 batchid 25769803907 00000020:00080000:0.0:1788391192.066274:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b5328c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d69054e180 00000020:00080000:0.0:1788391192.066278:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6b5328f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58d316800 00000004:00080000:0.0:1788391192.066316:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788391192.066335:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803906 batchid updated 00000100:00100000:2.0:1788391192.066480:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103474304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391192.066560:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391192.066636:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103474304 00000100:00100000:2.0:1788391192.066643:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103474304 00000100:00100000:2.0:1788391192.066696:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788391192.066706:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103474304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788391192.066891:0:44885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1788391192.066896:0:44885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 1788391191 -> 1788391191 00002000:00010000:2.0:1788391192.066898:0:44885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391192.066901:0:44885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 1788391191 -> 1788391191 00002000:00010000:2.0:1788391192.066903:0:44885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1788391192.066938:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103474304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (378us total) trans 30064771179 rc 0/0 00000100:00100000:2.0:1788391192.066945:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788391192.066982:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788391192.067013:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58b179180/2, rc 0, transno 30064771179 00000100:00100000:2.0:1788391192.067019:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103474304:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788391192.067135:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803907 committed batchid 25769803906 00000020:00080000:3.0:1788391192.067263:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000100:00100000:0.0:1788391192.067657:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103474432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788391192.067735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391192.068112:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103474432 00000100:00100000:1.0:1788391192.068118:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103474432 00000100:00100000:1.0:1788391192.068157:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788391192.068166:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103474432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391192.068342:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103474432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (606us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1788391192.068349:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788391192.068467:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771112 gen 2 00000004:00080000:2.0:1788391192.068472:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771112 committed transno 30064771112 00000100:00100000:2.0:1788391192.068496:0:3287:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d58c3eaa00 x1875263103474432/t30064771113(30064771113) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788391208 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788391192.068517:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58c3eaa00/2, rc 0, transno 30064771113 00000100:00100000:2.0:1788391192.068528:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103474432:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788391192.085092:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771176 is committed 00000001:00080000:1.0:1788391192.085300:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771178 is committed 00000100:00100000:3.0:1788391192.200660:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391192.200878:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205440 00000100:00100000:2.0:1788391192.200888:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205440 00000100:00100000:2.0:1788391192.201076:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1788391192.201087:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36413:x1875263094205440:12345-192.168.202.1@tcp:103:dd.500 00010000:00010000:2.0:1788391192.201102:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391192.201126:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd3782b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0013d expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.201146:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391192.201172:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391192.201225:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:36413:x1875263094205440:12345-192.168.202.1@tcp:103:dd.500 Request processed in 140us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391192.201232:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00080000:0.0:1788391192.201618:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391192.203646:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391192.203733:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205568 00000100:00100000:0.0:1788391192.203743:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205568 00000100:00100000:0.0:1788391192.203837:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:0.0:1788391192.203849:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:36413:x1875263094205568:12345-192.168.202.1@tcp:58:dd.500 00010000:00010000:0.0:1788391192.203952:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391192.204011:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391192.204023:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391192.204550:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].8, 136 off9280 00000100:00100000:0.0:1788391192.204635:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:36413:x1875263094205568:12345-192.168.202.1@tcp:58:dd.500 Request processed in 788us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391192.204643:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:1.0:1788391192.206408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391192.206495:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205696 00000100:00100000:2.0:1788391192.206504:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205696 00000100:00100000:2.0:1788391192.206597:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:2.0:1788391192.206608:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:36413:x1875263094205696:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:2.0:1788391192.206626:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391192.206643:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0016e expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206690:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206699:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206718:0:43348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206730:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206742:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:2.0:1788391192.206745:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391192.206750:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 22 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391192.206772:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e200, rc 0) 00000100:00100000:2.0:1788391192.206823:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36413:x1875263094205696:12345-192.168.202.1@tcp:101:dd.500 Request processed in 217us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391192.206830:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 294 00010000:00010000:2.0:1788391192.525215:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391193.102181:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391193.102189:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391193.102214:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 9 00000040:00080000:2.0:1788391193.102220:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391193.102326:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103474560:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788391193.102419:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6811ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788391193.107492:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103474560:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391193.108332:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.108391:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205824 00000100:00100000:2.0:1788391193.108399:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205824 00000100:00100000:2.0:1788391193.108457:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:2.0:1788391193.108467:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36414:x1875263094205824:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391193.108516:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391193.108623:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36414:x1875263094205824:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 156us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.108631:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:1.0:1788391193.110884:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.110993:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094205952 00000100:00100000:3.0:1788391193.111001:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094205952 00000100:00100000:3.0:1788391193.111053:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:3.0:1788391193.111063:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36414:x1875263094205952:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788391193.111134:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111149:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111162:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111186:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111194:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111200:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111234:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111242:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111248:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391193.111282:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00000004:00200000:3.0:1788391193.111285:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391193.111297:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111307:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111324:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111330:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111345:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.111349:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111356:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111368:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391193.111371:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.111375:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111381:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd378e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111394:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111401:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111417:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111422:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.111425:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111431:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111448:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdcf8d881 (ffff95d686a70200) 00010000:00010000:3.0:1788391193.111450:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.111453:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111460:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd378ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111474:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111479:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111483:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111487:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.111490:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111495:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111513:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:3.0:1788391193.111515:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.111518:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.111524:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1000/0x9aafc5f04cd378f6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.111660:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36414:x1875263094205952:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 596us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.111669:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:3.0:1788391193.117683:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.117780:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094206208 00000100:00100000:2.0:1788391193.117789:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094206208 00000100:00100000:2.0:1788391193.117840:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:2.0:1788391193.117849:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:36414:x1875263094206208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.117885:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391193.117904:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd378fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00175 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118070:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118086:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118096:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391193.118107:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00010000:00010000:2.0:1788391193.118231:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118238:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118245:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118250:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.118254:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118261:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118272:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:2.0:1788391193.118281:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391193.118287:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118292:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37904 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118330:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd378fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00175 expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118340:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391193.118343:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391193.118360:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd378fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00175 expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.118368:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788391193.118430:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 581us (756us total) trans 30064771332 rc 301/301 00000100:00100000:2.0:1788391193.118437:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:1.0:1788391193.120908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.121102:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094206336 00000100:00100000:2.0:1788391193.121111:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094206336 00000100:00100000:2.0:1788391193.121192:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:2.0:1788391193.121199:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206336:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391193.121229:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391193.121328:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206336:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 128us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.121336:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:1.0:1788391193.129269:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.129329:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094206592 00000100:00100000:0.0:1788391193.129339:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094206592 00000100:00100000:0.0:1788391193.129450:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:0.0:1788391193.129462:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206592:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391193.129481:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391193.129485:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391193.129531:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd377d0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00121 expref: 23 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.129546:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:0.0:1788391193.129549:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391193.129558:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37912 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0017c expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391193.130289:0:42646:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc8:0x0], index 0: 0 00010000:00010000:0.0:1788391193.130539:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37919 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.130550:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37919 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.130558:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37919 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.130607:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37912 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0017c expref: 25 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.130623:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37919 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0017c expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.130628:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391193.130631:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391193.130632:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64faa00, rc 0) 00000100:00100000:0.0:1788391193.130694:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094206592:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1234us (1435us total) trans 30064771333 rc 0/0 00000100:00100000:0.0:1788391193.130707:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:0.0:1788391193.134012:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.134078:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094206848 00000100:00100000:1.0:1788391193.134086:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094206848 00000100:00100000:1.0:1788391193.134139:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:1.0:1788391193.134150:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094206848:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391193.134214:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391193.134235:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64faa00/0x9aafc5f04cd37919 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0017c expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134249:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391193.134256:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391193.134272:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134281:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134287:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134296:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134300:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134304:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134516:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134527:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134531:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134535:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391193.134538:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134543:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134549:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:1.0:1788391193.134550:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391193.134553:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134556:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37927 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134798:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134806:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134813:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134818:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391193.134826:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134831:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134836:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x294edee2 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391193.134838:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391193.134840:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.134843:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd3792e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x294edee2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391193.134996:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206848:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 847us (990us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788391193.135003:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:1.0:1788391193.138320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.138733:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094206976 00000100:00100000:2.0:1788391193.138751:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094206976 00000100:00100000:2.0:1788391193.138832:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:2.0:1788391193.138840:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094206976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.138857:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391193.138874:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37935 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00183 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.138905:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.138918:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.138929:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.139055:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37935 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 25 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.139072:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.139081:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391193.139084:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391193.139087:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391193.139139:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094206976:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 298us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.139146:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:3.0:1788391193.142246:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.142450:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094207232 00000100:00100000:2.0:1788391193.142468:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094207232 00000100:00100000:2.0:1788391193.142587:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:2.0:1788391193.142598:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094207232:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.142793:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.142812:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.142824:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391193.143365:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].11, 88 off8992 00000004:00080000:2.0:1788391193.143377:0:43348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1010250415338ns, next at 1011250412970ns, rc = 0 00000004:00010000:2.0:1788391193.143473:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000312983af reply state 0000000012f7ca3e transno 30064771334 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.143482:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391193.145240:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36414:x1875263094207232:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 2634us (2994us total) trans 30064771334 rc 0/0 00000100:00100000:2.0:1788391193.145253:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00010000:00010000:1.0:1788391193.147678:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.147696:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.147704:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.147710:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391193.147715:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.147723:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.147755:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788391193.147758:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391193.147763:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391193.147768:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.147774:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37943 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391193.148263:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094207360 00000100:00100000:0.0:1788391193.148274:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094207360 00000100:00100000:0.0:1788391193.148338:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:0.0:1788391193.148350:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:36414:x1875263094207360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391193.148484:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391193.148512:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0018a expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.148568:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 26 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.148582:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 26 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.148601:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391193.148604:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391193.148607:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788391193.148781:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36414:x1875263094207360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 432us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391193.148788:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:3.0:1788391193.151026:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.151130:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094207488 00000100:00100000:2.0:1788391193.151139:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094207488 00000100:00080000:0.0:1788391193.151184:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391193.151212:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788391193.151223:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+5:2357:x1875263094207488:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.151767:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2357:x1875263094207488:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 544us (745us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1788391193.151776:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1788391193.184297:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.184553:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094207744 00000100:00100000:2.0:1788391193.184627:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094207744 00000100:00100000:2.0:1788391193.184704:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1788391193.184715:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:36414:x1875263094207744:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.185755:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094207744:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1037us (1463us total) trans 30064771335 rc 0/0 00000100:00100000:2.0:1788391193.185765:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1788391193.193811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.193877:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208000 00000100:00100000:1.0:1788391193.193897:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208000 00000100:00100000:1.0:1788391193.193994:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00100000:1.0:1788391193.194006:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094208000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391193.194120:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094208000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391193.194128:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00100000:1.0:1788391193.199362:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.199454:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208128 00000100:00100000:0.0:1788391193.199465:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208128 00000100:00100000:0.0:1788391193.199548:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 305 00000100:00100000:0.0:1788391193.199560:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094208128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391193.199592:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391193.199614:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37951 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00191 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199681:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199696:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199707:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391193.199743:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391193.199763:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199791:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37951 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00191 expref: 29 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199809:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00191 expref: 28 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.199818:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391193.199822:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788391193.199826:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788391193.199892:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36414:x1875263094208128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 335us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391193.199900:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 305 00000100:00100000:3.0:1788391193.203626:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.203874:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208256 00000100:00100000:2.0:1788391193.203950:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208256 00000100:00100000:2.0:1788391193.204207:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1788391193.204218:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094208256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.204235:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391193.204254:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00198 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391193.204280:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af19, blocks: 0x1 00010000:00010000:2.0:1788391193.204299:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=1010s v=(0 0) 00010000:00010000:2.0:1788391193.204303:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391193.204312:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 7 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.204329:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 7 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.204342:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788391193.204405:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094208256:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 188us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.204429:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1788391193.211888:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.211995:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208512 00000100:00100000:1.0:1788391193.212006:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208512 00000100:00100000:1.0:1788391193.212066:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:1.0:1788391193.212076:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36414:x1875263094208512:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391193.212177:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36414:x1875263094208512:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391193.212185:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:3.0:1788391193.222322:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.223084:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208640 00000100:00100000:0.0:1788391193.223095:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208640 00000100:00100000:0.0:1788391193.223168:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:0.0:1788391193.223179:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:36414:x1875263094208640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391193.223196:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391193.223216:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0019f expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.223248:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.223258:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391193.223262:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391193.223268:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.223299:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.223312:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 1110 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391193.223325:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103474688:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391193.223477:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a3747e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391193.231448:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.231685:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103474688:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391193.231727:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.231764:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:0.0:1788391193.231826:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:36414:x1875263094208640:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 8648us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391193.231835:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788391193.235278:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208768 00000100:00100000:2.0:1788391193.235295:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208768 00010000:00010000:2.0:1788391193.235344:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 1110 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.235395:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788391193.235405:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2356:x1875263094208768:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391193.235421:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391193.235443:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 1110 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.235459:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 1110 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.235481:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006739c86f/0x9aafc5f04cd3795f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00198 expref: 8 pid: 43326 timeout: 1110 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.235509:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391193.235514:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391193.235523:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.235533:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.235592:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.235605:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103474816:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391193.235689:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391193.239273:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103474816:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391193.239296:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391193.239347:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094208768:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3943us (7910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.239358:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391193.258725:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.259195:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094208896 00000100:00100000:1.0:1788391193.259206:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094208896 00002000:00100000:1.0:1788391193.259306:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff95d58cb19f80 x1875263094208896/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391193.259337:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19f80 with x1875263094208896 ext(0->1048575) 00002000:00010000:1.0:1788391193.259343:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19f80 00000100:00100000:1.0:1788391193.259381:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:1.0:1788391193.259392:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094208896:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391193.276406:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.276482:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209024 00000100:00100000:2.0:1788391193.276493:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209024 00002000:00100000:2.0:1788391193.276552:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff95d58cb1a300 x1875263094209024/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.276737:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1a300 with x1875263094209024 ext(1048576->2097151) 00002000:00010000:2.0:1788391193.276744:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1a300 00000100:00100000:2.0:1788391193.276769:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1788391193.276779:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2359:x1875263094209024:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391193.288862:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094208896:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 29461us (30137us total) trans 30064771115 rc 0/0 00000100:00100000:1.0:1788391193.288878:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00002000:00100000:1.0:1788391193.288890:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff95d58cb19f80 x1875263094208896/t30064771115(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391193.288899:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19f80 with x1875263094208896 ext(0->1048575) 00002000:00010000:1.0:1788391193.288905:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19f80 00000100:00100000:2.0:1788391193.292672:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2359:x1875263094209024:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 15884us (16265us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1788391193.292685:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00002000:00100000:2.0:1788391193.292696:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff95d58cb1a300 x1875263094209024/t30064771116(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.292722:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1a300 with x1875263094209024 ext(1048576->2097151) 00002000:00010000:2.0:1788391193.292728:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1a300 00000100:00100000:1.0:1788391193.300124:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.300199:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209152 00000100:00100000:3.0:1788391193.300207:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209152 00002000:00100000:3.0:1788391193.300248:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff95d58aef0a80 x1875263094209152/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391193.300256:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0a80 with x1875263094209152 ext(2097152->3145727) 00002000:00010000:3.0:1788391193.300261:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0a80 00000100:00100000:3.0:1788391193.300285:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:3.0:1788391193.300292:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094209152:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.305685:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094209152:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 5383us (5560us total) trans 30064771117 rc 0/0 00000100:00100000:2.0:1788391193.305695:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00002000:00100000:2.0:1788391193.305707:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff95d58aef0a80 x1875263094209152/t30064771117(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.305715:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0a80 with x1875263094209152 ext(2097152->3145727) 00002000:00010000:2.0:1788391193.305721:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0a80 00000100:00100000:1.0:1788391193.320072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.321620:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209280 00000100:00100000:3.0:1788391193.321634:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209280 00002000:00100000:3.0:1788391193.321700:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff95d58aef1500 x1875263094209280/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391193.321712:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1500 with x1875263094209280 ext(3145728->4194303) 00002000:00010000:3.0:1788391193.321719:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1500 00000100:00100000:3.0:1788391193.321756:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788391193.321768:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094209280:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391193.329524:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094209280:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7746us (9450us total) trans 30064771118 rc 0/0 00000100:00100000:3.0:1788391193.329538:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00002000:00100000:3.0:1788391193.329550:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff95d58aef1500 x1875263094209280/t30064771118(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391193.329560:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1500 with x1875263094209280 ext(3145728->4194303) 00002000:00010000:3.0:1788391193.329569:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1500 00000100:00100000:0.0:1788391193.334724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.334816:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209408 00000100:00100000:2.0:1788391193.334826:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209408 00002000:00100000:2.0:1788391193.334875:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff95d58c3ea680 x1875263094209408/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.334887:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ea680 with x1875263094209408 ext(4194304->5242879) 00002000:00010000:2.0:1788391193.334894:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ea680 00000100:00100000:2.0:1788391193.334931:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:2.0:1788391193.334942:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094209408:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.345467:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094209408:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10517us (10743us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1788391193.345483:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00002000:00100000:2.0:1788391193.351588:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff95d58c3ea680 x1875263094209408/t30064771119(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.351626:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ea680 with x1875263094209408 ext(4194304->5242879) 00002000:00010000:2.0:1788391193.351633:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ea680 00000100:00100000:0.0:1788391193.355682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.355833:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209536 00000100:00100000:2.0:1788391193.355844:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209536 00002000:00100000:2.0:1788391193.355898:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff95d58c3e9500 x1875263094209536/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.355910:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e9500 with x1875263094209536 ext(5242880->6291455) 00002000:00010000:2.0:1788391193.355916:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e9500 00000100:00100000:2.0:1788391193.355952:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:2.0:1788391193.355986:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2358:x1875263094209536:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.363343:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2358:x1875263094209536:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7370us (7660us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1788391193.363357:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00002000:00100000:2.0:1788391193.363370:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff95d58c3e9500 x1875263094209536/t30064771120(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.363380:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e9500 with x1875263094209536 ext(5242880->6291455) 00002000:00010000:2.0:1788391193.363387:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e9500 00000100:00100000:1.0:1788391193.376630:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.377666:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209664 00000100:00100000:2.0:1788391193.377677:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209664 00002000:00100000:2.0:1788391193.377739:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff95d58aef3480 x1875263094209664/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.377750:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3480 with x1875263094209664 ext(6291456->7340031) 00002000:00010000:2.0:1788391193.377755:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3480 00000100:00100000:2.0:1788391193.377807:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1788391193.377818:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094209664:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.387181:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094209664:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9355us (10552us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1788391193.387195:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00002000:00100000:2.0:1788391193.387207:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff95d58aef3480 x1875263094209664/t30064771121(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.387217:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3480 with x1875263094209664 ext(6291456->7340031) 00002000:00010000:2.0:1788391193.387224:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3480 00000100:00100000:1.0:1788391193.388458:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.388522:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209792 00000100:00100000:2.0:1788391193.388530:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209792 00002000:00100000:2.0:1788391193.388584:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff95d58aef3b80 x1875263094209792/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.388593:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3b80 with x1875263094209792 ext(7340032->8388607) 00002000:00010000:2.0:1788391193.388597:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3b80 00000100:00100000:2.0:1788391193.388624:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:2.0:1788391193.388633:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094209792:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.397071:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094209792:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8426us (8604us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1788391193.397084:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00002000:00100000:2.0:1788391193.397097:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff95d58aef3b80 x1875263094209792/t30064771122(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.397108:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3b80 with x1875263094209792 ext(7340032->8388607) 00002000:00010000:2.0:1788391193.397128:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3b80 00000100:00100000:0.0:1788391193.403662:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.403787:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094209920 00000100:00100000:2.0:1788391193.403798:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094209920 00002000:00100000:2.0:1788391193.403848:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff95d58c3e8e00 x1875263094209920/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.403860:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8e00 with x1875263094209920 ext(8388608->9437183) 00002000:00010000:2.0:1788391193.403866:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e8e00 00000100:00100000:2.0:1788391193.403904:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:2.0:1788391193.403917:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094209920:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.413086:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094209920:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9160us (9522us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788391193.413109:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00002000:00100000:2.0:1788391193.413122:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff95d58c3e8e00 x1875263094209920/t30064771123(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.413134:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3e8e00 with x1875263094209920 ext(8388608->9437183) 00002000:00010000:2.0:1788391193.413141:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3e8e00 00000100:00100000:0.0:1788391193.418473:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.418542:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210048 00000100:00100000:2.0:1788391193.418552:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210048 00002000:00100000:2.0:1788391193.418749:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff95d6bc68f480 x1875263094210048/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.418759:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68f480 with x1875263094210048 ext(9437184->10485759) 00002000:00010000:2.0:1788391193.418765:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68f480 00000100:00100000:2.0:1788391193.418843:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:2.0:1788391193.418855:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094210048:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.428902:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094210048:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10037us (10427us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1788391193.428915:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00002000:00100000:2.0:1788391193.428925:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff95d6bc68f480 x1875263094210048/t30064771124(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.428933:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68f480 with x1875263094210048 ext(9437184->10485759) 00002000:00010000:2.0:1788391193.428937:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68f480 00000100:00100000:3.0:1788391193.435200:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.435337:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210176 00000100:00100000:2.0:1788391193.435358:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210176 00002000:00100000:2.0:1788391193.435661:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff95d58cb19880 x1875263094210176/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.435674:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19880 with x1875263094210176 ext(10485760->11534335) 00002000:00010000:2.0:1788391193.435680:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19880 00000100:00100000:2.0:1788391193.435763:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1788391193.435775:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2356:x1875263094210176:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.444058:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094210176:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8275us (8859us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788391193.444072:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00002000:00100000:2.0:1788391193.444085:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff95d58cb19880 x1875263094210176/t30064771125(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.444096:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19880 with x1875263094210176 ext(10485760->11534335) 00002000:00010000:2.0:1788391193.444103:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19880 00000100:00100000:1.0:1788391193.449841:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.449946:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210304 00000100:00100000:2.0:1788391193.449991:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210304 00002000:00100000:2.0:1788391193.450043:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff95d58aef1f80 x1875263094210304/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.450054:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1f80 with x1875263094210304 ext(11534336->12582911) 00002000:00010000:2.0:1788391193.450061:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1f80 00000100:00100000:2.0:1788391193.450132:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1788391193.450143:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094210304:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.457331:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094210304:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7179us (7488us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1788391193.457345:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00002000:00100000:2.0:1788391193.457358:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff95d58aef1f80 x1875263094210304/t30064771126(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.457370:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1f80 with x1875263094210304 ext(11534336->12582911) 00002000:00010000:2.0:1788391193.457388:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1f80 00000100:00100000:1.0:1788391193.463804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.463919:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210432 00000100:00100000:2.0:1788391193.463929:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210432 00002000:00100000:2.0:1788391193.464008:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff95d58aef2300 x1875263094210432/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.464019:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2300 with x1875263094210432 ext(12582912->13631487) 00002000:00010000:2.0:1788391193.464025:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2300 00000100:00100000:2.0:1788391193.464096:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1788391193.464108:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094210432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.470836:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2356:x1875263094210432:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6722us (7033us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788391193.470853:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00002000:00100000:2.0:1788391193.470864:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff95d58aef2300 x1875263094210432/t30064771127(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.470872:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2300 with x1875263094210432 ext(12582912->13631487) 00002000:00010000:2.0:1788391193.470877:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2300 00000100:00100000:1.0:1788391193.472282:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.472370:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210560 00000100:00100000:2.0:1788391193.472379:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210560 00002000:00100000:2.0:1788391193.472432:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff95d58aef1880 x1875263094210560/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.472442:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1880 with x1875263094210560 ext(13631488->14680063) 00002000:00010000:2.0:1788391193.472447:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1880 00000100:00100000:2.0:1788391193.472622:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1788391193.472633:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094210560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.477280:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094210560:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 4641us (4994us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1788391193.477293:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00002000:00100000:2.0:1788391193.477305:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff95d58aef1880 x1875263094210560/t30064771128(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.477315:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1880 with x1875263094210560 ext(13631488->14680063) 00002000:00010000:2.0:1788391193.477321:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1880 00000100:00100000:0.0:1788391193.483766:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.483822:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210688 00000100:00100000:2.0:1788391193.483834:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210688 00002000:00100000:2.0:1788391193.483882:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff95d691119180 x1875263094210688/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.483902:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119180 with x1875263094210688 ext(14680064->15728639) 00002000:00010000:2.0:1788391193.483906:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691119180 00000100:00100000:2.0:1788391193.483988:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:2.0:1788391193.483996:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094210688:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.491367:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2357:x1875263094210688:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7350us (7593us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1788391193.491381:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00002000:00100000:2.0:1788391193.491394:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff95d691119180 x1875263094210688/t30064771129(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.491415:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d691119180 with x1875263094210688 ext(14680064->15728639) 00002000:00010000:2.0:1788391193.491422:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d691119180 00000100:00100000:3.0:1788391193.495324:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.495385:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210816 00000100:00100000:2.0:1788391193.495394:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210816 00002000:00100000:2.0:1788391193.495445:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff95d587d03800 x1875263094210816/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.495459:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03800 with x1875263094210816 ext(15728640->16777215) 00002000:00010000:2.0:1788391193.495463:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d03800 00000100:00100000:2.0:1788391193.495492:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:2.0:1788391193.495510:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2358:x1875263094210816:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.502926:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094210816:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7404us (7599us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788391193.502937:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00002000:00100000:2.0:1788391193.502982:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff95d587d03800 x1875263094210816/t30064771130(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.502994:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03800 with x1875263094210816 ext(15728640->16777215) 00002000:00010000:2.0:1788391193.502999:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d03800 00000100:00100000:1.0:1788391193.507197:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.507253:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094210944 00000100:00100000:2.0:1788391193.507261:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094210944 00002000:00100000:2.0:1788391193.507302:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff95d58aef1c00 x1875263094210944/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.507310:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1c00 with x1875263094210944 ext(16777216->17825791) 00002000:00010000:2.0:1788391193.507314:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1c00 00000100:00100000:2.0:1788391193.507339:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:2.0:1788391193.507349:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094210944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.514475:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2359:x1875263094210944:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7115us (7274us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1788391193.514489:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00002000:00100000:2.0:1788391193.514511:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff95d58aef1c00 x1875263094210944/t30064771131(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.514522:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1c00 with x1875263094210944 ext(16777216->17825791) 00002000:00010000:2.0:1788391193.514529:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1c00 00000100:00100000:3.0:1788391193.519737:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.519801:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211072 00000100:00100000:2.0:1788391193.519811:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211072 00002000:00100000:2.0:1788391193.519861:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff95d587d02680 x1875263094211072/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.519872:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02680 with x1875263094211072 ext(17825792->18874367) 00002000:00010000:2.0:1788391193.519892:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d02680 00000100:00100000:2.0:1788391193.519995:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:2.0:1788391193.520005:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2358:x1875263094211072:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.526537:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2358:x1875263094211072:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6523us (6797us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1788391193.526551:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00002000:00100000:2.0:1788391193.526565:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff95d587d02680 x1875263094211072/t30064771132(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.526575:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02680 with x1875263094211072 ext(17825792->18874367) 00002000:00010000:2.0:1788391193.526582:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d02680 00000100:00100000:3.0:1788391193.531768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.531919:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211200 00000100:00100000:2.0:1788391193.531929:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211200 00002000:00100000:2.0:1788391193.532006:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff95d587d00e00 x1875263094211200/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.532017:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00e00 with x1875263094211200 ext(18874368->19922943) 00002000:00010000:2.0:1788391193.532023:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00e00 00000100:00100000:2.0:1788391193.532056:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391193.532066:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2358:x1875263094211200:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391193.541561:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2358:x1875263094211200:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9485us (9792us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1788391193.541575:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00002000:00100000:2.0:1788391193.541589:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff95d587d00e00 x1875263094211200/t30064771133(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.541619:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00e00 with x1875263094211200 ext(18874368->19922943) 00002000:00010000:2.0:1788391193.541624:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00e00 00000100:00100000:3.0:1788391193.544097:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.544325:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211328 00000100:00100000:2.0:1788391193.544335:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211328 00002000:00100000:2.0:1788391193.544486:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff95d587d00380 x1875263094211328/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.544505:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00380 with x1875263094211328 ext(19922944->20971519) 00002000:00010000:2.0:1788391193.544510:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00380 00000100:00100000:2.0:1788391193.544539:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:2.0:1788391193.544551:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2359:x1875263094211328:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1788391193.549076:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391193.552639:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2359:x1875263094211328:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8083us (8543us total) trans 30064771134 rc 0/0 00000100:00100000:2.0:1788391193.552654:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00002000:00100000:2.0:1788391193.552666:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff95d587d00380 x1875263094211328/t30064771134(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391193.552677:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00380 with x1875263094211328 ext(19922944->20971519) 00002000:00010000:2.0:1788391193.552683:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00380 00000100:00100000:3.0:1788391193.554797:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.554882:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211456 00000100:00100000:2.0:1788391193.554892:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211456 00000100:00100000:2.0:1788391193.554939:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00100000:2.0:1788391193.554950:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36414:x1875263094211456:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788391193.581616:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:36414:x1875263094211456:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 26657us (26816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.581629:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 307 00000001:00080000:0.0:1788391193.581705:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771333 is committed 00000001:00080000:0.0:1788391193.581718:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771335 is committed 00000004:00080000:0.0:1788391193.581726:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:0.0:1788391193.581748:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803907 batchid updated 00000020:00080000:0.0:1788391193.581768:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000020:00080000:0.0:1788391193.581778:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000100:00100000:2.0:1788391193.582710:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103475072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788391193.582782:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391193.582839:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391193.582845:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103474944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788391193.582867:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391193.582898:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103475072 00000100:00100000:2.0:1788391193.582905:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103475072 00000100:00100000:2.0:1788391193.582948:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103474944 00000100:00100000:2.0:1788391193.582952:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103474944 00000100:00100000:2.0:1788391193.583009:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788391193.583018:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103475072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788391193.583168:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1788391193.583172:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788391193 00002000:00010000:2.0:1788391193.583175:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391193.583177:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1788391193 -> 1788391193 00002000:00010000:2.0:1788391193.583180:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391193.583213:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1875263103475072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (431us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1788391193.583220:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788391193.583234:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788391193.583241:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103474944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788391193.583254:0:43328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:199 count 1 00002000:00010000:2.0:1788391193.583275:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 15728640, mtime: 0x6a98af17, atime: 0x0, ctime: 0x6a98af17, blocks: 0x7807 00010000:00010000:2.0:1788391193.583282:0:43328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.583295:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=1010s v=(0 0) 00010000:00010000:2.0:1788391193.583300:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391193.583313:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.583328:0:43328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.583340:0:43328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.583466:0:43328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.583485:0:43328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788391193.584058:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1875263103474944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 814us (1187us total) trans 30064771136 rc 0/0 00000100:00100000:2.0:1788391193.584066:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788391193.584091:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391193.584106:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391193.584112:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.584121:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391193.584126:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.584135:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.584165:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.584173:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd3796d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.584191:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391193.584192:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391193.584194:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788391193.584224:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d587d00000/2, rc 0, transno 30064771136 00000100:00100000:2.0:1788391193.584230:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103474944:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788391193.584240:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d587d00a80/2, rc 0, transno 30064771135 00000100:00100000:2.0:1788391193.584243:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103475072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788391193.585570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.585639:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211584 00000100:00100000:2.0:1788391193.585646:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211584 00000100:00100000:2.0:1788391193.585687:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:2.0:1788391193.585694:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094211584:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788391193.643976:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094211584:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 58254us (58386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391193.643990:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000001:00080000:1.0:1788391193.644387:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771115 is committed 00000001:00080000:1.0:1788391193.644409:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771113 is committed 00000001:00080000:1.0:1788391193.644415:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771136 is committed 00000001:00080000:1.0:1788391193.644423:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771134 is committed 00000100:00100000:2.0:1788391193.646683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.646741:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211840 00000100:00100000:1.0:1788391193.646763:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211840 00000100:00100000:1.0:1788391193.646859:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:1.0:1788391193.646870:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094211840:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391193.646920:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391193.646945:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37958 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00191 expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.647041:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391193.647047:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391193.647076:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.647090:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.647097:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391193.647678:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060daad46 reply state 000000001c5f8f28 transno 30064771336 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391193.647687:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391193.647828:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:36414:x1875263094211840:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 958us (1150us total) trans 30064771336 rc 0/0 00000100:00100000:1.0:1788391193.647835:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 308 00010000:00010000:2.0:1788391193.651601:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651618:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651626:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651652:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.651657:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651665:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651682:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391193.651685:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391193.651690:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.651696:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37974 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.652161:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.652235:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094211968 00000100:00100000:2.0:1788391193.652244:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094211968 00000100:00100000:2.0:1788391193.652293:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:2.0:1788391193.652300:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094211968:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788391193.652518:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:2.0:1788391193.652522:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 1788391193 -> 1788391192 00002000:00010000:2.0:1788391193.652524:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 1788391191 00002000:00010000:2.0:1788391193.652526:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1788391193 -> 1788391192 00002000:00010000:2.0:1788391193.652529:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:2.0:1788391193.652583:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094211968:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 282us (423us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1788391193.652590:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1788391193.661788:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.661906:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212224 00000100:00100000:0.0:1788391193.661917:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212224 00000100:00100000:0.0:1788391193.662016:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:0.0:1788391193.662027:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:36414:x1875263094212224:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788391193.662096:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.662124:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.662133:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.662172:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 24 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.662184:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 24 pid: 42644 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391193.662199:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad33480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103475200:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391193.662299:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391193.664858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.665307:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212352 00000100:00100000:1.0:1788391193.665317:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212352 00010000:00010000:1.0:1788391193.665359:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 25 pid: 42644 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391193.665421:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1788391193.665431:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094212352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391193.665445:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391193.665452:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 25 pid: 42644 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.665465:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 25 pid: 42644 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.665485:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391193.665489:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.665511:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.665518:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391193.665562:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391193.665609:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094212352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 179us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391193.665617:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:0.0:1788391193.665922:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd3793c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00183 expref: 24 pid: 42644 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391193.665938:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad33480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103475200:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391193.665957:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666175:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666181:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666210:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666223:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666229:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666234:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391193.666239:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666245:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666255:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391193.666257:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788391193.666261:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.666266:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd3797b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391193.666321:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094212224:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 4295us (4542us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788391193.666328:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:3.0:1788391193.668481:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.668594:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212480 00000100:00100000:2.0:1788391193.668603:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212480 00000100:00100000:2.0:1788391193.668690:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:2.0:1788391193.668700:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2356:x1875263094212480:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.668741:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.668760:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.668769:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391193.668774:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391193.668779:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.668813:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.668828:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 7 pid: 43698 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.668844:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103475328:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391193.668924:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788391193.675753:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103475328:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391193.675789:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391193.714102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.714304:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212608 00000100:00100000:3.0:1788391193.714314:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212608 00010000:00010000:3.0:1788391193.714356:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.714482:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1788391193.714501:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094212608:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391193.714516:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391193.714537:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.714551:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.714575:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd37966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0019f expref: 8 pid: 43698 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.714590:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391193.714594:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391193.714599:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.714607:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.714659:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391193.714715:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094212608:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 223us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.714723:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00010000:00010000:2.0:1788391193.714792:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714802:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714823:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714832:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714840:0:43327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714847:0:43327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391193.714852:0:43327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714861:0:43327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714883:0:43327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.714905:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1f54f14/0x9aafc5f04cd37982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.714950:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:2356:x1875263094212480:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 46251us (46479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.714957:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:3.0:1788391193.719312:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.719687:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212864 00000100:00100000:2.0:1788391193.719697:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212864 00000100:00100000:2.0:1788391193.719806:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 310 00000100:00100000:2.0:1788391193.719817:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:36414:x1875263094212864:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391193.719911:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.719931:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.719944:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.720198:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.720210:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.720219:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.720275:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.720289:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 24 pid: 42646 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.720303:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103475456:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391193.720383:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788391193.725031:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.725113:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094212992 00000100:00100000:3.0:1788391193.725121:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094212992 00010000:00010000:3.0:1788391193.725168:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 25 pid: 42646 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.725207:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1788391193.725216:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094212992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391193.725230:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391193.725236:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 25 pid: 42646 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.725248:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 25 pid: 42646 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.725269:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:3.0:1788391193.725307:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.725315:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.725320:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.725344:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391193.725392:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094212992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 178us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.725397:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00010000:00010000:2.0:1788391193.727324:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3794a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0018a expref: 24 pid: 42646 timeout: 1110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.727349:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103475456:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391193.727372:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.727381:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.727385:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391193.727645:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771337 00000001:00080000:2.0:1788391193.727795:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771338 00000001:00080000:2.0:1788391193.727838:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771339 00000100:00100000:2.0:1788391193.727918:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103475584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788391193.727995:0:43348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391193.728029:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391193.728091:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103475584 00000100:00100000:3.0:1788391193.728096:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103475584 00000100:00100000:3.0:1788391193.728134:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788391193.728140:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103475584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788391193.728231:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103475584:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.728238:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788391193.728318:0:43348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771136 gen 2 00000004:00080000:2.0:1788391193.728323:0:43348:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58c3eaa00, transno 30064771113 00000004:00080000:2.0:1788391193.728332:0:43348:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d587d00a80, transno 30064771135 00000004:00080000:2.0:1788391193.728334:0:43348:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d587d00000, transno 30064771136 00000100:00100000:2.0:1788391193.728338:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103475584:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1788391193.728813:0:42666:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:2.0:1788391193.728859:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771340 00000100:00100000:2.0:1788391193.728910:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103475712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788391193.728937:0:43348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391193.729043:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391193.730642:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103475712 00000100:00100000:3.0:1788391193.730653:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103475712 00000100:00100000:3.0:1788391193.730704:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788391193.730709:0:42650:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788391193.730714:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:43348:x1875263103475712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788391193.730719:0:42650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788391193.731122:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:43348:x1875263103475712:12345-0@lo:1000:mdt00_003.0 Request processed in 409us (2182us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1788391193.731130:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788391193.732257:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:43348:1875263103475712:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788391193.732304:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732316:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732323:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732330:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.732334:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732342:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732357:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391193.732361:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391193.732366:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732390:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37990 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732423:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732429:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732435:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732440:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.732444:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732450:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732459:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:2.0:1788391193.732462:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391193.732469:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732481:0:43348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732502:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.732550:0:43348:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e200/0x9aafc5f04cd378e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0016e expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.732563:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103475840:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391193.732632:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69054e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788391193.736438:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103475840:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391193.736465:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736475:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd378da lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736521:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736534:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736544:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736554:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736559:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736566:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736591:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.736596:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736602:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736615:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:2.0:1788391193.736617:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391193.736620:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736626:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37997 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736635:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736640:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736646:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736651:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391193.736654:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736660:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736680:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:2.0:1788391193.736682:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391193.736685:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.736690:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37989 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391193.737259:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094212864:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 17440us (17950us total) trans 30064771341 rc 0/0 00000100:00100000:2.0:1788391193.737268:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 310 00000020:00080000:2.0:1788391193.737273:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788391193.737406:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000040:00080000:1.0:1788391193.737781:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391193.737792:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788391193.737811:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213120 00000100:00100000:2.0:1788391193.737816:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213120 00000100:00100000:2.0:1788391193.737859:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1788391193.737868:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36413:x1875263094213120:12345-192.168.202.1@tcp:49:dd.500 00000100:00100000:2.0:1788391193.737984:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36413:x1875263094213120:12345-192.168.202.1@tcp:49:dd.500 Request processed in 116us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391193.737991:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000040:00080000:1.0:1788391193.738402:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:1.0:1788391193.738410:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391193.750513:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.750596:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213248 00000100:00100000:0.0:1788391193.750608:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213248 00000100:00100000:0.0:1788391193.750672:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391193.750683:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:36413:x1875263094213248:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391193.750716:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391193.750734:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd3799e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001a6 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391193.750756:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 20971520, mtime: 0x6a98af18, atime: 0x6a98af17, ctime: 0x6a98af18, blocks: 0xa007 00010000:00010000:0.0:1788391193.750774:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=1010s v=(0 0) 00010000:00010000:0.0:1788391193.750778:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391193.750788:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd3799e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001a6 expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.750804:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a347de4/0x9aafc5f04cd3799e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001a6 expref: 7 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391193.750819:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb600, rc 0) 00000100:00100000:0.0:1788391193.750876:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:36413:x1875263094213248:12345-192.168.202.1@tcp:101:dd.500 Request processed in 195us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391193.750884:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1788391193.783311:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.783429:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213376 00000100:00100000:2.0:1788391193.783438:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213376 00002000:00100000:2.0:1788391193.783484:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff95d587d01880 x1875263094213376/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.783508:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01880 with x1875263094213376 ext(20971520->22020095) 00002000:00010000:2.0:1788391193.783514:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01880 00000100:00100000:2.0:1788391193.783550:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1788391193.783575:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094213376:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391193.797774:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094213376:12345-192.168.202.1@tcp:4:dd.500 Request processed in 14190us (14462us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1788391193.797788:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00002000:00100000:2.0:1788391193.797801:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff95d587d01880 x1875263094213376/t30064771139(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.797812:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01880 with x1875263094213376 ext(20971520->22020095) 00002000:00010000:2.0:1788391193.797818:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01880 00000100:00100000:1.0:1788391193.808989:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.809072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.809251:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213504 00000100:00100000:3.0:1788391193.809261:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213504 00002000:00100000:3.0:1788391193.809311:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff95d58aef2d80 x1875263094213504/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788391193.809341:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2d80 with x1875263094213504 ext(22020096->23068671) 00002000:00010000:3.0:1788391193.809346:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2d80 00000100:00100000:3.0:1788391193.809379:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213632 00000100:00100000:3.0:1788391193.809382:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213632 00002000:00100000:3.0:1788391193.809397:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff95d58aef0700 x1875263094213632/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788391193.809406:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0700 with x1875263094213632 ext(23068672->24117247) 00002000:00010000:3.0:1788391193.809409:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0700 00000100:00100000:3.0:1788391193.809432:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:3.0:1788391193.809442:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094213504:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391193.810584:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:1.0:1788391193.810598:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094213632:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:3.0:1788391193.823293:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.823357:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213760 00000100:00100000:2.0:1788391193.823368:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213760 00002000:00100000:2.0:1788391193.823414:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff95d587d01c00 x1875263094213760/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.823426:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01c00 with x1875263094213760 ext(24117248->25165823) 00002000:00010000:2.0:1788391193.823432:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01c00 00000100:00100000:0.0:1788391193.823887:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094213504:12345-192.168.202.1@tcp:4:dd.500 Request processed in 14444us (14926us total) trans 30064771140 rc 0/0 00000100:00100000:2.0:1788391193.824132:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:2.0:1788391193.824147:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094213760:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:0.0:1788391193.824542:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00002000:00100000:0.0:1788391193.824551:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff95d58aef2d80 x1875263094213504/t30064771140(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788391193.824559:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2d80 with x1875263094213504 ext(22020096->23068671) 00002000:00010000:0.0:1788391193.824563:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2d80 00000100:00100000:2.0:1788391193.830821:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094213632:12345-192.168.202.1@tcp:4:dd.500 Request processed in 20217us (21738us total) trans 30064771141 rc 0/0 00000100:00100000:2.0:1788391193.830836:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00002000:00100000:2.0:1788391193.830858:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff95d58aef0700 x1875263094213632/t30064771141(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.830869:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0700 with x1875263094213632 ext(23068672->24117247) 00002000:00010000:2.0:1788391193.830875:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0700 00000100:00100000:2.0:1788391193.838251:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094213760:12345-192.168.202.1@tcp:4:dd.500 Request processed in 14097us (14958us total) trans 30064771142 rc 0/0 00000100:00100000:2.0:1788391193.838264:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00002000:00100000:2.0:1788391193.838277:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff95d587d01c00 x1875263094213760/t30064771142(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.838286:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01c00 with x1875263094213760 ext(24117248->25165823) 00002000:00010000:2.0:1788391193.838292:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01c00 00000100:00100000:1.0:1788391193.842292:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.842504:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094213888 00000100:00100000:2.0:1788391193.842515:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094213888 00002000:00100000:2.0:1788391193.842562:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff95d58aef3100 x1875263094213888/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.842574:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3100 with x1875263094213888 ext(25165824->26214399) 00002000:00010000:2.0:1788391193.842580:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3100 00000100:00100000:2.0:1788391193.842658:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:2.0:1788391193.842668:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094213888:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391193.854364:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094213888:12345-192.168.202.1@tcp:4:dd.500 Request processed in 11686us (12069us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1788391193.854378:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00002000:00100000:2.0:1788391193.854390:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff95d58aef3100 x1875263094213888/t30064771143(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.854403:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef3100 with x1875263094213888 ext(25165824->26214399) 00002000:00010000:2.0:1788391193.854408:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef3100 00000100:00100000:0.0:1788391193.855062:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.855117:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214144 00000100:00100000:2.0:1788391193.855126:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214144 00000100:00100000:2.0:1788391193.855180:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1788391193.855191:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:36414:x1875263094214144:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788391193.858041:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788391193.858161:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771342 00010000:00010000:2.0:1788391193.858223:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858240:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858251:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858259:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858265:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858272:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391193.858296:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788391193.858484:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391193.858502:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.858509:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391193.858514:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.858524:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.858538:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:3.0:1788391193.858542:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391193.858546:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.858564:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379a5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.858582:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391193.858585:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391193.858586:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391193.858634:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:36414:x1875263094214144:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 3439us (3567us total) trans 30064771343 rc 0/0 00000100:00100000:2.0:1788391193.858645:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000020:00080000:2.0:1788391193.858651:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391193.864047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.864124:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214272 00000100:00100000:3.0:1788391193.864135:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214272 00002000:00100000:3.0:1788391193.864185:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff95d58ad33800 x1875263094214272/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788391193.864196:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad33800 with x1875263094214272 ext(26214400->27262975) 00002000:00010000:3.0:1788391193.864201:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad33800 00000100:00100000:3.0:1788391193.864236:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:3.0:1788391193.864247:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094214272:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391193.870207:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094214272:12345-192.168.202.1@tcp:4:dd.500 Request processed in 5948us (6153us total) trans 30064771144 rc 0/0 00000100:00100000:1.0:1788391193.870221:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00002000:00100000:1.0:1788391193.870234:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff95d58ad33800 x1875263094214272/t30064771144(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391193.870246:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad33800 with x1875263094214272 ext(26214400->27262975) 00002000:00010000:1.0:1788391193.870253:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad33800 00000100:00100000:3.0:1788391193.876643:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.876746:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214400 00000100:00100000:2.0:1788391193.876756:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214400 00002000:00100000:2.0:1788391193.876805:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff95d587d01180 x1875263094214400/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.876838:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01180 with x1875263094214400 ext(27262976->28311551) 00002000:00010000:2.0:1788391193.876845:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01180 00000100:00100000:2.0:1788391193.877094:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1788391193.877105:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094214400:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391193.887590:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094214400:12345-192.168.202.1@tcp:4:dd.500 Request processed in 10478us (10950us total) trans 30064771145 rc 0/0 00000100:00100000:2.0:1788391193.887600:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00002000:00100000:2.0:1788391193.887610:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff95d587d01180 x1875263094214400/t30064771145(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.887617:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d01180 with x1875263094214400 ext(27262976->28311551) 00002000:00010000:2.0:1788391193.887622:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d01180 00000100:00100000:0.0:1788391193.888143:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391193.888219:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214528 00000100:00100000:2.0:1788391193.888227:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214528 00002000:00100000:2.0:1788391193.888262:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff95d68f321180 x1875263094214528/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.888273:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321180 with x1875263094214528 ext(28311552->29360127) 00002000:00010000:2.0:1788391193.888277:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f321180 00000100:00100000:2.0:1788391193.888346:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1788391193.888356:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094214528:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391193.896819:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2356:x1875263094214528:12345-192.168.202.1@tcp:4:dd.500 Request processed in 8454us (8668us total) trans 30064771146 rc 0/0 00000100:00100000:2.0:1788391193.896833:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00002000:00100000:2.0:1788391193.896857:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff95d68f321180 x1875263094214528/t30064771146(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391193.896869:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321180 with x1875263094214528 ext(28311552->29360127) 00002000:00010000:2.0:1788391193.896875:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68f321180 00000100:00100000:0.0:1788391193.898487:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391193.898590:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214656 00000100:00100000:1.0:1788391193.898600:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214656 00002000:00100000:1.0:1788391193.898644:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff95d6bbcf1180 x1875263094214656/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391193.898654:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf1180 with x1875263094214656 ext(29360128->30408703) 00002000:00010000:1.0:1788391193.898659:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf1180 00000100:00100000:1.0:1788391193.898685:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1788391193.898694:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2358:x1875263094214656:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391193.903793:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2358:x1875263094214656:12345-192.168.202.1@tcp:4:dd.500 Request processed in 5089us (5303us total) trans 30064771147 rc 0/0 00000100:00100000:1.0:1788391193.903818:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00002000:00100000:1.0:1788391193.903831:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff95d6bbcf1180 x1875263094214656/t30064771147(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391193.903841:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf1180 with x1875263094214656 ext(29360128->30408703) 00002000:00010000:1.0:1788391193.903847:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf1180 00000100:00100000:3.0:1788391193.911087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391193.911201:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215040 00000100:00100000:0.0:1788391193.911211:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215040 00000100:00100000:0.0:1788391193.911267:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1788391193.911278:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:36413:x1875263094215040:12345-192.168.202.1@tcp:35:dd.500 00000001:00080000:0.0:1788391193.911568:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771344 00000001:00080000:0.0:1788391193.911628:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771345 00000100:00100000:2.0:1788391193.911688:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.911821:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094214784 00000100:00100000:3.0:1788391193.911826:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094214784 00002000:00100000:3.0:1788391193.911857:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff95d58b178380 x1875263094214784/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/0 e 0 to 0 dl 1788391204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788391193.911878:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b178380 with x1875263094214784 ext(30408704->31457279) 00002000:00010000:3.0:1788391193.911883:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b178380 00000100:00100000:3.0:1788391193.912004:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:2.0:1788391193.912050:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094214784:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391193.915338:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36413:x1875263094215040:12345-192.168.202.1@tcp:35:dd.500 Request processed in 4051us (4249us total) trans 30064771346 rc 0/0 00000100:00100000:1.0:1788391193.915352:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000020:00080000:1.0:1788391193.915358:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788391193.926211:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2356:x1875263094214784:12345-192.168.202.1@tcp:4:dd.500 Request processed in 14188us (14512us total) trans 30064771148 rc 0/0 00000100:00100000:1.0:1788391193.926225:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00002000:00100000:1.0:1788391193.926239:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff95d58b178380 x1875263094214784/t30064771148(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:54/0 lens 488/448 e 0 to 0 dl 1788391204 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391193.926250:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b178380 with x1875263094214784 ext(30408704->31457279) 00002000:00010000:1.0:1788391193.926256:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b178380 00000100:00100000:2.0:1788391193.979236:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391193.979361:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215168 00000100:00100000:3.0:1788391193.979371:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215168 00000100:00100000:3.0:1788391193.979486:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:3.0:1788391193.979523:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36424:x1875263094215168:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1788391193.979608:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.979624:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.979637:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.979652:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.979659:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.979664:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980020:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980030:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980037:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391193.980077:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980090:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980102:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980109:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980115:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.980119:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980127:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980136:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff95d686a70600) 00010000:00010000:3.0:1788391193.980138:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.980141:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980147:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd379ac lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980160:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980166:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980172:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980178:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.980186:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980193:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980200:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff95d686a70400) 00010000:00010000:3.0:1788391193.980203:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.980206:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980212:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd379b3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980226:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980233:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980237:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980240:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391193.980242:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980245:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980250:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff95d6a704c400) 00010000:00010000:3.0:1788391193.980252:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391193.980258:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391193.980262:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd379ba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391193.980316:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36424:x1875263094215168:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 795us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391193.980320:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00010000:00010000:3.0:1788391194.573523:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391194.575286:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103475968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391194.575342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391194.575399:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103475968 00000100:00100000:0.0:1788391194.575406:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103475968 00000100:00100000:0.0:1788391194.575457:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788391194.575466:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103475968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391194.575509:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 178847744 pending 0 free 3781165056 avail 3779067904 00000100:00100000:0.0:1788391194.575553:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103475968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391194.575560:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788391194.575579:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391194.575853:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103475968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391194.576770:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103476224:0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.576796:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103476352:0@lo:400:kworker.0 00000100:00100000:0.0:1788391194.576813:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391194.576852:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391194.576857:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476224 00000100:00100000:0.0:1788391194.576863:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476224 00000100:00100000:0.0:1788391194.576975:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788391194.576980:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476352 00000100:00100000:0.0:1788391194.576986:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103476224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391194.576988:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476352 00000100:00100000:1.0:1788391194.577024:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788391194.577034:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103476352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391194.577043:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103476224:12345-0@lo:400:kworker.0 Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391194.577051:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788391194.577088:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103476352:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391194.577095:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788391194.577179:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103476352:0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577222:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103476096:0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577253:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391194.577290:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103476608:0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391194.577328:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391194.577334:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103476480:0@lo:400:kworker.0 00000100:00100000:1.0:1788391194.577353:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476096 00000100:00100000:3.0:1788391194.577358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391194.577367:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476096 00000100:00100000:3.0:1788391194.577397:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476608 00000100:00100000:3.0:1788391194.577403:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476608 00000100:00100000:1.0:1788391194.577403:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788391194.577426:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103476096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577440:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476480 00000100:00100000:3.0:1788391194.577444:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476480 00000100:00080000:0.0:1788391194.577502:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391194.577521:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103476224:0@lo:400:kworker.0 00000100:00100000:1.0:1788391194.577546:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103476096:12345-0@lo:400:kworker.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391194.577554:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788391194.577664:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788391194.577672:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103476608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577704:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103476608:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391194.577718:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788391194.577734:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788391194.577743:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103476480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391194.577780:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103476480:12345-0@lo:400:kworker.0 Request processed in 39us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391194.577787:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788391194.577871:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103476480:0@lo:400:kworker.0 00000100:00100000:2.0:1788391194.577941:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103476096:0@lo:400:kworker.0 00000100:00100000:2.0:1788391194.577984:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103476608:0@lo:400:kworker.0 00010000:00010000:3.0:1788391195.597685:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391195.598070:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103476736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391195.599033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391195.599191:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476736 00000100:00100000:0.0:1788391195.599199:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476736 00000100:00100000:0.0:1788391195.599250:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788391195.599260:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103476736:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788391195.599291:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788391195.599295:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 144769024 pending 17039360 free 3830448128 avail 3828350976 00000100:00100000:0.0:1788391195.599349:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103476736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391195.599356:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788391195.599579:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103476736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391196.280643:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391196.280690:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391196.280725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391196.280814:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391196.280834:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215296 00000100:00100000:2.0:1788391196.280843:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215296 00000100:00100000:3.0:1788391196.280861:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215552 00000100:00100000:3.0:1788391196.280866:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215552 00000100:00100000:2.0:1788391196.280890:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1788391196.280899:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094215296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391196.280909:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1788391196.280917:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094215552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391196.281002:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094215296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391196.281010:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1788391196.281511:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094215552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 593us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391196.281519:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00080000:3.0:1788391196.281560:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391196.283092:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391196.283138:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215680 00000100:00100000:3.0:1788391196.283145:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215680 00000100:00100000:3.0:1788391196.283243:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1788391196.283252:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2359:x1875263094215680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391196.283301:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215808 00000100:00100000:1.0:1788391196.283308:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215808 00000100:00100000:3.0:1788391196.283328:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2359:x1875263094215680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391196.283336:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00080000:0.0:1788391196.283674:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391196.283679:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391196.283709:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215424 00000100:00100000:1.0:1788391196.283715:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215424 00000100:00100000:3.0:1788391196.283733:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391196.283758:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094215808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391196.283793:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094215808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391196.283804:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1788391196.283822:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1788391196.283832:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2359:x1875263094215424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:0.0:1788391196.283854:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391196.283864:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2359:x1875263094215424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391196.284203:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00010000:00010000:1.0:1788391196.626665:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391197.166648:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771179 is committed 00000100:00100000:0.0:1788391197.167098:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391197.167158:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094215936 00000100:00100000:3.0:1788391197.167167:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094215936 00000100:00100000:3.0:1788391197.167221:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:3.0:1788391197.167233:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36354:x1875263094215936:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788391197.167589:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36354:x1875263094215936:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 357us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391197.167596:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:0.0:1788391197.170057:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391197.170547:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216192 00000100:00100000:2.0:1788391197.170556:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216192 00000100:00100000:2.0:1788391197.170609:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391197.170619:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:36354:x1875263094216192:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391197.170844:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:36354:x1875263094216192:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 217us (786us total) trans 30064771347 rc 0/0 00000100:00100000:2.0:1788391197.170866:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788391197.337781:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391197.338866:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216320 00000100:00100000:2.0:1788391197.338879:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216320 00000100:00100000:2.0:1788391197.338948:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 313 00000100:00100000:2.0:1788391197.339007:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:36863:x1875263094216320:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788391197.339030:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391197.339051:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001ad expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339131:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339145:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339159:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391197.339195:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391197.339198:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391197.339222:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339246:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 7 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339265:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 6 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391197.339293:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:2.0:1788391197.339296:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391197.339300:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391197.339355:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:36863:x1875263094216320:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 396us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391197.339361:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 313 00010000:00010000:0.0:1788391197.645283:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391198.669208:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788391198.715420:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771346 is committed 00000001:00080000:3.0:1788391198.715443:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771347 is committed 00000020:00080000:3.0:1788391198.715467:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a69f7e40 refcount 2 committed 0 result 0 batchid 25769803908 00000020:00080000:3.0:1788391198.715472:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fd0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a69f7780 00000020:00080000:3.0:1788391198.715475:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a0fd0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58d3afc00 00000020:00080000:1.0:1788391198.715527:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803908 committed batchid 25769803907 00000020:00080000:1.0:1788391198.715652:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000001:00080000:1.0:1788391198.721388:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771140 is committed 00000001:00080000:1.0:1788391198.721480:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771148 is committed 00000001:00080000:1.0:1788391198.721646:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771138 is committed 00000001:02000400:0.0:1788391199.421197:0:46047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 19:19:58 (1788391198) 00000100:00100000:0.0:1788391199.695548:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103476992:0@lo:400:kworker.0 00000100:00100000:0.0:1788391199.695632:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391199.695695:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103477504:0@lo:400:kworker.0 00000100:00100000:3.0:1788391199.695703:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476992 00000100:00100000:3.0:1788391199.695711:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476992 00000100:00100000:0.0:1788391199.695721:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391199.695742:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788391199.695748:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103477120:0@lo:400:kworker.0 00000100:00100000:3.0:1788391199.695766:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788391199.695768:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391199.695775:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103476992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391199.695787:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103477632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391199.695807:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391199.695819:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103476992:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391199.695826:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788391199.695834:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771138 gen 2 00000004:00080000:0.0:1788391199.695839:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771138 committed transno 30064771138 00000100:00100000:3.0:1788391199.695843:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477120 00000100:00100000:3.0:1788391199.695845:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477120 00000100:00100000:0.0:1788391199.695858:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103476992:0@lo:400:kworker.0 00000100:00100000:3.0:1788391199.695873:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788391199.695878:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103477120:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788391199.695878:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391199.695882:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391199.695892:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477632 00000100:00100000:0.0:1788391199.695895:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477632 00000100:00100000:0.0:1788391199.695923:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788391199.695924:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103477120:12345-0@lo:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391199.695929:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103477632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391199.695930:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00000024:0.0:1788391199.695955:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 178847744 pending 0 free 3781165056 avail 3779067904 00000100:00100000:3.0:1788391199.695976:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771179 gen 2 00000004:00080000:3.0:1788391199.695980:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58b179180, transno 30064771179 00000100:00100000:3.0:1788391199.695988:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103477120:0@lo:400:kworker.0 00000100:00100000:0.0:1788391199.696002:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103477632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391199.696008:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788391199.696009:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103477632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391199.696113:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103476864:0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696149:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391199.696180:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103477376:0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696201:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391199.696223:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391199.696229:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103477248:0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696249:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391199.696275:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477504 00000100:00100000:2.0:1788391199.696279:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477504 00000100:00100000:2.0:1788391199.696311:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477376 00000100:00100000:2.0:1788391199.696315:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477376 00000100:00100000:2.0:1788391199.696328:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477248 00000100:00100000:2.0:1788391199.696331:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477248 00000100:00100000:2.0:1788391199.696341:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788391199.696346:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103477504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696379:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103477504:12345-0@lo:400:kworker.0 Request processed in 33us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391199.696385:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788391199.696405:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788391199.696412:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103477376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696455:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103477376:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391199.696460:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788391199.696472:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788391199.696478:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103477248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.696503:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103477248:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391199.696509:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788391199.696985:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391199.697009:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103477504:0@lo:400:kworker.0 00000100:00100000:0.0:1788391199.697040:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103476864 00000100:00100000:0.0:1788391199.697045:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103476864 00000100:00100000:0.0:1788391199.697076:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788391199.697083:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103476864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.697290:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103477248:0@lo:400:kworker.0 00000100:00100000:2.0:1788391199.697298:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103477376:0@lo:400:kworker.0 00010000:00010000:3.0:1788391199.697592:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391199.699690:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103476864:12345-0@lo:400:kworker.0 Request processed in 2598us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391199.699714:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788391199.706619:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103476864:0@lo:400:kworker.0 00000100:00100000:0.0:1788391200.395954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.396065:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216576 00000100:00100000:2.0:1788391200.396081:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216576 00000100:00080000:0.0:1788391200.396164:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391200.396180:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 314 00000100:00100000:2.0:1788391200.396193:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:37145:x1875263094216576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391200.396220:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391200.396243:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001b4 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396311:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396324:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396349:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396367:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396374:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396381:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396725:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396734:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396743:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391200.396752:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788391200.396920:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396929:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396936:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.396942:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391200.396953:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397009:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397021:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:2.0:1788391200.397024:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391200.397028:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397034:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd379d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397051:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397057:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397063:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397067:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391200.397069:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397074:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397080:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6830d2700) 00010000:00010000:2.0:1788391200.397082:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391200.397091:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397096:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd379dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397527:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001b4 expref: 24 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397548:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001b4 expref: 23 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.397555:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391200.397558:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391200.397561:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f400, rc 0) 00000100:00100000:2.0:1788391200.397631:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37145:x1875263094216576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1441us (1691us total) trans 30064771348 rc 0/0 00000100:00100000:2.0:1788391200.397641:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 314 00000100:00100000:0.0:1788391200.401690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.401780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.402178:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216832 00000100:00100000:2.0:1788391200.402188:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216832 00000100:00100000:2.0:1788391200.402252:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 315 00000100:00100000:2.0:1788391200.402263:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37145:x1875263094216832:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788391200.402393:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37145:x1875263094216832:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 131us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391200.402401:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 315 00000100:00100000:1.0:1788391200.403805:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216704 00000100:00100000:1.0:1788391200.403816:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216704 00000100:00100000:1.0:1788391200.403892:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1788391200.403901:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2358:x1875263094216704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391200.403915:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391200.403940:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd379e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001b4 expref: 23 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.404117:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391200.404123:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391200.404214:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2358:x1875263094216704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 314us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391200.404222:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1788391200.484343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.484439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.489753:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094216960 00000100:00100000:2.0:1788391200.489768:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094216960 00000100:00100000:2.0:1788391200.489854:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217216 00000100:00100000:2.0:1788391200.489873:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217216 00000100:00100000:2.0:1788391200.490038:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 316 00000100:00100000:2.0:1788391200.490051:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2359:x1875263094216960:12345-192.168.202.1@tcp:41:mkdir.0 00000004:00000024:2.0:1788391200.490102:0:43348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1788391200.490181:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2359:x1875263094216960:12345-192.168.202.1@tcp:41:mkdir.0 Request processed in 133us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391200.490188:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 316 00000100:00100000:2.0:1788391200.490206:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 317 00000100:00100000:2.0:1788391200.490213:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:37160:x1875263094217216:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:2.0:1788391200.490263:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391200.490291:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd3771a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc000db expref: 22 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.490311:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:2.0:1788391200.490316:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391200.490615:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.490630:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.490638:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.490669:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.490682:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 5 pid: 42645 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.490704:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103477760:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391200.490760:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788391200.494871:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.494912:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217344 00000100:00100000:2.0:1788391200.494920:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217344 00010000:00010000:2.0:1788391200.494991:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 6 pid: 42645 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.495019:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788391200.495030:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094217344:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391200.495043:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391200.495051:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 6 pid: 42645 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.495064:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 6 pid: 42645 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.495089:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:2.0:1788391200.495096:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.495106:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.495115:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.495167:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391200.495219:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094217344:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391200.495227:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00080000:2.0:1788391200.495265:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788391200.495545:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd379c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ad expref: 5 pid: 42645 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391200.495564:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103477760:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391200.495585:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.495596:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.495602:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.495671:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.495682:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.495700:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391200.496770:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1788391200.496782:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496790:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496797:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496802:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ea00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391200.496807:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496815:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496827:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391200.496830:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391200.496834:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.496839:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd379f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391200.496859:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000da01bbf reply state 00000000718bc9e1 transno 30064771349 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391200.496895:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391200.497004:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37160:x1875263094217216:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 6787us (12569us total) trans 30064771349 rc 0/0 00000100:00100000:1.0:1788391200.497015:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 317 00010000:00010000:1.0:1788391200.501085:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501100:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501105:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501109:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391200.501113:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501120:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501135:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff95d6a0d29000) 00010000:00010000:1.0:1788391200.501139:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391200.501143:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.501149:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd379f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.505355:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.505424:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217472 00000100:00100000:1.0:1788391200.505449:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217472 00000100:00100000:1.0:1788391200.505525:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 318 00000100:00100000:1.0:1788391200.505534:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:37161:x1875263094217472:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391200.505556:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391200.505574:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001bb expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505627:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505637:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505645:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391200.505672:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391200.505675:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391200.505688:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505706:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001bb expref: 24 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505718:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001bb expref: 23 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.505723:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391200.505725:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391200.505728:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7200, rc 0) 00000100:00100000:1.0:1788391200.505778:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37161:x1875263094217472:12345-192.168.202.1@tcp:101:dd.0 Request processed in 247us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391200.505788:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 318 00000100:00100000:2.0:1788391200.507261:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.507404:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217600 00000100:00100000:0.0:1788391200.507418:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217600 00000100:00100000:0.0:1788391200.507492:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 319 00000100:00100000:0.0:1788391200.507502:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:37161:x1875263094217600:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391200.507517:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391200.507531:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37a0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001c2 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507576:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507584:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507590:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507600:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507604:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507622:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507696:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd37a23 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507701:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd37a23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507706:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd37a23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391200.507722:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00000004:00200000:0.0:1788391200.507724:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391200.507735:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd37a23 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507743:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507747:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507751:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507755:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391200.507758:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507762:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507775:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:0.0:1788391200.507777:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391200.507780:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507784:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507792:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507795:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507798:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507802:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fae00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391200.507804:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507807:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507810:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff95d6a704cb00) 00010000:00010000:0.0:1788391200.507811:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391200.507813:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507816:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37a1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507841:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001c2 expref: 25 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507867:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa800/0x9aafc5f04cd37a23 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001c2 expref: 24 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391200.507874:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:0.0:1788391200.507876:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788391200.507878:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa800, rc 0) 00000100:00100000:0.0:1788391200.507946:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:37161:x1875263094217600:12345-192.168.202.1@tcp:101:dd.0 Request processed in 446us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391200.507952:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 319 00000100:00100000:2.0:1788391200.510051:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.510235:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217856 00000100:00100000:1.0:1788391200.510248:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217856 00000100:00100000:1.0:1788391200.510309:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 320 00000100:00100000:1.0:1788391200.510318:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:37161:x1875263094217856:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391200.510336:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391200.510356:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37a2a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001c9 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510478:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510491:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510501:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510514:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510521:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.510533:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391200.511101:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc8:0x0], index 1: 0 00010000:00010000:1.0:1788391200.511256:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a3f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511275:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a3f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511283:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a3f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511316:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511323:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511329:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511335:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391200.511339:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511346:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511357:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391200.511359:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391200.511364:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511370:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37a31 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391200.511382:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab67f364 reply state 000000007f6f31cd transno 30064771350 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391200.511397:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391200.511427:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37a2a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001c9 expref: 27 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511453:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a3f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001c9 expref: 26 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.511460:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391200.511462:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391200.511465:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7000, rc 0) 00000100:00100000:1.0:1788391200.511538:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:37161:x1875263094217856:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1221us (1501us total) trans 30064771350 rc 0/0 00000100:00100000:1.0:1788391200.511546:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 320 00010000:00010000:1.0:1788391200.513069:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513084:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513091:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513096:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391200.513100:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513107:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513142:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff95d6a0d29000) 00010000:00010000:1.0:1788391200.513145:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391200.513149:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.513156:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37a38 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.516549:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.516721:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094217984 00000100:00100000:3.0:1788391200.516736:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094217984 00000100:00100000:3.0:1788391200.516932:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788391200.516947:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:37161:x1875263094217984:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391200.516997:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391200.517024:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001d0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391200.517060:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391200.517086:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=1017s v=(0 0) 00010000:00010000:3.0:1788391200.517092:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391200.517103:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 10 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.517123:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 10 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.517158:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:3.0:1788391200.517233:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:37161:x1875263094217984:12345-192.168.202.1@tcp:101:dd.0 Request processed in 289us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391200.517241:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00080000:2.0:1788391200.517311:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391200.532078:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.532183:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218112 00000100:00100000:3.0:1788391200.532197:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218112 00002000:00100000:3.0:1788391200.532269:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff95d58b179180 x1875263094218112/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.532282:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179180 with x1875263094218112 ext(0->1048575) 00002000:00010000:3.0:1788391200.532289:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b179180 00000100:00100000:3.0:1788391200.532335:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788391200.532348:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094218112:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.545104:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.547054:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218240 00000100:00100000:3.0:1788391200.547070:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218240 00002000:00100000:2.0:1788391200.547304:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff95d58cb1ad80 x1875263094218240/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.547314:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1ad80 with x1875263094218240 ext(1048576->2097151) 00002000:00010000:2.0:1788391200.547320:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1ad80 00000100:00100000:2.0:1788391200.547353:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788391200.547362:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094218240:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.553100:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.553158:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218368 00000100:00100000:1.0:1788391200.553170:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218368 00002000:00100000:1.0:1788391200.553233:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff95d58cb1aa00 x1875263094218368/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.553247:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1aa00 with x1875263094218368 ext(2097152->3145727) 00002000:00010000:1.0:1788391200.553254:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1aa00 00000100:00100000:1.0:1788391200.553316:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788391200.553330:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094218368:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.560293:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094218112:12345-192.168.202.1@tcp:4:dd.0 Request processed in 27931us (28213us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1788391200.560311:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00002000:00100000:2.0:1788391200.560328:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff95d58b179180 x1875263094218112/t30064771180(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.560340:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179180 with x1875263094218112 ext(0->1048575) 00002000:00010000:2.0:1788391200.560348:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b179180 00000100:00100000:0.0:1788391200.567305:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094218240:12345-192.168.202.1@tcp:4:dd.0 Request processed in 19928us (22199us total) trans 30064771181 rc 0/0 00000100:00100000:0.0:1788391200.567322:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00002000:00100000:0.0:1788391200.567338:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff95d58cb1ad80 x1875263094218240/t30064771181(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.567350:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1ad80 with x1875263094218240 ext(1048576->2097151) 00002000:00010000:0.0:1788391200.567359:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1ad80 00000100:00100000:2.0:1788391200.571949:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094218368:12345-192.168.202.1@tcp:4:dd.0 Request processed in 18605us (18845us total) trans 30064771182 rc 0/0 00000100:00100000:2.0:1788391200.572000:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00002000:00100000:2.0:1788391200.572018:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff95d58cb1aa00 x1875263094218368/t30064771182(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.572030:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1aa00 with x1875263094218368 ext(2097152->3145727) 00002000:00010000:2.0:1788391200.572040:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1aa00 00000100:00100000:2.0:1788391200.572855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.572954:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218496 00000100:00100000:0.0:1788391200.572979:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218496 00002000:00100000:0.0:1788391200.573024:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff95d58b17b800 x1875263094218496/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.573032:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17b800 with x1875263094218496 ext(3145728->4194303) 00002000:00010000:0.0:1788391200.573036:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b17b800 00000100:00100000:0.0:1788391200.573079:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:0.0:1788391200.573088:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094218496:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.582860:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094218496:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9756us (9993us total) trans 30064771183 rc 0/0 00000100:00100000:0.0:1788391200.582876:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00002000:00100000:0.0:1788391200.582890:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff95d58b17b800 x1875263094218496/t30064771183(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.582901:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17b800 with x1875263094218496 ext(3145728->4194303) 00002000:00010000:0.0:1788391200.582908:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b17b800 00000100:00100000:2.0:1788391200.584457:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.584556:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218624 00000100:00100000:0.0:1788391200.584569:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218624 00002000:00100000:0.0:1788391200.584648:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff95d58b179c00 x1875263094218624/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.584660:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179c00 with x1875263094218624 ext(4194304->5242879) 00002000:00010000:0.0:1788391200.584666:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b179c00 00000100:00100000:0.0:1788391200.584701:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:0.0:1788391200.584713:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094218624:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.596487:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094218624:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11759us (12023us total) trans 30064771184 rc 0/0 00000100:00100000:0.0:1788391200.596507:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00002000:00100000:0.0:1788391200.596524:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff95d58b179c00 x1875263094218624/t30064771184(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.596537:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179c00 with x1875263094218624 ext(4194304->5242879) 00002000:00010000:0.0:1788391200.596562:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b179c00 00000100:00100000:2.0:1788391200.600320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.600811:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218752 00000100:00100000:1.0:1788391200.600825:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218752 00002000:00100000:1.0:1788391200.600898:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff95d58c3eaa00 x1875263094218752/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.600911:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eaa00 with x1875263094218752 ext(5242880->6291455) 00002000:00010000:1.0:1788391200.600917:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eaa00 00000100:00100000:1.0:1788391200.601028:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:1.0:1788391200.601047:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094218752:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.611022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.611111:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094218880 00000100:00100000:3.0:1788391200.611171:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094218880 00002000:00100000:3.0:1788391200.611231:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff95d587134e00 x1875263094218880/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.611243:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134e00 with x1875263094218880 ext(6291456->7340031) 00002000:00010000:3.0:1788391200.611249:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587134e00 00000100:00100000:3.0:1788391200.611286:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1788391200.611297:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2358:x1875263094218880:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.612704:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2357:x1875263094218752:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11649us (12394us total) trans 30064771185 rc 0/0 00000100:00100000:1.0:1788391200.612717:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00002000:00100000:1.0:1788391200.612728:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff95d58c3eaa00 x1875263094218752/t30064771185(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.612738:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3eaa00 with x1875263094218752 ext(5242880->6291455) 00002000:00010000:1.0:1788391200.612744:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c3eaa00 00000100:00100000:3.0:1788391200.623042:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.624275:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2358:x1875263094218880:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12972us (13259us total) trans 30064771186 rc 0/0 00000100:00100000:1.0:1788391200.624303:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00002000:00100000:1.0:1788391200.624320:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff95d587134e00 x1875263094218880/t30064771186(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.624331:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134e00 with x1875263094218880 ext(6291456->7340031) 00002000:00010000:1.0:1788391200.624339:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587134e00 00000100:00100000:1.0:1788391200.624374:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219008 00000100:00100000:1.0:1788391200.624383:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219008 00002000:00100000:1.0:1788391200.624424:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff95d587646300 x1875263094219008/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.624443:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646300 with x1875263094219008 ext(7340032->8388607) 00002000:00010000:1.0:1788391200.624447:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646300 00000100:00100000:1.0:1788391200.624483:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:1.0:1788391200.624494:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2359:x1875263094219008:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.635271:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.635338:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219136 00000100:00100000:3.0:1788391200.635349:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219136 00002000:00100000:3.0:1788391200.635480:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff95d58d2f9180 x1875263094219136/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.635490:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9180 with x1875263094219136 ext(8388608->9437183) 00002000:00010000:3.0:1788391200.635495:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2f9180 00000100:00100000:3.0:1788391200.635527:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:3.0:1788391200.635539:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094219136:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.636671:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094219008:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12172us (13634us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1788391200.636695:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00002000:00100000:1.0:1788391200.636704:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff95d587646300 x1875263094219008/t30064771187(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391200.636711:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646300 with x1875263094219008 ext(7340032->8388607) 00002000:00010000:1.0:1788391200.636715:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646300 00000100:00100000:0.0:1788391200.643268:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094219136:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7716us (7997us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1788391200.643286:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00002000:00100000:0.0:1788391200.643304:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff95d58d2f9180 x1875263094219136/t30064771188(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.643315:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9180 with x1875263094219136 ext(8388608->9437183) 00002000:00010000:0.0:1788391200.643324:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2f9180 00000100:00100000:2.0:1788391200.646931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.648541:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219264 00000100:00100000:3.0:1788391200.648559:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219264 00002000:00100000:3.0:1788391200.648632:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff95d58af8ed80 x1875263094219264/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.648647:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8ed80 with x1875263094219264 ext(9437184->10485759) 00002000:00010000:3.0:1788391200.648654:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58af8ed80 00000100:00100000:3.0:1788391200.648763:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1788391200.648776:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2358:x1875263094219264:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391200.659122:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2358:x1875263094219264:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10334us (12193us total) trans 30064771189 rc 0/0 00000100:00100000:3.0:1788391200.659141:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00002000:00100000:3.0:1788391200.659158:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff95d58af8ed80 x1875263094219264/t30064771189(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.659170:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8ed80 with x1875263094219264 ext(9437184->10485759) 00002000:00010000:3.0:1788391200.659178:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58af8ed80 00000100:00100000:0.0:1788391200.671997:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.672132:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219392 00000100:00100000:2.0:1788391200.672145:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219392 00002000:00100000:2.0:1788391200.672296:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff95d58d2fad80 x1875263094219392/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.672308:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fad80 with x1875263094219392 ext(10485760->11534335) 00002000:00010000:2.0:1788391200.672315:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fad80 00000100:00100000:2.0:1788391200.672364:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:2.0:1788391200.672377:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2358:x1875263094219392:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.679687:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2358:x1875263094219392:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7295us (7686us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788391200.679705:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00002000:00100000:2.0:1788391200.679720:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff95d58d2fad80 x1875263094219392/t30064771190(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.679756:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fad80 with x1875263094219392 ext(10485760->11534335) 00002000:00010000:2.0:1788391200.679764:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fad80 00000100:00100000:3.0:1788391200.683099:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.683237:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219520 00000100:00100000:0.0:1788391200.683257:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219520 00002000:00100000:0.0:1788391200.683327:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff95d587645880 x1875263094219520/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.683337:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645880 with x1875263094219520 ext(11534336->12582911) 00002000:00010000:0.0:1788391200.683342:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645880 00000100:00100000:0.0:1788391200.683374:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:0.0:1788391200.683383:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2357:x1875263094219520:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.691866:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2357:x1875263094219520:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8465us (8763us total) trans 30064771191 rc 0/0 00000100:00100000:0.0:1788391200.691886:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00002000:00100000:0.0:1788391200.691904:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff95d587645880 x1875263094219520/t30064771191(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.691943:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645880 with x1875263094219520 ext(11534336->12582911) 00002000:00010000:0.0:1788391200.691951:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645880 00000100:00100000:3.0:1788391200.695033:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.695125:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219648 00000100:00100000:0.0:1788391200.695137:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219648 00002000:00100000:0.0:1788391200.695197:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff95d587645c00 x1875263094219648/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.695208:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645c00 with x1875263094219648 ext(12582912->13631487) 00002000:00010000:0.0:1788391200.695213:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645c00 00000100:00100000:0.0:1788391200.695244:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:0.0:1788391200.695253:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2356:x1875263094219648:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.703869:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2356:x1875263094219648:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8599us (8830us total) trans 30064771192 rc 0/0 00000100:00100000:0.0:1788391200.703887:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00002000:00100000:0.0:1788391200.703933:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff95d587645c00 x1875263094219648/t30064771192(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.703945:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645c00 with x1875263094219648 ext(12582912->13631487) 00002000:00010000:0.0:1788391200.703953:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645c00 00000100:00100000:3.0:1788391200.705401:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.705519:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219776 00000100:00100000:2.0:1788391200.705531:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219776 00002000:00100000:2.0:1788391200.705692:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff95d587645180 x1875263094219776/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.705702:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645180 with x1875263094219776 ext(13631488->14680063) 00002000:00010000:2.0:1788391200.705707:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645180 00000100:00100000:2.0:1788391200.705798:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:2.0:1788391200.705810:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2357:x1875263094219776:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391200.713410:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2357:x1875263094219776:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7585us (8003us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1788391200.713442:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00002000:00100000:3.0:1788391200.713461:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff95d587645180 x1875263094219776/t30064771193(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.713473:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645180 with x1875263094219776 ext(13631488->14680063) 00002000:00010000:3.0:1788391200.713481:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645180 00010000:00010000:2.0:1788391200.717704:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391200.717913:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103477888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391200.718045:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391200.718172:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103477888 00000100:00100000:2.0:1788391200.718183:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103477888 00000100:00100000:2.0:1788391200.718259:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788391200.718273:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103477888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391200.718319:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 127729664 pending 0 free 3819962368 avail 3817865216 00000100:00100000:2.0:1788391200.718926:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103477888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 655us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391200.718935:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788391200.719140:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103477888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391200.719284:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.719446:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.719524:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094219904 00000100:00100000:3.0:1788391200.719531:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094219904 00000100:00100000:2.0:1788391200.719539:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220160 00000100:00100000:2.0:1788391200.719543:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220160 00002000:00100000:3.0:1788391200.719578:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff95d58d2fb100 x1875263094219904/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.719590:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fb100 with x1875263094219904 ext(14680064->15728639) 00002000:00010000:3.0:1788391200.719596:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fb100 00000100:00100000:3.0:1788391200.719626:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1788391200.719636:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2356:x1875263094219904:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.719768:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:2.0:1788391200.719777:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:37161:x1875263094220160:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:2.0:1788391200.720189:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:37161:x1875263094220160:12345-192.168.202.1@tcp:35:dd.0 Request processed in 412us (742us total) trans 30064771351 rc 0/0 00000100:00100000:2.0:1788391200.720217:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788391200.731598:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094219904:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11947us (12300us total) trans 30064771194 rc 0/0 00000100:00100000:3.0:1788391200.731616:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00002000:00100000:3.0:1788391200.731634:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff95d58d2fb100 x1875263094219904/t30064771194(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.731646:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fb100 with x1875263094219904 ext(14680064->15728639) 00002000:00010000:3.0:1788391200.731655:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fb100 00000100:00100000:1.0:1788391200.731847:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.732038:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220416 00000100:00100000:3.0:1788391200.732048:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220416 00000100:00100000:3.0:1788391200.732163:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 321 00000100:00100000:3.0:1788391200.732173:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:37162:x1875263094220416:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391200.732200:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391200.732227:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a54 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001d7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732365:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732384:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732397:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732413:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732420:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.732440:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391200.733029:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc9:0x0], index 0: 0 00010000:00010000:3.0:1788391200.733227:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37a69 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733238:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733255:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733298:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733306:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733314:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733320:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391200.733325:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733334:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733354:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:3.0:1788391200.733358:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391200.733365:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733372:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a5b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391200.733387:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064a0b6d7 reply state 00000000da427336 transno 30064771352 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391200.733398:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391200.733457:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a54 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d7 expref: 30 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733474:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37a69 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d7 expref: 29 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.733482:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:3.0:1788391200.733485:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391200.733487:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:3.0:1788391200.733560:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37162:x1875263094220416:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1387us (1713us total) trans 30064771352 rc 0/0 00000100:00100000:3.0:1788391200.733568:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 321 00000100:00100000:1.0:1788391200.742063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788391200.742255:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742270:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742280:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742286:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391200.742292:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742301:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742322:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff95d686a70e00) 00010000:00010000:2.0:1788391200.742325:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391200.742331:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.742337:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd37a62 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391200.742795:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220544 00000100:00100000:3.0:1788391200.742808:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220544 00000100:00100000:3.0:1788391200.742902:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788391200.742915:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+6:37162:x1875263094220544:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1788391200.742937:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391200.742986:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd37a77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001de expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391200.743023:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391200.743051:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=1017s v=(0 0) 00010000:00010000:3.0:1788391200.743056:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391200.743068:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd37a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001de expref: 7 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.743085:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d44b0022/0x9aafc5f04cd37a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001de expref: 7 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.743121:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1000, rc 0) 00000100:00100000:3.0:1788391200.743206:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:37162:x1875263094220544:12345-192.168.202.1@tcp:101:dd.0 Request processed in 293us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391200.743214:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00080000:2.0:1788391200.743481:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391200.767112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.767218:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220672 00000100:00100000:3.0:1788391200.767230:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220672 00002000:00100000:3.0:1788391200.767301:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff95d58d2fa680 x1875263094220672/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.767311:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fa680 with x1875263094220672 ext(0->1048575) 00002000:00010000:3.0:1788391200.767317:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2fa680 00000100:00100000:3.0:1788391200.767346:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1788391200.767354:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2357:x1875263094220672:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.779648:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094220672:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12279us (12536us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1788391200.779667:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00002000:00100000:2.0:1788391200.779683:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff95d58d2fa680 x1875263094220672/t30064771149(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.779711:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fa680 with x1875263094220672 ext(0->1048575) 00002000:00010000:2.0:1788391200.779718:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2fa680 00000100:00100000:0.0:1788391200.786649:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.786858:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220800 00000100:00100000:3.0:1788391200.786873:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220800 00002000:00100000:3.0:1788391200.786943:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff95d58d2f8e00 x1875263094220800/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.786956:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8e00 with x1875263094220800 ext(1048576->2097151) 00002000:00010000:3.0:1788391200.787003:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8e00 00000100:00100000:3.0:1788391200.787034:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1788391200.787046:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2357:x1875263094220800:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391200.795525:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094220800:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8464us (8881us total) trans 30064771150 rc 0/0 00000100:00100000:3.0:1788391200.795543:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00002000:00100000:3.0:1788391200.795580:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff95d58d2f8e00 x1875263094220800/t30064771150(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.795592:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8e00 with x1875263094220800 ext(1048576->2097151) 00002000:00010000:3.0:1788391200.795599:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8e00 00000100:00100000:1.0:1788391200.795770:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.796238:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094220928 00000100:00100000:3.0:1788391200.796249:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094220928 00002000:00100000:3.0:1788391200.796310:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff95d5853d0700 x1875263094220928/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.796321:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d0700 with x1875263094220928 ext(2097152->3145727) 00002000:00010000:3.0:1788391200.796325:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d0700 00000100:00100000:3.0:1788391200.796440:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:3.0:1788391200.796452:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094220928:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391200.806005:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094220928:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9539us (10219us total) trans 30064771151 rc 0/0 00000100:00100000:3.0:1788391200.806023:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00002000:00100000:3.0:1788391200.806040:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff95d5853d0700 x1875263094220928/t30064771151(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.806052:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d0700 with x1875263094220928 ext(2097152->3145727) 00002000:00010000:3.0:1788391200.806060:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d0700 00000100:00100000:0.0:1788391200.808225:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.808301:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221056 00000100:00100000:2.0:1788391200.808315:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221056 00002000:00100000:2.0:1788391200.808379:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff95d58d2f8380 x1875263094221056/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.808391:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8380 with x1875263094221056 ext(3145728->4194303) 00002000:00010000:2.0:1788391200.808397:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8380 00000100:00100000:2.0:1788391200.808448:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:2.0:1788391200.808461:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094221056:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.817323:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094221056:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8848us (9091us total) trans 30064771152 rc 0/0 00000100:00100000:2.0:1788391200.817342:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00002000:00100000:2.0:1788391200.817358:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff95d58d2f8380 x1875263094221056/t30064771152(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.817370:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8380 with x1875263094221056 ext(3145728->4194303) 00002000:00010000:2.0:1788391200.817378:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8380 00000100:00100000:0.0:1788391200.824587:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.824744:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221184 00000100:00100000:3.0:1788391200.824756:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221184 00002000:00100000:3.0:1788391200.824812:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff95d58d2faa00 x1875263094221184/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.824822:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2faa00 with x1875263094221184 ext(4194304->5242879) 00002000:00010000:3.0:1788391200.824833:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2faa00 00000100:00100000:3.0:1788391200.825025:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1788391200.825035:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094221184:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.833457:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094221184:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8396us (8858us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1788391200.833476:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00002000:00100000:2.0:1788391200.833493:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff95d58d2faa00 x1875263094221184/t30064771153(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.833507:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2faa00 with x1875263094221184 ext(4194304->5242879) 00002000:00010000:2.0:1788391200.833524:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2faa00 00000100:00100000:0.0:1788391200.842620:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.842804:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221312 00000100:00100000:3.0:1788391200.842818:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221312 00002000:00100000:3.0:1788391200.842892:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff95d58d2f8000 x1875263094221312/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.842902:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8000 with x1875263094221312 ext(5242880->6291455) 00002000:00010000:3.0:1788391200.842909:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8000 00000100:00100000:3.0:1788391200.842945:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1788391200.842955:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2358:x1875263094221312:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.854953:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2358:x1875263094221312:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11981us (12328us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1788391200.854997:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00002000:00100000:2.0:1788391200.855012:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff95d58d2f8000 x1875263094221312/t30064771154(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.855035:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8000 with x1875263094221312 ext(5242880->6291455) 00002000:00010000:2.0:1788391200.855044:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8000 00000100:00100000:0.0:1788391200.860149:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.860284:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221440 00000100:00100000:2.0:1788391200.860297:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221440 00002000:00100000:2.0:1788391200.860367:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff95d58d2f8a80 x1875263094221440/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.860381:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8a80 with x1875263094221440 ext(6291456->7340031) 00002000:00010000:2.0:1788391200.860388:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8a80 00000100:00100000:2.0:1788391200.860445:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:2.0:1788391200.860458:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094221440:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.869649:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094221440:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9175us (9498us total) trans 30064771155 rc 0/0 00000100:00100000:2.0:1788391200.869668:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00002000:00100000:2.0:1788391200.869684:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff95d58d2f8a80 x1875263094221440/t30064771155(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.869696:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8a80 with x1875263094221440 ext(6291456->7340031) 00002000:00010000:2.0:1788391200.869704:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8a80 00000100:00100000:0.0:1788391200.875648:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.876522:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221568 00000100:00100000:2.0:1788391200.876557:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221568 00002000:00100000:2.0:1788391200.876624:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff95d58d2f9500 x1875263094221568/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.876633:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9500 with x1875263094221568 ext(7340032->8388607) 00002000:00010000:2.0:1788391200.876639:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9500 00000100:00100000:2.0:1788391200.876673:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:2.0:1788391200.876682:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094221568:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.886095:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.886272:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221696 00000100:00100000:2.0:1788391200.886295:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221696 00002000:00100000:2.0:1788391200.886424:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff95d5853d3100 x1875263094221696/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.886448:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3100 with x1875263094221696 ext(8388608->9437183) 00002000:00010000:2.0:1788391200.886456:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d3100 00000100:00100000:2.0:1788391200.886558:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:2.0:1788391200.886571:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094221696:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.888747:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094221568:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12054us (13104us total) trans 30064771156 rc 0/0 00000100:00100000:2.0:1788391200.888762:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00002000:00100000:2.0:1788391200.888776:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff95d58d2f9500 x1875263094221568/t30064771156(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.888787:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9500 with x1875263094221568 ext(7340032->8388607) 00002000:00010000:2.0:1788391200.888793:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9500 00000100:00100000:2.0:1788391200.893889:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.893931:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221824 00000100:00100000:2.0:1788391200.893981:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221824 00002000:00100000:2.0:1788391200.894043:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff95d58af8fb80 x1875263094221824/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.894056:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8fb80 with x1875263094221824 ext(9437184->10485759) 00002000:00010000:2.0:1788391200.894063:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8fb80 00000100:00100000:2.0:1788391200.894093:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1788391200.894105:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2359:x1875263094221824:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391200.895777:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094221696:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9200us (9698us total) trans 30064771157 rc 0/0 00000100:00100000:3.0:1788391200.895795:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00002000:00100000:3.0:1788391200.895806:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff95d5853d3100 x1875263094221696/t30064771157(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.895815:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3100 with x1875263094221696 ext(8388608->9437183) 00002000:00010000:3.0:1788391200.895821:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d3100 00000100:00100000:3.0:1788391200.900476:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.900748:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094221952 00000100:00100000:2.0:1788391200.900761:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094221952 00002000:00100000:2.0:1788391200.900827:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff95d587646d80 x1875263094221952/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.900842:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646d80 with x1875263094221952 ext(10485760->11534335) 00002000:00010000:2.0:1788391200.900849:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587646d80 00000100:00100000:2.0:1788391200.900888:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:2.0:1788391200.900900:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094221952:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391200.908944:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2359:x1875263094221824:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14822us (15051us total) trans 30064771158 rc 0/0 00000100:00100000:0.0:1788391200.909000:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00002000:00100000:0.0:1788391200.909019:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff95d58af8fb80 x1875263094221824/t30064771158(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.909031:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8fb80 with x1875263094221824 ext(9437184->10485759) 00002000:00010000:0.0:1788391200.909038:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8fb80 00000040:00080000:3.0:1788391200.909928:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391200.909936:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391200.910476:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:3.0:1788391200.910491:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391200.912804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.913027:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222080 00000100:00100000:2.0:1788391200.913040:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222080 00002000:00100000:2.0:1788391200.913103:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff95d5853d3800 x1875263094222080/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.913115:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3800 with x1875263094222080 ext(11534336->12582911) 00002000:00010000:2.0:1788391200.913122:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d3800 00000100:00100000:2.0:1788391200.913203:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:2.0:1788391200.913215:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2358:x1875263094222080:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.915423:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2359:x1875263094221952:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14511us (14950us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1788391200.915470:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00002000:00100000:2.0:1788391200.915486:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff95d587646d80 x1875263094221952/t30064771159(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.915498:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646d80 with x1875263094221952 ext(10485760->11534335) 00002000:00010000:2.0:1788391200.915506:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587646d80 00000100:00100000:2.0:1788391200.921118:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.921777:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222208 00000100:00100000:3.0:1788391200.921789:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222208 00002000:00100000:3.0:1788391200.921863:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff95d58af8df80 x1875263094222208/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.921875:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8df80 with x1875263094222208 ext(12582912->13631487) 00002000:00010000:3.0:1788391200.921882:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8df80 00000100:00100000:3.0:1788391200.921922:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1788391200.921934:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2358:x1875263094222208:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.922787:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2358:x1875263094222080:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9570us (9992us total) trans 30064771160 rc 0/0 00000100:00100000:2.0:1788391200.922799:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00002000:00100000:2.0:1788391200.922808:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff95d5853d3800 x1875263094222080/t30064771160(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391200.922817:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3800 with x1875263094222080 ext(11534336->12582911) 00002000:00010000:2.0:1788391200.922822:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d3800 00000100:00100000:0.0:1788391200.928934:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2358:x1875263094222208:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6988us (7815us total) trans 30064771161 rc 0/0 00000100:00100000:0.0:1788391200.928951:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00002000:00100000:0.0:1788391200.928989:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff95d58af8df80 x1875263094222208/t30064771161(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.929000:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8df80 with x1875263094222208 ext(12582912->13631487) 00002000:00010000:0.0:1788391200.929009:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8df80 00000100:00100000:3.0:1788391200.930834:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391200.930940:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222336 00000100:00100000:0.0:1788391200.930953:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222336 00002000:00100000:0.0:1788391200.931086:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff95d587644700 x1875263094222336/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.931098:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644700 with x1875263094222336 ext(13631488->14680063) 00002000:00010000:0.0:1788391200.931104:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587644700 00000100:00100000:0.0:1788391200.931141:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1788391200.931152:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2359:x1875263094222336:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391200.942320:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391200.942445:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.942766:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222464 00000100:00100000:3.0:1788391200.942780:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222464 00002000:00100000:3.0:1788391200.942844:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff95d58b15e680 x1875263094222464/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/0 e 0 to 0 dl 1788391211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391200.942856:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15e680 with x1875263094222464 ext(14680064->15728639) 00002000:00010000:3.0:1788391200.942863:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b15e680 00000100:00100000:3.0:1788391200.942938:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1788391200.942949:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2359:x1875263094222464:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391200.944062:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222720 00000100:00100000:1.0:1788391200.944071:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222720 00000100:00100000:1.0:1788391200.944129:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:1.0:1788391200.944139:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37162:x1875263094222720:12345-192.168.202.1@tcp:35:dd.0 00000001:00080000:1.0:1788391200.944481:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771353 00000100:00100000:1.0:1788391200.944621:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:37162:x1875263094222720:12345-192.168.202.1@tcp:35:dd.0 Request processed in 482us (2173us total) trans 30064771354 rc 0/0 00000100:00100000:1.0:1788391200.944631:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000020:00080000:1.0:1788391200.944638:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391200.944788:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2359:x1875263094222336:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13636us (13962us total) trans 30064771162 rc 0/0 00000100:00100000:0.0:1788391200.944798:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00002000:00100000:0.0:1788391200.944810:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff95d587644700 x1875263094222336/t30064771162(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.944821:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644700 with x1875263094222336 ext(13631488->14680063) 00002000:00010000:0.0:1788391200.944828:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587644700 00000100:00100000:0.0:1788391200.957030:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2359:x1875263094222464:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14066us (14707us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1788391200.957048:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00002000:00100000:0.0:1788391200.957065:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff95d58b15e680 x1875263094222464/t30064771163(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:61/0 lens 488/448 e 0 to 0 dl 1788391211 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391200.957077:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b15e680 with x1875263094222464 ext(14680064->15728639) 00002000:00010000:0.0:1788391200.957086:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b15e680 00000100:00100000:2.0:1788391200.964868:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.965006:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094222848 00000100:00100000:3.0:1788391200.965018:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094222848 00000100:00100000:3.0:1788391200.965090:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 322 00000100:00100000:3.0:1788391200.965102:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:37163:x1875263094222848:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788391200.965136:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391200.965163:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a7e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001e5 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965211:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965252:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965267:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965390:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37a7e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 33 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965413:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 32 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.965422:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391200.965438:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391200.965443:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:3.0:1788391200.965563:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:37163:x1875263094222848:12345-192.168.202.1@tcp:101:chown.0 Request processed in 462us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391200.965570:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 322 00000100:00100000:1.0:1788391200.971503:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.971724:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223104 00000100:00100000:3.0:1788391200.971738:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223104 00000100:00100000:3.0:1788391200.971808:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 323 00000100:00100000:3.0:1788391200.971820:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:37163:x1875263094223104:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:3.0:1788391200.971889:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391200.971925:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a3f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001c9 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.971948:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391200.972106:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391200.972223:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.972241:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391200.972254:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391200.972800:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].10, 88 off9000 00000004:00080000:2.0:1788391200.972820:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1018079858468ns, next at 1019079855548ns, rc = 0 00000004:00010000:2.0:1788391200.972920:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8b914a0 reply state 000000002d976c8c transno 30064771355 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.972930:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391200.973207:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37163:x1875263094223104:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1386us (1720us total) trans 30064771355 rc 0/0 00000100:00100000:2.0:1788391200.973215:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 323 00000100:00100000:2.0:1788391200.975218:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788391200.975302:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975340:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975349:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975356:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391200.975362:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975371:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975391:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391200.975394:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391200.975400:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.975406:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37a8c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391200.975559:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223232 00000100:00100000:3.0:1788391200.975571:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223232 00000100:00100000:3.0:1788391200.975635:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 324 00000100:00100000:3.0:1788391200.975647:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:37163:x1875263094223232:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788391200.975674:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391200.975695:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001ec expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.975765:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 33 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.975778:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 33 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.975798:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:3.0:1788391200.975801:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391200.975804:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:3.0:1788391200.975911:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37163:x1875263094223232:12345-192.168.202.1@tcp:101:chown.0 Request processed in 266us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391200.975919:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 324 00000100:00100000:0.0:1788391200.980650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.980881:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223360 00000100:00100000:3.0:1788391200.980895:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223360 00000100:00100000:3.0:1788391200.981068:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:3.0:1788391200.981081:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094223360:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:3.0:1788391200.981345:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1788391200.981349:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788391200 00002000:00010000:3.0:1788391200.981370:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391200.981372:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 0 -> 1788391201 00002000:00010000:3.0:1788391200.981374:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391200.981455:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094223360:12345-192.168.202.1@tcp:2:chown.0 Request processed in 376us (817us total) trans 30064771195 rc 0/0 00000100:00100000:3.0:1788391200.981463:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788391200.994787:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391200.995342:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223488 00000100:00100000:1.0:1788391200.995356:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223488 00000100:00100000:1.0:1788391200.995605:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 325 00000100:00100000:1.0:1788391200.995619:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37164:x1875263094223488:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391200.995648:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391200.995676:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a9a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001f3 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995752:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37aa1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995770:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37aa1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995783:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37aa1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995907:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37a9a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001f3 expref: 35 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995931:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7a00/0x9aafc5f04cd37aa1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001f3 expref: 34 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391200.995941:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:1.0:1788391200.995944:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391200.995948:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7a00, rc 0) 00000100:00100000:1.0:1788391200.996645:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:37164:x1875263094223488:12345-192.168.202.1@tcp:101:chown.0 Request processed in 1026us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391200.996655:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 325 00000100:00100000:2.0:1788391200.998367:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391200.998482:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223744 00000100:00100000:3.0:1788391200.998494:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223744 00000100:00100000:3.0:1788391200.998553:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:3.0:1788391200.998567:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:37164:x1875263094223744:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:3.0:1788391200.998633:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391200.998672:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37a69 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d7 expref: 34 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.998693:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:3.0:1788391200.998699:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391200.998738:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.998758:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391200.998769:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391200.999395:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].12, 88 off9080 00000004:00080000:2.0:1788391200.999421:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1018106459384ns, next at 1019106456883ns, rc = 0 00000004:00010000:2.0:1788391200.999534:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cd92f9c reply state 00000000b72fbfb2 transno 30064771356 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391200.999544:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391200.999662:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37164:x1875263094223744:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1097us (1303us total) trans 30064771356 rc 0/0 00000100:00100000:2.0:1788391200.999671:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 326 00010000:00010000:2.0:1788391201.000505:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000519:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000527:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000534:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391201.000553:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000562:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000579:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:2.0:1788391201.000582:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391201.000587:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.000593:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37aa8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391201.001041:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.001172:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094223872 00000100:00100000:0.0:1788391201.001183:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094223872 00000100:00100000:0.0:1788391201.001303:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:0.0:1788391201.001316:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:37164:x1875263094223872:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1788391201.001343:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391201.001363:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd37aaf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc001fa expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.001450:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd37aaf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001fa expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.001474:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb000/0x9aafc5f04cd37aaf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001fa expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.001496:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:0.0:1788391201.001499:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391201.001502:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb000, rc 0) 00000100:00100000:0.0:1788391201.001559:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37164:x1875263094223872:12345-192.168.202.1@tcp:101:chown.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.001567:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:3.0:1788391201.006760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.006877:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224000 00000100:00100000:0.0:1788391201.006892:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224000 00000100:00100000:0.0:1788391201.007570:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1788391201.007636:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2358:x1875263094224000:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:0.0:1788391201.007899:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:0.0:1788391201.007904:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788391201 00002000:00010000:0.0:1788391201.007907:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391201.007909:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 0 -> 1788391201 00002000:00010000:0.0:1788391201.007911:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391201.011855:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2358:x1875263094224000:12345-192.168.202.1@tcp:2:chown.0 Request processed in 4206us (5091us total) trans 30064771164 rc 0/0 00000100:00100000:0.0:1788391201.011871:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788391201.063233:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.063350:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224128 00000100:00100000:1.0:1788391201.063363:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224128 00000100:00100000:1.0:1788391201.063445:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:1.0:1788391201.063456:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37170:x1875263094224128:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.063482:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.063505:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00201 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063606:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063621:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063631:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.063669:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1788391201.063672:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391201.063693:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063717:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00201 expref: 37 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063733:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00201 expref: 36 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.063740:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391201.063743:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391201.063746:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6c00, rc 0) 00000100:00100000:1.0:1788391201.063807:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:37170:x1875263094224128:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 353us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.063819:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:3.0:1788391201.068092:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.068452:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224256 00000100:00100000:1.0:1788391201.068465:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224256 00000100:00100000:1.0:1788391201.068575:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:1.0:1788391201.068588:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:37170:x1875263094224256:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.068619:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.068647:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37ac4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00208 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068736:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068753:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068766:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068783:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068789:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068796:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068939:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068950:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.068957:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.069044:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:1.0:1788391201.069049:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391201.069071:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069084:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069093:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069101:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069108:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069116:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.069121:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069130:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069144:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391201.069147:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.069153:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069159:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37acb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069191:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069198:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069204:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069210:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.069213:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069219:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069228:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff95d6a0d29000) 00010000:00010000:1.0:1788391201.069230:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.069233:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069239:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37ad2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069275:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37ac4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 38 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069290:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 37 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.069310:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.069313:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.069316:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6400, rc 0) 00000100:00100000:1.0:1788391201.069406:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:37170:x1875263094224256:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 821us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.069414:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:3.0:1788391201.076951:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.077159:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224512 00000100:00100000:1.0:1788391201.077183:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224512 00000100:00100000:1.0:1788391201.077419:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:1.0:1788391201.077442:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:37170:x1875263094224512:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.077469:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.077494:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37ae0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0020f expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.077630:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37ae7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.077648:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37ae7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.077662:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37ae7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.077676:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1788391201.077839:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37ae0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0020f expref: 40 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.077885:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37ae7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0020f expref: 39 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.077895:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.077899:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.077902:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6a00, rc 0) 00000100:00100000:1.0:1788391201.078002:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:37170:x1875263094224512:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 563us (1062us total) trans 30064771357 rc 0/0 00000100:00100000:1.0:1788391201.078011:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:2.0:1788391201.080713:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.080759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.080854:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224640 00000100:00100000:1.0:1788391201.080866:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224640 00000100:00100000:1.0:1788391201.080948:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1788391201.080985:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094224640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391201.081008:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.081037:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37ae7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0020f expref: 39 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.081060:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.081066:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.081121:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2359:x1875263094224640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.081128:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1788391201.087483:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094224896 00000100:00100000:0.0:1788391201.087507:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094224896 00000100:00100000:0.0:1788391201.087756:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:0.0:1788391201.087770:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37170:x1875263094224896:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391201.087824:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391201.087851:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37af5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00216 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.087994:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.088013:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.088027:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391201.088041:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:0.0:1788391201.088342:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37af5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00216 expref: 41 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.088362:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00216 expref: 40 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.088372:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391201.088375:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391201.088380:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788391201.088532:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:37170:x1875263094224896:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 765us (7772us total) trans 30064771358 rc 0/0 00000100:00100000:0.0:1788391201.088541:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:2.0:1788391201.166709:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.166788:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225024 00000100:00100000:0.0:1788391201.166803:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225024 00000100:00100000:0.0:1788391201.166888:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788391201.166922:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2359:x1875263094225024:12345-192.168.202.1@tcp:1:lfs.500 00010000:00010000:0.0:1788391201.167011:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.167039:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 41 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.167049:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788391201.167055:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391201.167061:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.167108:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 41 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.167125:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 41 pid: 43328 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391201.167142:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103478016:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391201.167265:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692fd0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391201.169695:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103478016:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391201.169732:0:43698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391201.176357:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.176458:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225152 00000100:00100000:1.0:1788391201.176472:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225152 00010000:00010000:1.0:1788391201.176529:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 42 pid: 43328 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.176601:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1788391201.176613:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094225152:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391201.176631:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.176660:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 42 pid: 43328 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.176675:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 42 pid: 43328 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.176755:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134783e5/0x9aafc5f04cd37a4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001d0 expref: 42 pid: 43328 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.176779:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391201.176784:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391201.176792:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.176803:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.176846:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.176910:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094225152:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 299us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.176918:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00010000:00010000:0.0:1788391201.177167:0:43698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177188:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177218:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177227:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177236:0:43698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177244:0:43698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391201.177249:0:43698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177258:0:43698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177273:0:43698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.177282:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000003bb756/0x9aafc5f04cd37b0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391201.177386:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2359:x1875263094225024:12345-192.168.202.1@tcp:1:lfs.500 Request processed in 10467us (10691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.177395:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788391201.179588:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.179746:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225408 00000100:00100000:1.0:1788391201.179759:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225408 00000100:00100000:1.0:1788391201.179912:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788391201.179924:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:37170:x1875263094225408:12345-192.168.202.1@tcp:35:lfs.500 00000004:00010000:1.0:1788391201.180027:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00216 expref: 40 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391201.180376:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771359 00000001:00080000:1.0:1788391201.180449:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771360 00000001:00080000:1.0:1788391201.181124:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771361 00010000:00010000:1.0:1788391201.181197:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181218:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181227:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 44 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181236:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181245:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181289:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181307:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 44 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.181335:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478144:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391201.181474:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 44 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181485:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 44 pid: 42645 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.181495:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478272:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391201.181527:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.181536:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 44 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.181546:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478400:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391201.181568:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead180 going to sleep for 11 seconds 00000100:00100000:1.0:1788391201.184457:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478144:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391201.184473:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478272:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391201.186248:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.186281:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.186344:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.186501:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225536 00000100:00100000:1.0:1788391201.186512:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225536 00010000:00010000:1.0:1788391201.186566:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 45 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.186612:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225664 00000100:00100000:1.0:1788391201.186633:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225664 00010000:00010000:1.0:1788391201.186650:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 46 pid: 42645 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.186676:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225792 00000100:00100000:1.0:1788391201.186679:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225792 00010000:00010000:1.0:1788391201.186693:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 47 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.186716:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788391201.186728:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094225536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391201.186746:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.186754:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 47 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186770:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 47 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186794:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd37a93 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001ec expref: 47 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186812:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.186817:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186827:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186834:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.186892:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2357:x1875263094225536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 167us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.186901:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788391201.186919:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788391201.186925:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2357:x1875263094225664:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391201.186948:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.186953:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 45 pid: 42645 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.186998:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 45 pid: 42645 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187011:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37ad9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00208 expref: 45 pid: 42645 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187020:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.187024:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187031:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187037:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.187052:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2357:x1875263094225664:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 128us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.187058:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:1.0:1788391201.187068:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1788391201.187074:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2356:x1875263094225792:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391201.187088:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.187093:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 43 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187103:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 43 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187114:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.187117:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187124:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187132:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187151:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.187170:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2356:x1875263094225792:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 96us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.187176:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00010000:00010000:1.0:1788391201.187218:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37a85 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001e5 expref: 42 pid: 42646 timeout: 1118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.187230:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103478400:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391201.187263:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187288:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.187301:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391201.188175:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771362 00000001:00080000:1.0:1788391201.188436:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771363 00000100:00100000:1.0:1788391201.188558:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103478528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391201.188622:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391201.188650:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc264540 going to sleep for 11 seconds 00000100:00100000:3.0:1788391201.188850:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103478528 00000100:00100000:3.0:1788391201.188871:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103478528 00000100:00100000:3.0:1788391201.188945:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788391201.188956:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103478528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391201.189070:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103478528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391201.189077:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788391201.189169:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391201.190125:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103478528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391201.190834:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771364 00000100:00100000:1.0:1788391201.190921:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103478656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391201.191579:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391201.191671:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b4ead180 going to sleep for 11 seconds 00000100:00100000:3.0:1788391201.191899:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103478656 00000100:00100000:3.0:1788391201.191908:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103478656 00000100:00100000:3.0:1788391201.192103:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788391201.192116:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103478656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391201.192376:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103478656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 263us (798us total) trans 30064771196 rc 0/0 00000100:00100000:3.0:1788391201.192384:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788391201.192531:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103478656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391201.192612:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771365 00010000:00010000:1.0:1788391201.192664:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192677:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192686:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192693:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.192703:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192735:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192756:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.192759:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788391201.192765:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.192771:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b11 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391201.193359:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788391201.193615:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].11, 64 off9064 00000001:00080000:1.0:1788391201.193630:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771366 00010000:00010000:1.0:1788391201.193671:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.193675:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391201.193684:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37afc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00216 expref: 46 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.193827:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37170:x1875263094225408:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 13904us (14251us total) trans 30064771367 rc 0/0 00000100:00100000:1.0:1788391201.193837:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000020:00080000:1.0:1788391201.193841:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788391201.201053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.201105:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094225920 00000100:00100000:1.0:1788391201.201120:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094225920 00000100:00100000:1.0:1788391201.201193:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:1.0:1788391201.201207:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37170:x1875263094225920:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391201.201239:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.201477:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37b18 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0021d expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.201697:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37b18 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0021d expref: 46 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.201716:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37b18 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0021d expref: 46 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.201737:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391201.201741:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391201.201746:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df7000, rc 0) 00000100:00100000:1.0:1788391201.201833:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:37170:x1875263094225920:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 630us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.201842:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:0.0:1788391201.205183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.205239:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094226176 00000100:00100000:3.0:1788391201.205253:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094226176 00000100:00100000:3.0:1788391201.205420:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391201.205447:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:37170:x1875263094226176:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:3.0:1788391201.205760:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:37170:x1875263094226176:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 317us (589us total) trans 30064771368 rc 0/0 00000100:00100000:3.0:1788391201.205768:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:0.0:1788391201.251831:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.252500:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094226304 00000100:00100000:1.0:1788391201.252515:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094226304 00000100:00100000:1.0:1788391201.252593:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:1.0:1788391201.252607:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:37176:x1875263094226304:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.252642:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.252671:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b1f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00224 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252757:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252774:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252808:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252829:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252835:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.252841:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253018:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253028:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253035:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.253067:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000004:00200000:1.0:1788391201.253071:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391201.253090:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253102:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253108:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253121:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253126:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253131:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.253137:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253143:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253155:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391201.253157:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.253160:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253165:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd37b26 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253176:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253179:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253183:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253186:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.253191:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253195:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253199:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.253200:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.253202:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253205:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd37b2d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253230:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6a00/0x9aafc5f04cd37b1f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00224 expref: 49 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253239:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6000/0x9aafc5f04cd37b34 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00224 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.253243:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:1.0:1788391201.253244:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.253246:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6000, rc 0) 00000100:00100000:0.0:1788391201.253438:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37176:x1875263094226304:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 831us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.253448:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:2.0:1788391201.257576:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.257827:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094226560 00000100:00100000:1.0:1788391201.257840:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094226560 00000100:00100000:1.0:1788391201.257954:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00100000:1.0:1788391201.258005:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37176:x1875263094226560:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.258034:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.258062:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37b3b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0022b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.258224:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37b42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.258241:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37b42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.258254:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37b42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.258268:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:1.0:1788391201.258550:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6800/0x9aafc5f04cd37b3b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0022b expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.258574:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37b42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0022b expref: 50 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.258585:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:1.0:1788391201.258588:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.258592:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdde00, rc 0) 00000100:00100000:0.0:1788391201.258800:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:37176:x1875263094226560:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 795us (1233us total) trans 30064771369 rc 0/0 00000100:00100000:0.0:1788391201.258810:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00100000:3.0:1788391201.261798:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.261853:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.261904:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094226944 00000100:00100000:1.0:1788391201.261917:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094226944 00000100:00100000:1.0:1788391201.262037:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1788391201.262048:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094226816 00000100:00100000:1.0:1788391201.262050:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:2359:x1875263094226944:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788391201.262056:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094226816 00010000:00010000:1.0:1788391201.262075:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.262109:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37b42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0022b expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391201.262117:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:0.0:1788391201.262131:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:37176:x1875263094226816:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391201.262159:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:0.0:1788391201.262160:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.262167:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391201.262184:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37b50 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00232 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.262234:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:2359:x1875263094226944:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 186us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.262242:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:0.0:1788391201.262320:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37b57 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.262348:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37b57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.262374:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37b57 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391201.262392:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:0.0:1788391201.262576:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37b50 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00232 expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.262590:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37b57 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00232 expref: 51 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.262598:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:0.0:1788391201.262602:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391201.262605:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788391201.262632:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:37176:x1875263094226816:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 504us (846us total) trans 30064771370 rc 0/0 00000100:00100000:0.0:1788391201.262639:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:2.0:1788391201.304811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.304887:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094227072 00000100:00100000:3.0:1788391201.304900:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094227072 00000100:00100000:1.0:1788391201.305153:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1788391201.305169:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:37176:x1875263094227072:12345-192.168.202.1@tcp:103:lfs.500 00010000:00010000:1.0:1788391201.305190:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.305222:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37b57 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00232 expref: 51 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.305246:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff95d686a70f00) 00010000:00010000:1.0:1788391201.305253:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391201.305337:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:37176:x1875263094227072:12345-192.168.202.1@tcp:103:lfs.500 Request processed in 173us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.305345:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1788391201.315197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.315264:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094227328 00000100:00100000:3.0:1788391201.315278:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094227328 00000100:00100000:3.0:1788391201.315472:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1788391201.315505:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:37176:x1875263094227328:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:3.0:1788391201.315824:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:37176:x1875263094227328:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 321us (639us total) trans 30064771371 rc 0/0 00000100:00100000:3.0:1788391201.315833:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1788391201.339311:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.339652:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094227584 00000100:00100000:2.0:1788391201.339672:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094227584 00000100:00100000:2.0:1788391201.339769:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391201.339782:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:37176:x1875263094227584:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:2.0:1788391201.340198:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37176:x1875263094227584:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 417us (899us total) trans 30064771372 rc 0/0 00000100:00100000:2.0:1788391201.340208:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391201.400605:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.400694:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094227712 00000100:00100000:0.0:1788391201.400708:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094227712 00000100:00100000:0.0:1788391201.401192:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788391201.401209:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094227712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391201.401317:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094227712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 113us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.401326:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:2.0:1788391201.404310:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.404389:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094227968 00000100:00100000:1.0:1788391201.404500:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094227968 00000100:00100000:1.0:1788391201.404562:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 336 00000100:00100000:1.0:1788391201.404570:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37186:x1875263094227968:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391201.404599:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.404620:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00239 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.404736:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1788391201.404884:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37b65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00239 expref: 54 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.404899:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391201.404902:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391201.404906:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00239 expref: 54 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.404918:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc000, rc 0) 00000100:00100000:1.0:1788391201.405275:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37186:x1875263094227968:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 704us (974us total) trans 30064771373 rc 301/301 00000100:00100000:1.0:1788391201.405284:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 336 00000100:00100000:1.0:1788391201.408344:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.408450:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094228096 00000100:00100000:0.0:1788391201.408466:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094228096 00000100:00100000:0.0:1788391201.408549:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:0.0:1788391201.408559:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37186:x1875263094228096:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391201.408662:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408683:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408696:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408712:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408719:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408726:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408840:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408849:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408856:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391201.408907:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408922:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408934:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408939:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408944:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391201.408949:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.408957:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409031:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:0.0:1788391201.409035:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391201.409041:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409049:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37b73 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409061:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409065:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409069:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409072:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391201.409080:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409084:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409090:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff95d6a704cb00) 00010000:00010000:0.0:1788391201.409092:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391201.409093:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409097:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b7a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409108:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409111:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409114:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409126:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391201.409128:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409132:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409136:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:0.0:1788391201.409138:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391201.409144:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.409148:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b81 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391201.409221:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37186:x1875263094228096:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 663us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.409228:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:2.0:1788391201.411550:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.411805:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094228352 00000100:00100000:1.0:1788391201.411818:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094228352 00000100:00100000:1.0:1788391201.412042:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1788391201.412056:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37186:x1875263094228352:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391201.412352:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:37186:x1875263094228352:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 299us (810us total) trans 30064771374 rc 0/0 00000100:00100000:1.0:1788391201.412366:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1788391201.465375:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.465519:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094228608 00000100:00100000:0.0:1788391201.465533:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094228608 00000100:00100000:0.0:1788391201.465650:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 338 00000100:00100000:0.0:1788391201.465661:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:37196:x1875263094228608:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391201.465691:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391201.465726:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00240 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.465840:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b8f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.465854:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b8f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.465865:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b8f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391201.465875:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:0.0:1788391201.466039:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37b88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00240 expref: 57 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.466055:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb200/0x9aafc5f04cd37b8f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00240 expref: 56 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.466069:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:0.0:1788391201.466071:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391201.466074:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb200, rc 0) 00000100:00100000:0.0:1788391201.466139:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:37196:x1875263094228608:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 480us (775us total) trans 30064771375 rc 0/0 00000100:00100000:0.0:1788391201.466148:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 338 00000100:00100000:0.0:1788391201.511031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.511156:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094228864 00000100:00100000:1.0:1788391201.511170:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094228864 00000100:00100000:1.0:1788391201.511237:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 339 00000100:00100000:1.0:1788391201.511248:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:37202:x1875263094228864:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391201.511275:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.511298:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37b9d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00247 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511419:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511449:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511471:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511483:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511491:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511498:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511632:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bb2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511638:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511643:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.511651:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1788391201.511741:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511759:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511766:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511772:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdda00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.511777:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511786:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511800:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391201.511802:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.511807:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511811:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37ba4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511823:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511826:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511830:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511834:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.511840:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511844:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511849:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.511850:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.511851:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511855:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37bab lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511891:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37b9d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00247 expref: 59 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511901:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bb2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00247 expref: 58 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.511906:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391201.511907:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.511909:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:1.0:1788391201.512018:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094228864:12345-192.168.202.1@tcp:101:dd.500 Request processed in 771us (1002us total) trans 30064771376 rc 0/0 00000100:00100000:1.0:1788391201.512024:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 339 00000100:00100000:2.0:1788391201.514482:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.514574:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229120 00000100:00100000:1.0:1788391201.514585:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229120 00000100:00100000:1.0:1788391201.514718:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 340 00000100:00100000:1.0:1788391201.514729:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094229120:12345-192.168.202.1@tcp:36:dd.500 00010000:00010000:1.0:1788391201.514810:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391201.514839:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bb2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00247 expref: 58 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.514858:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391201.514862:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391201.515138:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.515154:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.515165:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391201.515218:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771377 00000004:00010000:1.0:1788391201.515244:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032d739e6 reply state 00000000d73127d4 transno 30064771378 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.515253:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391201.515373:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37202:x1875263094229120:12345-192.168.202.1@tcp:36:dd.500 Request processed in 645us (902us total) trans 30064771378 rc 0/0 00000100:00100000:1.0:1788391201.515380:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 340 00000020:00080000:1.0:1788391201.515384:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391201.519514:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519537:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519545:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519567:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.519573:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519581:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519602:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391201.519605:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.519611:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.519617:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bc0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391201.701270:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.701491:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229376 00000100:00100000:3.0:1788391201.701505:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229376 00000100:00100000:3.0:1788391201.701654:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1788391201.701667:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37202:x1875263094229376:12345-192.168.202.1@tcp:103:dd.500 00010000:00010000:3.0:1788391201.701688:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391201.701718:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7000/0x9aafc5f04cd37b18 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0021d expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.701744:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:3.0:1788391201.701757:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391201.701826:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094229376:12345-192.168.202.1@tcp:103:dd.500 Request processed in 162us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391201.701833:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1788391201.711564:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.711724:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229504 00000100:00100000:3.0:1788391201.711738:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229504 00000100:00100000:3.0:1788391201.711818:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 341 00000100:00100000:3.0:1788391201.711830:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094229504:12345-192.168.202.1@tcp:58:dd.500 00010000:00010000:3.0:1788391201.711999:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.712016:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.712049:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788391201.712400:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].9, 136 off9416 00000100:00100000:3.0:1788391201.712627:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094229504:12345-192.168.202.1@tcp:58:dd.500 Request processed in 798us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391201.712634:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 341 00000100:00100000:2.0:1788391201.714296:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.714385:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229632 00000100:00100000:0.0:1788391201.714398:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229632 00000100:00100000:0.0:1788391201.714522:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 342 00000100:00100000:0.0:1788391201.714533:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:37202:x1875263094229632:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391201.714554:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391201.714577:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0024e expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.714874:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.714888:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 59 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.714912:0:43348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.714926:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 59 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.714998:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:0.0:1788391201.715001:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391201.715005:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 59 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391201.715012:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa000, rc 0) 00000100:00100000:0.0:1788391201.715066:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37202:x1875263094229632:12345-192.168.202.1@tcp:101:dd.500 Request processed in 537us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.715072:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 342 00010000:00010000:3.0:1788391201.742549:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391201.935471:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391201.935484:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391201.935557:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:1.0:1788391201.935565:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391201.935739:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103478784:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788391201.935930:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391201.938946:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103478784:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788391201.939747:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.940024:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229760 00000100:00100000:1.0:1788391201.940034:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229760 00000100:00100000:1.0:1788391201.940098:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 343 00000100:00100000:1.0:1788391201.940110:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37203:x1875263094229760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788391201.940149:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788391201.940693:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37203:x1875263094229760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 581us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.940701:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 343 00000100:00100000:2.0:1788391201.946117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.946303:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094229888 00000100:00100000:1.0:1788391201.946317:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094229888 00000100:00100000:1.0:1788391201.946402:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 344 00000100:00100000:1.0:1788391201.946416:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37203:x1875263094229888:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788391201.946525:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946547:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946565:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946583:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946590:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946597:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946625:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946634:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.946641:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391201.947308:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00000004:00200000:1.0:1788391201.947315:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391201.947333:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947346:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947353:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947360:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947365:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.947370:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947378:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947392:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391201.947395:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.947400:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947406:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37bd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947432:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947450:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947456:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947460:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.947464:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947470:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947477:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xcbfe478c (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.947480:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.947482:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947488:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37bdc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947503:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947509:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947515:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947519:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.947527:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947533:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947539:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391201.947542:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391201.947545:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.947550:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37be3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.947647:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37203:x1875263094229888:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1233us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.947656:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 344 00000100:00100000:2.0:1788391201.952106:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.952279:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094230144 00000100:00100000:3.0:1788391201.952291:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094230144 00000100:00100000:3.0:1788391201.952365:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 345 00000100:00100000:3.0:1788391201.952377:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:37203:x1875263094230144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391201.952405:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391201.952442:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37bea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00255 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952581:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952600:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952614:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391201.952627:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00010000:00010000:3.0:1788391201.952756:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952787:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952794:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952801:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391201.952806:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952815:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952830:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:3.0:1788391201.952832:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391201.952838:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952844:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd37bf1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952896:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37bea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00255 expref: 61 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952907:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391201.952910:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391201.952914:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd37bea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00255 expref: 61 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391201.952924:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:3.0:1788391201.953059:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 684us (968us total) trans 30064771379 rc 301/301 00000100:00100000:3.0:1788391201.953068:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 345 00000100:00100000:2.0:1788391201.956558:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391201.957134:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094230272 00000100:00100000:0.0:1788391201.957148:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094230272 00000100:00100000:0.0:1788391201.961442:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 346 00000100:00100000:0.0:1788391201.961485:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc722850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230272:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788391201.961540:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788391201.961685:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc722850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230272:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 226us (5141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391201.961694:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 346 00000100:00100000:2.0:1788391201.965284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.965465:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094230528 00000100:00100000:1.0:1788391201.965477:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094230528 00000100:00100000:1.0:1788391201.965550:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 347 00000100:00100000:1.0:1788391201.965561:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391201.965587:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.965591:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391201.965626:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd37abd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00201 expref: 60 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.965649:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391201.965654:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391201.965669:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37bff lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0025c expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391201.966277:0:42645:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc9:0x0], index 1: 0 00010000:00010000:1.0:1788391201.966530:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37c06 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.966547:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37c06 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.966557:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37c06 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.966616:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37bff lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0025c expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.966635:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37c06 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0025c expref: 61 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.966643:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391201.966646:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391201.966648:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd200, rc 0) 00000100:00100000:1.0:1788391201.966732:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:37203:x1875263094230528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1170us (1459us total) trans 30064771380 rc 0/0 00000100:00100000:1.0:1788391201.966741:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 347 00000100:00100000:1.0:1788391201.971625:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.971757:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094230784 00000100:00100000:2.0:1788391201.971770:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094230784 00000100:00100000:2.0:1788391201.971841:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 348 00000100:00100000:2.0:1788391201.971854:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:37203:x1875263094230784:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391201.971932:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391201.972044:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd200/0x9aafc5f04cd37c06 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0025c expref: 61 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972066:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391201.972101:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391201.972131:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972146:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972156:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972169:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972175:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972180:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972252:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972257:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972263:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972268:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391201.972273:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972280:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972293:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:2.0:1788391201.972295:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391201.972299:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972304:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37c14 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972316:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972320:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972325:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972329:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391201.972332:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972336:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972341:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x3e24b63d (ffff95d6830d2700) 00010000:00010000:2.0:1788391201.972342:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391201.972344:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.972348:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c1b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x3e24b63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391201.972443:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230784:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 592us (832us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788391201.972450:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 348 00000100:00100000:2.0:1788391201.974356:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.974468:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094230912 00000100:00100000:1.0:1788391201.974479:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094230912 00000100:00100000:1.0:1788391201.974595:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 349 00000100:00100000:1.0:1788391201.974608:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:37203:x1875263094230912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391201.974648:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391201.974675:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c22 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00263 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974716:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974731:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974744:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974860:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c22 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974881:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 61 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.974891:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391201.974894:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391201.974897:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdda00, rc 0) 00000100:00100000:1.0:1788391201.975000:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:37203:x1875263094230912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 394us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.975008:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 349 00000100:00100000:0.0:1788391201.978151:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.979155:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094231168 00000100:00100000:3.0:1788391201.979170:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094231168 00000100:00100000:1.0:1788391201.979283:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 350 00000100:00100000:1.0:1788391201.979300:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:37203:x1875263094231168:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391201.979433:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.979469:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.979483:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391201.979927:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].12, 88 off9152 00000004:00080000:1.0:1788391201.979951:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1019086989026ns, next at 1020086973468ns, rc = 0 00000004:00010000:1.0:1788391201.980455:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000729c6208 reply state 00000000049da15e transno 30064771381 ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391201.980465:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391201.980626:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:37203:x1875263094231168:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1330us (2485us total) trans 30064771381 rc 0/0 00000100:00100000:1.0:1788391201.980635:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 350 00010000:00010000:1.0:1788391201.986084:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986108:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986117:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986122:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391201.986128:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986136:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986181:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391201.986196:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391201.986202:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391201.986209:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c30 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391201.986386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391201.986603:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094231296 00000100:00100000:2.0:1788391201.986615:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094231296 00000100:00100000:2.0:1788391201.986679:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 351 00000100:00100000:2.0:1788391201.986692:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:37203:x1875263094231296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391201.986723:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391201.986746:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0026a expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.986822:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 63 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.986838:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 63 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391201.986860:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:2.0:1788391201.986863:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391201.986866:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391201.987085:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:37203:x1875263094231296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 396us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391201.987094:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 351 00000100:00100000:2.0:1788391201.988932:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.989005:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094231424 00000100:00100000:3.0:1788391201.989016:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094231424 00000100:00100000:3.0:1788391201.989087:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788391201.989100:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094231424:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391201.989475:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094231424:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 377us (554us total) trans 30064771197 rc 0/0 00000100:00100000:3.0:1788391201.989484:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:0.0:1788391201.992606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391201.992805:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094231680 00000100:00100000:3.0:1788391201.992816:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094231680 00000100:00100000:3.0:1788391201.992899:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1788391201.992909:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:37203:x1875263094231680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391201.993214:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:37203:x1875263094231680:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 305us (621us total) trans 30064771382 rc 0/0 00000100:00100000:3.0:1788391201.993222:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:2.0:1788391201.995544:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391201.995626:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094231936 00000100:00100000:1.0:1788391201.995636:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094231936 00000100:00100000:1.0:1788391201.995692:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 352 00000100:00100000:1.0:1788391201.995704:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:37203:x1875263094231936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788391201.995842:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:37203:x1875263094231936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 141us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391201.995849:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 352 00000100:00100000:2.0:1788391202.001579:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.001825:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232064 00000100:00100000:1.0:1788391202.001836:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232064 00000100:00100000:1.0:1788391202.001953:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 353 00000100:00100000:1.0:1788391202.002007:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:37203:x1875263094232064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391202.002033:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391202.002061:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c3e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00271 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002147:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002161:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002199:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391202.002247:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391202.002269:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002294:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37c3e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00271 expref: 66 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002314:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00271 expref: 65 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.002334:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391202.002337:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788391202.002342:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdd600, rc 0) 00000100:00100000:1.0:1788391202.002410:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:37203:x1875263094232064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 408us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391202.002429:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 353 00000100:00080000:0.0:1788391202.002884:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391202.006133:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.006355:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232192 00000100:00100000:3.0:1788391202.006370:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232192 00000100:00100000:3.0:1788391202.006511:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:3.0:1788391202.006524:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2359:x1875263094232192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391202.006548:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788391202.006552:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788391202.006577:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00278 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391202.006627:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af22, blocks: 0x1 00010000:00010000:3.0:1788391202.006649:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=1019s v=(0 0) 00010000:00010000:3.0:1788391202.006654:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391202.006663:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 42 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.006680:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 42 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.006693:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:3.0:1788391202.006760:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2359:x1875263094232192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 239us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.006767:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:2.0:1788391202.009738:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.009851:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232448 00000100:00100000:3.0:1788391202.009862:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232448 00000100:00100000:3.0:1788391202.009995:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 354 00000100:00100000:3.0:1788391202.010008:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:37203:x1875263094232448:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.010147:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:37203:x1875263094232448:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 141us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.010155:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 354 00000100:00100000:2.0:1788391202.015881:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.016061:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232576 00000100:00100000:0.0:1788391202.016075:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232576 00000100:00100000:0.0:1788391202.016138:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788391202.016167:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:37203:x1875263094232576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391202.016271:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391202.016294:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0027f expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391202.016336:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 43 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391202.016347:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391202.016351:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391202.016358:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 43 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391202.016402:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 43 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391202.016415:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 43 pid: 43328 timeout: 1119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391202.016442:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103478912:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391202.016573:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788391202.018583:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.018652:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232704 00000100:00100000:2.0:1788391202.018660:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232704 00010000:00010000:2.0:1788391202.018695:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 44 pid: 43328 timeout: 1119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.018735:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391202.018745:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2356:x1875263094232704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391202.018763:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391202.018791:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 44 pid: 43328 timeout: 1119 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.018807:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 44 pid: 43328 timeout: 1119 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.018836:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391202.018841:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391202.018850:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 44 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.018861:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 44 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.018904:0:45855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 44 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.018946:0:45855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586dc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:45855:1875263103479040:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391202.019038:0:45855:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326e480 going to sleep for 11 seconds 00010000:00010000:3.0:1788391202.021050:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cf8d4a/0x9aafc5f04cd37c4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00278 expref: 44 pid: 43328 timeout: 1119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.021077:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:43698:1875263103478912:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391202.021135:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 43 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.021153:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:3.0:1788391202.021236:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:37203:x1875263094232576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5069us (5367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.021247:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788391202.022172:0:45855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586dc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:45855:1875263103479040:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391202.022290:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391202.022338:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094232704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3594us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.022348:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1788391202.042603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.042898:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232832 00000100:00100000:1.0:1788391202.042911:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232832 00002000:00100000:1.0:1788391202.043363:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff95d58d2fb800 x1875263094232832/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.043379:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fb800 with x1875263094232832 ext(0->1048575) 00002000:00010000:1.0:1788391202.043387:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fb800 00000100:00100000:1.0:1788391202.043494:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788391202.043508:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094232832:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.063122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.063308:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094232960 00000100:00100000:2.0:1788391202.063320:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094232960 00002000:00100000:2.0:1788391202.063387:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff95d587644380 x1875263094232960/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.063399:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644380 with x1875263094232960 ext(1048576->2097151) 00002000:00010000:2.0:1788391202.063407:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644380 00000100:00100000:2.0:1788391202.063455:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:2.0:1788391202.063467:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2358:x1875263094232960:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391202.083503:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2356:x1875263094232832:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 39978us (40895us total) trans 30064771198 rc 0/0 00000100:00100000:1.0:1788391202.083524:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00002000:00100000:1.0:1788391202.083543:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff95d58d2fb800 x1875263094232832/t30064771198(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.083554:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2fb800 with x1875263094232832 ext(0->1048575) 00002000:00010000:1.0:1788391202.083561:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58d2fb800 00000100:00100000:2.0:1788391202.090580:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2358:x1875263094232960:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 27095us (27569us total) trans 30064771199 rc 0/0 00000100:00100000:2.0:1788391202.090600:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00002000:00100000:2.0:1788391202.090619:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff95d587644380 x1875263094232960/t30064771199(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.090631:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644380 with x1875263094232960 ext(1048576->2097151) 00002000:00010000:2.0:1788391202.090639:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644380 00000100:00100000:1.0:1788391202.091200:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.091263:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233088 00000100:00100000:0.0:1788391202.091275:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233088 00002000:00100000:0.0:1788391202.091337:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff95d5853d1500 x1875263094233088/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.091365:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1500 with x1875263094233088 ext(2097152->3145727) 00002000:00010000:0.0:1788391202.091369:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1500 00000100:00100000:0.0:1788391202.091515:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1788391202.091528:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2359:x1875263094233088:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391202.098284:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2359:x1875263094233088:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6743us (7069us total) trans 30064771200 rc 0/0 00000100:00100000:0.0:1788391202.098303:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00002000:00100000:0.0:1788391202.098321:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff95d5853d1500 x1875263094233088/t30064771200(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.098334:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1500 with x1875263094233088 ext(2097152->3145727) 00002000:00010000:0.0:1788391202.098342:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1500 00000100:00100000:1.0:1788391202.102209:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.102428:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233216 00000100:00100000:3.0:1788391202.102441:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233216 00002000:00100000:3.0:1788391202.102506:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff95d5853d3480 x1875263094233216/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.102520:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3480 with x1875263094233216 ext(3145728->4194303) 00002000:00010000:3.0:1788391202.102527:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d3480 00000100:00100000:3.0:1788391202.102602:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:3.0:1788391202.102615:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2359:x1875263094233216:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.115379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.115494:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233344 00000100:00100000:2.0:1788391202.115507:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233344 00002000:00100000:2.0:1788391202.115572:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff95d587646a00 x1875263094233344/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.115585:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646a00 with x1875263094233344 ext(4194304->5242879) 00002000:00010000:2.0:1788391202.115605:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646a00 00000100:00100000:2.0:1788391202.115895:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:2.0:1788391202.115908:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:2357:x1875263094233344:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.119212:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2359:x1875263094233216:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 16584us (17001us total) trans 30064771201 rc 0/0 00000100:00100000:2.0:1788391202.119232:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00002000:00100000:2.0:1788391202.119251:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff95d5853d3480 x1875263094233216/t30064771201(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.119264:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3480 with x1875263094233216 ext(3145728->4194303) 00002000:00010000:2.0:1788391202.119273:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d3480 00000100:00100000:2.0:1788391202.123209:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2357:x1875263094233344:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 7288us (7874us total) trans 30064771202 rc 0/0 00000100:00100000:2.0:1788391202.123226:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00002000:00100000:2.0:1788391202.123241:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff95d587646a00 x1875263094233344/t30064771202(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.123253:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646a00 with x1875263094233344 ext(4194304->5242879) 00002000:00010000:2.0:1788391202.123260:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646a00 00000100:00100000:1.0:1788391202.125402:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.125464:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233472 00000100:00100000:0.0:1788391202.125474:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233472 00002000:00100000:0.0:1788391202.125532:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff95d5853d3b80 x1875263094233472/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.125541:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3b80 with x1875263094233472 ext(5242880->6291455) 00002000:00010000:0.0:1788391202.125545:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d3b80 00000100:00100000:0.0:1788391202.125573:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:0.0:1788391202.125585:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2357:x1875263094233472:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391202.130562:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2357:x1875263094233472:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 4962us (5150us total) trans 30064771203 rc 0/0 00000100:00100000:0.0:1788391202.130586:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00002000:00100000:0.0:1788391202.130614:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff95d5853d3b80 x1875263094233472/t30064771203(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.130627:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d3b80 with x1875263094233472 ext(5242880->6291455) 00002000:00010000:0.0:1788391202.130636:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d3b80 00000100:00100000:3.0:1788391202.136413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.137503:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233600 00000100:00100000:2.0:1788391202.137518:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233600 00002000:00100000:2.0:1788391202.137583:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff95d587644000 x1875263094233600/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.137595:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644000 with x1875263094233600 ext(6291456->7340031) 00002000:00010000:2.0:1788391202.137603:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644000 00000100:00100000:2.0:1788391202.137654:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:2.0:1788391202.137685:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2356:x1875263094233600:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.149600:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094233600:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 11899us (13181us total) trans 30064771204 rc 0/0 00000100:00100000:2.0:1788391202.149618:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00002000:00100000:2.0:1788391202.149635:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff95d587644000 x1875263094233600/t30064771204(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.149647:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644000 with x1875263094233600 ext(6291456->7340031) 00002000:00010000:2.0:1788391202.149656:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644000 00000100:00100000:3.0:1788391202.151058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.151125:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233728 00000100:00100000:2.0:1788391202.151137:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233728 00002000:00100000:2.0:1788391202.151192:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff95d587644a80 x1875263094233728/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.151203:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644a80 with x1875263094233728 ext(7340032->8388607) 00002000:00010000:2.0:1788391202.151207:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644a80 00000100:00100000:2.0:1788391202.151243:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:2.0:1788391202.151254:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094233728:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.164223:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2356:x1875263094233728:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 12954us (13155us total) trans 30064771205 rc 0/0 00000100:00100000:3.0:1788391202.164259:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00002000:00100000:3.0:1788391202.164277:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff95d587644a80 x1875263094233728/t30064771205(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.164290:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644a80 with x1875263094233728 ext(7340032->8388607) 00002000:00010000:3.0:1788391202.164299:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644a80 00000100:00100000:2.0:1788391202.177850:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.178719:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233856 00000100:00100000:0.0:1788391202.178734:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233856 00002000:00100000:0.0:1788391202.178950:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff95d586dc2680 x1875263094233856/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.178982:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc2680 with x1875263094233856 ext(8388608->9437183) 00002000:00010000:0.0:1788391202.178989:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc2680 00000100:00100000:0.0:1788391202.179032:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:0.0:1788391202.179045:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2357:x1875263094233856:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788391202.196709:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:2357:x1875263094233856:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 17651us (18924us total) trans 30064771206 rc 0/0 00000100:00100000:0.0:1788391202.196729:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00002000:00100000:0.0:1788391202.196755:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff95d586dc2680 x1875263094233856/t30064771206(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.196767:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc2680 with x1875263094233856 ext(8388608->9437183) 00002000:00010000:0.0:1788391202.196775:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc2680 00000100:00100000:1.0:1788391202.198071:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.198156:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094233984 00000100:00100000:2.0:1788391202.198169:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094233984 00002000:00100000:2.0:1788391202.198228:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff95d5853d1f80 x1875263094233984/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.198239:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1f80 with x1875263094233984 ext(9437184->10485759) 00002000:00010000:2.0:1788391202.198243:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1f80 00000100:00100000:2.0:1788391202.198278:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1788391202.198309:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:2359:x1875263094233984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.212505:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:2359:x1875263094233984:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 14182us (14427us total) trans 30064771207 rc 0/0 00000100:00100000:2.0:1788391202.212524:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00002000:00100000:2.0:1788391202.212541:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff95d5853d1f80 x1875263094233984/t30064771207(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.212553:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1f80 with x1875263094233984 ext(9437184->10485759) 00002000:00010000:2.0:1788391202.212561:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1f80 00000100:00100000:1.0:1788391202.221880:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.222096:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234112 00000100:00100000:3.0:1788391202.222108:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234112 00002000:00100000:3.0:1788391202.222174:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff95d5853d2300 x1875263094234112/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.222187:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2300 with x1875263094234112 ext(10485760->11534335) 00002000:00010000:3.0:1788391202.222194:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d2300 00000100:00100000:3.0:1788391202.222292:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1788391202.222304:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:2356:x1875263094234112:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.230498:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:2356:x1875263094234112:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8180us (8617us total) trans 30064771208 rc 0/0 00000100:00100000:2.0:1788391202.230514:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00002000:00100000:2.0:1788391202.230532:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff95d5853d2300 x1875263094234112/t30064771208(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.230544:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2300 with x1875263094234112 ext(10485760->11534335) 00002000:00010000:2.0:1788391202.230552:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d2300 00000100:00100000:1.0:1788391202.240804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.240926:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234240 00000100:00100000:0.0:1788391202.240951:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234240 00002000:00100000:0.0:1788391202.241066:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff95d5853d1880 x1875263094234240/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.241079:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1880 with x1875263094234240 ext(11534336->12582911) 00002000:00010000:0.0:1788391202.241105:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1880 00000100:00100000:0.0:1788391202.241136:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1788391202.241149:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:2358:x1875263094234240:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.258032:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.258074:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234368 00000100:00100000:2.0:1788391202.258086:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234368 00002000:00100000:2.0:1788391202.258143:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff95d586dc0e00 x1875263094234368/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.258154:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0e00 with x1875263094234368 ext(12582912->13631487) 00002000:00010000:2.0:1788391202.258160:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0e00 00000100:00100000:2.0:1788391202.258189:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1788391202.258201:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:2359:x1875263094234368:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.272691:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:2358:x1875263094234240:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 31533us (31939us total) trans 30064771209 rc 0/0 00000100:00100000:3.0:1788391202.272706:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00002000:00100000:3.0:1788391202.272720:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff95d5853d1880 x1875263094234240/t30064771209(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.272732:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1880 with x1875263094234240 ext(11534336->12582911) 00002000:00010000:3.0:1788391202.272738:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1880 00000100:00100000:3.0:1788391202.278260:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:2359:x1875263094234368:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 20046us (20228us total) trans 30064771210 rc 0/0 00000100:00100000:3.0:1788391202.278300:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00002000:00100000:3.0:1788391202.278314:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff95d586dc0e00 x1875263094234368/t30064771210(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.278335:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0e00 with x1875263094234368 ext(12582912->13631487) 00002000:00010000:3.0:1788391202.278343:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0e00 00000100:00100000:3.0:1788391202.278596:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.278631:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234496 00000100:00100000:3.0:1788391202.278642:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234496 00002000:00100000:3.0:1788391202.278688:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff95d587645500 x1875263094234496/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.278699:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645500 with x1875263094234496 ext(13631488->14680063) 00002000:00010000:3.0:1788391202.278703:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645500 00000100:00100000:3.0:1788391202.278728:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:3.0:1788391202.278738:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:2356:x1875263094234496:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.288355:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:2356:x1875263094234496:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 9601us (9743us total) trans 30064771211 rc 0/0 00000100:00100000:2.0:1788391202.288374:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00002000:00100000:2.0:1788391202.288392:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff95d587645500 x1875263094234496/t30064771211(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.288405:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587645500 with x1875263094234496 ext(13631488->14680063) 00002000:00010000:2.0:1788391202.288570:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587645500 00000100:00100000:3.0:1788391202.296052:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.296307:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234624 00000100:00100000:0.0:1788391202.296318:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234624 00002000:00100000:0.0:1788391202.296376:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff95d587647480 x1875263094234624/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391202.296388:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587647480 with x1875263094234624 ext(14680064->15728639) 00002000:00010000:0.0:1788391202.296395:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587647480 00000100:00100000:0.0:1788391202.296438:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:0.0:1788391202.296449:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:2358:x1875263094234624:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391202.306777:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:2358:x1875263094234624:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10322us (10729us total) trans 30064771212 rc 0/0 00000100:00100000:1.0:1788391202.306788:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00002000:00100000:1.0:1788391202.306798:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff95d587647480 x1875263094234624/t30064771212(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.306805:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587647480 with x1875263094234624 ext(14680064->15728639) 00002000:00010000:1.0:1788391202.306810:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587647480 00000100:00100000:0.0:1788391202.319421:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.321373:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234752 00000100:00100000:2.0:1788391202.321391:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234752 00002000:00100000:2.0:1788391202.321470:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff95d68f323b80 x1875263094234752/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.321482:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323b80 with x1875263094234752 ext(15728640->16777215) 00002000:00010000:2.0:1788391202.321488:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323b80 00000100:00100000:2.0:1788391202.321527:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:2.0:1788391202.321540:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:2357:x1875263094234752:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.332318:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:2357:x1875263094234752:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10764us (12982us total) trans 30064771213 rc 0/0 00000100:00100000:3.0:1788391202.332335:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00002000:00100000:3.0:1788391202.332352:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff95d68f323b80 x1875263094234752/t30064771213(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.332363:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323b80 with x1875263094234752 ext(15728640->16777215) 00002000:00010000:3.0:1788391202.332372:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323b80 00000001:00080000:1.0:1788391202.342252:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771206 is committed 00000001:00080000:1.0:1788391202.342399:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771208 is committed 00000001:00080000:1.0:1788391202.342473:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771196 is committed 00000100:00100000:2.0:1788391202.345472:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.345615:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094234880 00000100:00100000:3.0:1788391202.345647:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094234880 00002000:00100000:3.0:1788391202.345713:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff95d586dc0380 x1875263094234880/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.345727:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0380 with x1875263094234880 ext(16777216->17825791) 00002000:00010000:3.0:1788391202.345735:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0380 00000100:00100000:3.0:1788391202.345815:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1788391202.345825:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2356:x1875263094234880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.353219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.353325:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235008 00000100:00100000:1.0:1788391202.353344:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235008 00002000:00100000:1.0:1788391202.353388:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff95d586dc3800 x1875263094235008/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.353398:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc3800 with x1875263094235008 ext(17825792->18874367) 00002000:00010000:1.0:1788391202.353404:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc3800 00000100:00100000:1.0:1788391202.353451:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:1.0:1788391202.353460:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2359:x1875263094235008:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391202.356264:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2356:x1875263094234880:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 10430us (10796us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1788391202.356276:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00002000:00100000:1.0:1788391202.356287:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff95d586dc0380 x1875263094234880/t30064771214(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.356298:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0380 with x1875263094234880 ext(16777216->17825791) 00002000:00010000:1.0:1788391202.356303:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0380 00000100:00100000:1.0:1788391202.365009:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2359:x1875263094235008:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 11533us (11784us total) trans 30064771215 rc 0/0 00000100:00100000:1.0:1788391202.365027:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00002000:00100000:1.0:1788391202.365044:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff95d586dc3800 x1875263094235008/t30064771215(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391202.365055:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc3800 with x1875263094235008 ext(17825792->18874367) 00002000:00010000:1.0:1788391202.365064:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc3800 00000100:00100000:2.0:1788391202.384373:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.384467:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235136 00000100:00100000:3.0:1788391202.384477:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235136 00002000:00100000:3.0:1788391202.384540:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff95d586dc2a00 x1875263094235136/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.384551:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc2a00 with x1875263094235136 ext(18874368->19922943) 00002000:00010000:3.0:1788391202.384556:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc2a00 00000100:00100000:3.0:1788391202.384590:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:3.0:1788391202.384600:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2359:x1875263094235136:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788391202.398614:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094235136:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 14005us (14242us total) trans 30064771216 rc 0/0 00000100:00100000:3.0:1788391202.398627:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00002000:00100000:3.0:1788391202.398638:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff95d586dc2a00 x1875263094235136/t30064771216(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391202.398648:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc2a00 with x1875263094235136 ext(18874368->19922943) 00002000:00010000:3.0:1788391202.398654:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc2a00 00000100:00100000:1.0:1788391202.405643:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.405821:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235264 00000100:00100000:2.0:1788391202.405830:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235264 00002000:00100000:2.0:1788391202.405872:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff95d5853d1c00 x1875263094235264/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.405881:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1c00 with x1875263094235264 ext(19922944->20971519) 00002000:00010000:2.0:1788391202.405886:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1c00 00000100:00100000:2.0:1788391202.405948:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1788391202.405958:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2356:x1875263094235264:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788391202.414227:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2356:x1875263094235264:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 8258us (8583us total) trans 30064771217 rc 0/0 00000100:00100000:2.0:1788391202.414243:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00002000:00100000:2.0:1788391202.414257:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff95d5853d1c00 x1875263094235264/t30064771217(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391202.414267:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d1c00 with x1875263094235264 ext(19922944->20971519) 00002000:00010000:2.0:1788391202.414273:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d1c00 00000100:00100000:0.0:1788391202.416120:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.416169:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235392 00000100:00100000:1.0:1788391202.416178:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235392 00000100:00100000:1.0:1788391202.416233:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 355 00000100:00100000:1.0:1788391202.416243:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:37203:x1875263094235392:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788391202.446368:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771375 is committed 00000001:00080000:0.0:1788391202.446389:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771381 is committed 00000004:00080000:0.0:1788391202.446394:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:0.0:1788391202.446443:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b4ead300 refcount 2 committed 0 result 0 batchid 25769803909 00000020:00080000:0.0:1788391202.446449:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d58ad54000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68133acc0 00000020:00080000:0.0:1788391202.446451:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d58ad54a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58d0de000 00000020:00080000:0.0:1788391202.446483:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803908 batchid updated 00000004:00080000:0.0:1788391202.446492:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000100:00100000:2.0:1788391202.446550:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103479168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391202.446619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391202.446650:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37203:x1875263094235392:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 30405us (30532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391202.446660:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 355 00000100:00100000:2.0:1788391202.446682:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103479168 00000020:00080000:1.0:1788391202.446684:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803909 committed batchid 25769803908 00000100:00100000:2.0:1788391202.446688:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103479168 00000100:00100000:2.0:1788391202.446739:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788391202.446747:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103479168:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788391202.446862:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000100:00100000:2.0:1788391202.446896:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103479168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (278us total) trans 30064771218 rc 0/0 00000100:00100000:2.0:1788391202.446902:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788391202.446937:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771196 gen 2 00000004:00080000:2.0:1788391202.446941:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771196 committed transno 30064771196 00000100:00100000:2.0:1788391202.447001:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d586dc0000 x1875263103479168/t30064771218(30064771218) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788391218 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788391202.447013:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586dc0000/2, rc 0, transno 30064771218 00000100:00100000:2.0:1788391202.447021:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103479168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788391202.450470:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:0.0:1788391202.450493:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771382 is committed 00000100:00100000:0.0:1788391202.450676:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103479424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788391202.450738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391202.450851:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391202.450858:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103479296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788391202.450882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391202.451003:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103479424 00000100:00100000:1.0:1788391202.451011:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103479424 00000100:00100000:1.0:1788391202.451066:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103479296 00000100:00100000:1.0:1788391202.451069:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103479296 00000100:00100000:1.0:1788391202.451095:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788391202.451104:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103479424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788391202.451258:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1788391202.451261:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 1788391201 -> 1788391201 00002000:00010000:1.0:1788391202.451264:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391202.451266:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1788391201 -> 1788391201 00002000:00010000:1.0:1788391202.451269:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391202.451311:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103479424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (572us total) trans 30064771165 rc 0/0 00000100:00100000:1.0:1788391202.451438:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788391202.451456:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788391202.451463:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103479296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788391202.451477:0:43328:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:200 count 1 00002000:00010000:1.0:1788391202.451500:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 15728640, mtime: 0x6a98af20, atime: 0x0, ctime: 0x6a98af21, blocks: 0x7807 00010000:00010000:1.0:1788391202.451506:0:43328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.451526:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=1019s v=(0 0) 00010000:00010000:1.0:1788391202.451530:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391202.451537:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.451550:0:43328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.451558:0:43328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.451565:0:43328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.451581:0:43328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391202.452056:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103479296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 592us (1170us total) trans 30064771219 rc 0/0 00000100:00100000:1.0:1788391202.452062:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788391202.452085:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788391202.452097:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391202.452102:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.452109:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391202.452113:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.452133:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.452150:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.452157:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051776990/0x9aafc5f04cd37c5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.452173:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391202.452174:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391202.452176:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391202.452206:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586dc1500/2, rc 0, transno 30064771219 00000100:00100000:1.0:1788391202.452212:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103479296:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788391202.452222:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d587647b80/2, rc 0, transno 30064771165 00000100:00100000:1.0:1788391202.452225:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103479424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788391202.452552:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391202.452563:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103479552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391202.452597:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391202.452705:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103479552 00000100:00100000:1.0:1788391202.452711:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103479552 00000100:00100000:1.0:1788391202.452750:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788391202.452758:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103479552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788391202.452854:0:44885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:1.0:1788391202.452857:0:44885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788391202 00002000:00010000:1.0:1788391202.452859:0:44885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391202.452860:0:44885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1788391202 -> 1788391202 00002000:00010000:1.0:1788391202.452862:0:44885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 22535 00000100:00100000:1.0:1788391202.452990:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3289:x1875263103479552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (392us total) trans 30064771220 rc 0/0 00000100:00100000:1.0:1788391202.452996:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788391202.453307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.453430:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235520 00000100:00100000:1.0:1788391202.453435:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235520 00000100:00100000:1.0:1788391202.453472:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:1.0:1788391202.453480:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2357:x1875263094235520:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788391202.454888:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586dc3480/2, rc 0, transno 30064771220 00000100:00100000:2.0:1788391202.454897:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103479552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788391202.502594:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2357:x1875263094235520:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 49104us (49278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391202.502609:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000001:00080000:1.0:1788391202.502645:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771220 is committed 00000001:00080000:1.0:1788391202.502656:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771215 is committed 00000001:00080000:1.0:1788391202.502676:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771217 is committed 00000100:00100000:1.0:1788391202.504568:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.504624:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235776 00000100:00100000:2.0:1788391202.504634:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235776 00000100:00100000:2.0:1788391202.504691:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 356 00000100:00100000:2.0:1788391202.504702:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37203:x1875263094235776:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391202.504755:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391202.504781:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd600/0x9aafc5f04cd37c45 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00271 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.504798:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:2.0:1788391202.504803:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391202.504833:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.504848:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.504857:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391202.505041:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000260a57db reply state 0000000071483b41 transno 30064771383 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.505048:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391202.505128:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:37203:x1875263094235776:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 428us (566us total) trans 30064771383 rc 0/0 00000100:00100000:2.0:1788391202.505135:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 356 00000100:00100000:2.0:1788391202.508690:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788391202.508700:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509104:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509113:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509119:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.509125:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509132:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509168:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391202.509171:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391202.509176:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.509182:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c61 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391202.509194:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094235904 00000100:00100000:0.0:1788391202.509203:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094235904 00000100:00100000:0.0:1788391202.509256:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:0.0:1788391202.509362:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094235904:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788391202.509612:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:0.0:1788391202.509617:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 1788391202 -> 1788391201 00002000:00010000:0.0:1788391202.509619:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 1788391201 00002000:00010000:0.0:1788391202.509621:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1788391202 -> 1788391201 00002000:00010000:0.0:1788391202.509622:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 22535 -> 40967 00000100:00100000:0.0:1788391202.509740:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094235904:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 474us (1059us total) trans 30064771221 rc 0/0 00000100:00100000:0.0:1788391202.509748:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1788391202.511676:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.511722:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236160 00000100:00100000:2.0:1788391202.511730:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236160 00000100:00100000:2.0:1788391202.511774:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 357 00000100:00100000:2.0:1788391202.511784:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37203:x1875263094236160:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788391202.511842:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.511854:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.511860:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.511888:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.511898:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 30 pid: 42645 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.511908:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103479680:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391202.512018:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391202.514336:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103479680:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391202.514364:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391202.515053:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.515109:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236288 00000100:00100000:3.0:1788391202.515125:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236288 00010000:00010000:3.0:1788391202.515160:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 31 pid: 42645 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.515196:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1788391202.515206:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094236288:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391202.515220:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391202.515226:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 31 pid: 42645 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515237:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 31 pid: 42645 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515259:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdda00/0x9aafc5f04cd37c29 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00263 expref: 31 pid: 42645 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515274:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:3.0:1788391202.515278:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515284:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515289:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.515310:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391202.515340:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515348:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515385:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515392:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515399:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515405:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391202.515410:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515428:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515438:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:2.0:1788391202.515440:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391202.515444:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.515450:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c68 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.515543:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2357:x1875263094236288:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 337us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391202.515543:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37203:x1875263094236160:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3759us (3870us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391202.515553:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 357 00000100:00100000:3.0:1788391202.515558:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:1.0:1788391202.517455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.517498:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236416 00000100:00100000:2.0:1788391202.517508:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236416 00000100:00100000:2.0:1788391202.517560:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391202.517756:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094236416:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391202.517797:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.517813:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.517818:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391202.517821:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391202.517824:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.517850:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.517859:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 11 pid: 43698 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.517870:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103479808:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391202.517930:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391202.521657:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103479808:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391202.521686:0:44885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391202.543429:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.544060:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236544 00000100:00100000:3.0:1788391202.544070:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236544 00010000:00010000:3.0:1788391202.544110:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 12 pid: 43698 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.544200:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1788391202.544212:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094236544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391202.544227:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391202.544250:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 12 pid: 43698 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.544265:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 12 pid: 43698 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.544299:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd37c53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0027f expref: 12 pid: 43698 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.544322:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391202.544328:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391202.544333:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.544343:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.544399:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391202.544471:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094236544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 261us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.544480:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00010000:00010000:2.0:1788391202.544639:0:44885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544649:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544674:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544683:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544690:0:44885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544697:0:44885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391202.544702:0:44885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544720:0:44885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544732:0:44885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.544740:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002372b8d9/0x9aafc5f04cd37c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.544800:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094236416:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 27231us (27349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391202.544808:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1788391202.547357:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.547452:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236800 00000100:00100000:2.0:1788391202.547460:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236800 00000100:00100000:2.0:1788391202.547504:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00100000:2.0:1788391202.547515:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37203:x1875263094236800:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391202.547682:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547694:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547703:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547890:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547901:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547909:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547942:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.547955:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 30 pid: 43348 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391202.547987:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103479936:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391202.548128:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690900 going to sleep for 11 seconds 00000100:00100000:0.0:1788391202.552078:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.552113:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103479936:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391202.552139:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.552198:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094236928 00000100:00100000:3.0:1788391202.552205:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094236928 00010000:00010000:3.0:1788391202.552240:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 31 pid: 43348 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391202.552289:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:3.0:1788391202.552299:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094236928:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391202.552321:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391202.552328:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 31 pid: 43348 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552339:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 31 pid: 43348 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552360:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37c37 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0026a expref: 31 pid: 43348 timeout: 1119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552379:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:3.0:1788391202.552385:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552393:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552434:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.552460:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391202.552518:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2356:x1875263094236928:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 220us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.552525:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00010000:00010000:2.0:1788391202.552731:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.552738:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391202.552912:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771384 00000001:00080000:2.0:1788391202.553091:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771385 00000001:00080000:2.0:1788391202.553137:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771386 00000100:00100000:2.0:1788391202.553215:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103480064:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391202.553267:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391202.553299:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391202.553501:0:45860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480064 00000100:00100000:0.0:1788391202.553507:0:45860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480064 00000100:00100000:0.0:1788391202.553549:0:45860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788391202.553560:0:45860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103480064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788391202.553644:0:45860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103480064:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391202.553651:0:45860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788391202.553876:0:42646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:1.0:1788391202.553882:0:42646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586dc0000, transno 30064771218 00000004:00080000:1.0:1788391202.553896:0:42646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586dc1500, transno 30064771219 00000004:00080000:1.0:1788391202.553899:0:42646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586dc3480, transno 30064771220 00000100:00100000:1.0:1788391202.553905:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103480064:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788391202.554500:0:42646:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771387 00000100:00100000:1.0:1788391202.554568:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cb18700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103480192:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788391202.554610:0:42646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391202.554639:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788391202.554647:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480192 00000100:00100000:2.0:1788391202.554653:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480192 00000100:00100000:2.0:1788391202.554689:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788391202.554697:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42646:x1875263103480192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788391202.554857:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42646:x1875263103480192:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (241us total) trans 30064771222 rc 0/0 00000100:00100000:2.0:1788391202.554865:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788391202.554885:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cb18700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:42646:1875263103480192:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788391202.554916:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.554924:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.554938:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.554943:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1ee00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.554947:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.554955:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.554989:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d6a0d29e00) 00010000:00010000:1.0:1788391202.554992:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391202.554996:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555003:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37c7d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555036:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555042:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555048:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555052:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.555055:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555070:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555079:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391202.555080:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391202.555086:0:42646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555096:0:42646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555104:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.555126:0:42646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa000/0x9aafc5f04cd37bce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0024e expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391202.555136:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cb1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103480320:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391202.555185:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2900 going to sleep for 11 seconds 00000004:00080000:3.0:1788391202.556486:0:42668:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1788391202.557802:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cb1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103480320:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391202.557829:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557838:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd37bc7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557866:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557889:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557900:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557911:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557916:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557921:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557926:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdc000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.557929:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557935:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557945:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391202.557948:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391202.557950:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.557955:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdc000/0x9aafc5f04cd37c84 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558071:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558083:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558088:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558092:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.558095:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558100:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558109:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391202.558112:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391202.558114:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.558120:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37c76 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391202.558440:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37203:x1875263094236800:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 10925us (11090us total) trans 30064771388 rc 0/0 00000100:00100000:1.0:1788391202.558451:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 358 00000020:00080000:1.0:1788391202.558457:0:42646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788391202.559193:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391202.559199:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391202.559784:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:3.0:1788391202.559792:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391202.563739:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.563875:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237056 00000100:00100000:3.0:1788391202.563886:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237056 00000100:00100000:3.0:1788391202.563949:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788391202.563986:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37202:x1875263094237056:12345-192.168.202.1@tcp:49:dd.500 00000100:00100000:3.0:1788391202.564124:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37202:x1875263094237056:12345-192.168.202.1@tcp:49:dd.500 Request processed in 164us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391202.564133:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1788391202.568805:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.568851:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237184 00000100:00100000:1.0:1788391202.568861:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237184 00000100:00100000:1.0:1788391202.568921:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:1.0:1788391202.568933:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:37202:x1875263094237184:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391202.569102:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391202.569123:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e0f7f16/0x9aafc5f04cd37c8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00286 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391202.569151:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 20971520, mtime: 0x6a98af21, atime: 0x6a98af21, ctime: 0x6a98af21, blocks: 0xa007 00010000:00010000:1.0:1788391202.569174:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=1019s v=(0 0) 00010000:00010000:1.0:1788391202.569180:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391202.569189:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e0f7f16/0x9aafc5f04cd37c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00286 expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.569206:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e0f7f16/0x9aafc5f04cd37c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00286 expref: 11 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.569221:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cdc000, rc 0) 00000100:00100000:1.0:1788391202.569290:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:37202:x1875263094237184:12345-192.168.202.1@tcp:101:dd.500 Request processed in 360us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391202.569298:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:1.0:1788391202.588770:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.589434:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237312 00000100:00100000:0.0:1788391202.589459:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237312 00002000:00100000:0.0:1788391202.589515:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff95d58cb1b800 x1875263094237312/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788391202.589527:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1b800 with x1875263094237312 ext(20971520->22020095) 00002000:00010000:0.0:1788391202.589533:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1b800 00000100:00100000:0.0:1788391202.589573:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:0.0:1788391202.589584:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094237312:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391202.603667:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.603798:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237440 00000100:00100000:3.0:1788391202.603808:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237440 00002000:00100000:3.0:1788391202.603851:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff95d58cb1a680 x1875263094237440/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788391202.603862:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1a680 with x1875263094237440 ext(22020096->23068671) 00002000:00010000:3.0:1788391202.603868:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1a680 00000100:00100000:3.0:1788391202.603900:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:3.0:1788391202.603926:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094237440:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391202.604762:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094237312:12345-192.168.202.1@tcp:4:dd.500 Request processed in 15176us (15996us total) trans 30064771223 rc 0/0 00000100:00100000:2.0:1788391202.604773:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00002000:00100000:2.0:1788391202.604782:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff95d58cb1b800 x1875263094237312/t30064771223(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.604790:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1b800 with x1875263094237312 ext(20971520->22020095) 00002000:00010000:2.0:1788391202.604793:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1b800 00000100:00100000:2.0:1788391202.619158:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094237440:12345-192.168.202.1@tcp:4:dd.500 Request processed in 15223us (15488us total) trans 30064771224 rc 0/0 00000100:00100000:2.0:1788391202.619174:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00002000:00100000:2.0:1788391202.619187:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff95d58cb1a680 x1875263094237440/t30064771224(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.619198:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1a680 with x1875263094237440 ext(22020096->23068671) 00002000:00010000:2.0:1788391202.619204:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb1a680 00000100:00100000:1.0:1788391202.630153:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.630291:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237568 00000100:00100000:2.0:1788391202.630301:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237568 00002000:00100000:2.0:1788391202.630358:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff95d58cb18e00 x1875263094237568/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.630370:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18e00 with x1875263094237568 ext(23068672->24117247) 00002000:00010000:2.0:1788391202.630375:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb18e00 00000100:00100000:2.0:1788391202.630409:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1788391202.634562:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094237568:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:0.0:1788391202.653689:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.653790:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237696 00000100:00100000:1.0:1788391202.653800:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237696 00002000:00100000:1.0:1788391202.653848:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff95d68f323480 x1875263094237696/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391202.653859:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323480 with x1875263094237696 ext(24117248->25165823) 00002000:00010000:1.0:1788391202.653865:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323480 00000100:00100000:1.0:1788391202.653919:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:1.0:1788391202.653931:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094237696:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391202.672334:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094237568:12345-192.168.202.1@tcp:4:dd.500 Request processed in 37782us (42180us total) trans 30064771225 rc 0/0 00000100:00100000:2.0:1788391202.672347:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00002000:00100000:2.0:1788391202.672360:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff95d58cb18e00 x1875263094237568/t30064771225(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.672372:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18e00 with x1875263094237568 ext(23068672->24117247) 00002000:00010000:2.0:1788391202.672378:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb18e00 00000100:00100000:0.0:1788391202.679483:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.679577:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094237824 00000100:00100000:2.0:1788391202.679588:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094237824 00002000:00100000:2.0:1788391202.679639:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff95d68f323800 x1875263094237824/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.679652:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323800 with x1875263094237824 ext(25165824->26214399) 00002000:00010000:2.0:1788391202.679658:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323800 00000100:00100000:2.0:1788391202.679694:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788391202.679706:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094237824:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391202.683792:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094237696:12345-192.168.202.1@tcp:4:dd.500 Request processed in 29853us (30104us total) trans 30064771226 rc 0/0 00000100:00100000:2.0:1788391202.683806:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00002000:00100000:2.0:1788391202.683817:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff95d68f323480 x1875263094237696/t30064771226(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.683828:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323480 with x1875263094237696 ext(24117248->25165823) 00002000:00010000:2.0:1788391202.683834:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323480 00000100:00100000:0.0:1788391202.694138:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.694384:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238080 00000100:00100000:3.0:1788391202.694394:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238080 00000100:00100000:3.0:1788391202.694463:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391202.694474:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37203:x1875263094238080:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788391202.695202:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788391202.695317:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771389 00010000:00010000:3.0:1788391202.695360:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695377:0:42648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695389:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695396:0:42648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695403:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695409:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391202.695439:0:42648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391202.695530:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37203:x1875263094238080:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1055us (1400us total) trans 30064771390 rc 0/0 00000100:00100000:3.0:1788391202.695539:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000020:00080000:3.0:1788391202.695544:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391202.696669:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391202.696681:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.696690:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391202.696695:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.696705:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.696723:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff95d686a70200) 00010000:00010000:2.0:1788391202.696726:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391202.696731:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.696738:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd37c92 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391202.696765:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391202.696767:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391202.696769:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391202.700475:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094237824:12345-192.168.202.1@tcp:4:dd.500 Request processed in 20759us (20990us total) trans 30064771227 rc 0/0 00000100:00100000:2.0:1788391202.700490:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00002000:00100000:2.0:1788391202.700502:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff95d68f323800 x1875263094237824/t30064771227(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.700513:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f323800 with x1875263094237824 ext(25165824->26214399) 00002000:00010000:2.0:1788391202.700520:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f323800 00000100:00100000:3.0:1788391202.704927:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.705071:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238208 00000100:00100000:2.0:1788391202.705083:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238208 00002000:00100000:2.0:1788391202.705133:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff95d587647800 x1875263094238208/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.705146:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587647800 with x1875263094238208 ext(26214400->27262975) 00002000:00010000:2.0:1788391202.705152:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587647800 00000100:00100000:2.0:1788391202.705191:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:2.0:1788391202.705202:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094238208:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391202.713866:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094238208:12345-192.168.202.1@tcp:4:dd.500 Request processed in 8654us (8936us total) trans 30064771228 rc 0/0 00000100:00100000:2.0:1788391202.713880:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00002000:00100000:2.0:1788391202.713893:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff95d587647800 x1875263094238208/t30064771228(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.713904:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587647800 with x1875263094238208 ext(26214400->27262975) 00002000:00010000:2.0:1788391202.713910:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587647800 00000100:00100000:0.0:1788391202.723816:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.724005:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238336 00000100:00100000:2.0:1788391202.724015:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238336 00002000:00100000:2.0:1788391202.724068:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff95d68f322a00 x1875263094238336/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.724080:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322a00 with x1875263094238336 ext(27262976->28311551) 00002000:00010000:2.0:1788391202.724086:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322a00 00000100:00100000:2.0:1788391202.724205:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1788391202.724217:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2359:x1875263094238336:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:2.0:1788391202.732517:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2359:x1875263094238336:12345-192.168.202.1@tcp:4:dd.500 Request processed in 8290us (8699us total) trans 30064771229 rc 0/0 00000100:00100000:2.0:1788391202.732535:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00002000:00100000:2.0:1788391202.732548:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff95d68f322a00 x1875263094238336/t30064771229(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.732560:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322a00 with x1875263094238336 ext(27262976->28311551) 00002000:00010000:2.0:1788391202.732567:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322a00 00000100:00100000:3.0:1788391202.738806:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.739163:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238464 00000100:00100000:2.0:1788391202.739175:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238464 00002000:00100000:2.0:1788391202.739227:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff95d587646680 x1875263094238464/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.739239:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646680 with x1875263094238464 ext(28311552->29360127) 00002000:00010000:2.0:1788391202.739245:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646680 00000100:00100000:2.0:1788391202.739376:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391202.739388:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094238464:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:0.0:1788391202.747832:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391202.747867:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238592 00000100:00100000:0.0:1788391202.747875:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238592 00002000:00100000:0.0:1788391202.747928:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff95d68f320380 x1875263094238592/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788391202.747940:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320380 with x1875263094238592 ext(29360128->30408703) 00002000:00010000:0.0:1788391202.747945:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320380 00000100:00100000:0.0:1788391202.747990:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:0.0:1788391202.748001:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2356:x1875263094238592:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:0.0:1788391202.755723:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094238592:12345-192.168.202.1@tcp:4:dd.500 Request processed in 7714us (7891us total) trans 30064771230 rc 0/0 00000100:00100000:0.0:1788391202.755737:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00002000:00100000:0.0:1788391202.755750:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff95d68f320380 x1875263094238592/t30064771230(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788391202.755778:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320380 with x1875263094238592 ext(29360128->30408703) 00002000:00010000:0.0:1788391202.755790:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320380 00000100:00100000:1.0:1788391202.759221:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094238464:12345-192.168.202.1@tcp:4:dd.500 Request processed in 19823us (20413us total) trans 30064771231 rc 0/0 00000100:00100000:1.0:1788391202.759237:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00002000:00100000:1.0:1788391202.759249:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff95d587646680 x1875263094238464/t30064771231(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788391202.760371:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587646680 with x1875263094238464 ext(28311552->29360127) 00002000:00010000:1.0:1788391202.760379:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587646680 00000100:00100000:3.0:1788391202.762766:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391202.762807:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391202.762834:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238720 00000100:00100000:2.0:1788391202.762844:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238720 00002000:00100000:2.0:1788391202.762896:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff95d587644e00 x1875263094238720/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/0 e 0 to 0 dl 1788391213 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.762906:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644e00 with x1875263094238720 ext(30408704->31457279) 00002000:00010000:2.0:1788391202.762912:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644e00 00000100:00100000:1.0:1788391202.762929:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094238976 00000100:00100000:1.0:1788391202.762934:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094238976 00000100:00100000:2.0:1788391202.762947:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:2.0:1788391202.762955:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094238720:12345-192.168.202.1@tcp:4:dd.500 00000100:00100000:1.0:1788391202.762991:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:1.0:1788391202.762999:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37202:x1875263094238976:12345-192.168.202.1@tcp:35:dd.500 00000001:00080000:1.0:1788391202.763388:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771391 00000001:00080000:1.0:1788391202.763467:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771392 00000100:00100000:1.0:1788391202.763562:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37202:x1875263094238976:12345-192.168.202.1@tcp:35:dd.500 Request processed in 562us (752us total) trans 30064771393 rc 0/0 00000100:00100000:1.0:1788391202.763570:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000020:00080000:1.0:1788391202.763575:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788391202.765407:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391202.770834:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094238720:12345-192.168.202.1@tcp:4:dd.500 Request processed in 7868us (8118us total) trans 30064771232 rc 0/0 00000100:00100000:2.0:1788391202.770851:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00002000:00100000:2.0:1788391202.770864:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff95d587644e00 x1875263094238720/t30064771232(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:63/0 lens 488/448 e 0 to 0 dl 1788391213 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788391202.770873:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587644e00 with x1875263094238720 ext(30408704->31457279) 00002000:00010000:2.0:1788391202.770879:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587644e00 00000100:00100000:3.0:1788391202.811738:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391202.811865:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239104 00000100:00100000:1.0:1788391202.811875:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239104 00000100:00100000:1.0:1788391202.811991:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 359 00000100:00100000:1.0:1788391202.811999:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37213:x1875263094239104:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391202.812063:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812089:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812098:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812108:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812113:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812117:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812333:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812340:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812344:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391202.812375:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812384:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812388:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812400:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812405:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdde00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.812408:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812424:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812440:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff95d6a704c700) 00010000:00010000:1.0:1788391202.812444:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391202.812449:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812455:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdde00/0x9aafc5f04cd37c99 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812466:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812474:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812479:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812484:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cdd800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.812487:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812507:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812516:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff95d6a0d29300) 00010000:00010000:1.0:1788391202.812519:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391202.812521:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812527:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cdd800/0x9aafc5f04cd37ca0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812542:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812548:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812552:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812555:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cddc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391202.812557:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812560:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812565:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff95d686a70900) 00010000:00010000:1.0:1788391202.812566:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391202.812568:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391202.812578:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cddc00/0x9aafc5f04cd37ca7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391202.812694:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37213:x1875263094239104:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 694us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391202.812949:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 359 00010000:00010000:2.0:1788391203.789095:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391203.858813:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771164 is committed 00000001:00080000:1.0:1788391203.858847:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771165 is committed 00000100:00100000:1.0:1788391204.813163:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788391204.813337:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391204.813613:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103480576:0@lo:400:kworker.0 00000100:00100000:0.0:1788391204.813684:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391204.813747:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391204.813755:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103480704:0@lo:400:kworker.0 00000100:00100000:0.0:1788391204.813781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391204.813817:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480576 00000100:00100000:0.0:1788391204.813825:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480576 00000100:00100000:0.0:1788391204.813878:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480704 00000100:00100000:0.0:1788391204.813882:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480704 00000100:00100000:0.0:1788391204.813908:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788391204.813922:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103480576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391204.813998:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103480576:12345-0@lo:400:kworker.0 Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391204.814006:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788391204.814022:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788391204.814029:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103480704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391204.814058:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103480704:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391204.814064:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788391204.814124:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103480704:0@lo:400:kworker.0 00000100:00100000:0.0:1788391204.814135:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771165 gen 2 00000004:00080000:0.0:1788391204.814140:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d587647b80, transno 30064771165 00000100:00100000:0.0:1788391204.814151:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103480576:0@lo:400:kworker.0 00000100:00100000:3.0:1788391204.814932:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391204.814981:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391204.815011:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391204.815016:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103480832:0@lo:400:kworker.0 00000100:00100000:3.0:1788391204.815039:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391204.815062:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480960 00000100:00100000:3.0:1788391204.815066:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480960 00000100:00100000:3.0:1788391204.815095:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788391204.815101:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103480960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391204.815127:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 272564224 pending 17039360 free 3760193536 avail 3758096384 00000100:00100000:3.0:1788391204.815161:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103480960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391204.815168:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788391204.815188:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480832 00000100:00100000:3.0:1788391204.815191:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480832 00000100:00100000:3.0:1788391204.815215:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788391204.815221:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103480832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391204.815247:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103480832:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391204.815252:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788391204.815280:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103480832:0@lo:400:kworker.0 00000100:00100000:3.0:1788391204.815293:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391204.815379:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103480448:0@lo:400:kworker.0 00000100:00100000:1.0:1788391204.815421:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788391204.815454:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391204.815459:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391204.815543:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103480448 00000100:00100000:1.0:1788391204.815548:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103480448 00000100:00100000:1.0:1788391204.815574:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788391204.815581:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103480448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391204.815614:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103480448:12345-0@lo:400:kworker.0 Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391204.815620:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788391204.815652:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103480448:0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816385:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103481088:0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391204.816450:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391204.816454:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103481216:0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816471:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391204.816493:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481088 00000100:00100000:2.0:1788391204.816496:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481088 00000100:00100000:2.0:1788391204.816528:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481216 00000100:00100000:2.0:1788391204.816531:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481216 00000100:00100000:2.0:1788391204.816551:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788391204.816558:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103481088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816596:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103481088:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391204.816602:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788391204.816618:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788391204.816623:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103481216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816648:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103481216:12345-0@lo:400:kworker.0 Request processed in 26us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391204.816653:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788391204.816669:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391204.816692:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103481216:0@lo:400:kworker.0 00000100:00100000:2.0:1788391204.816701:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103481088:0@lo:400:kworker.0 00010000:00010000:2.0:1788391205.837166:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391205.839957:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103481344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391205.840048:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391205.840393:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481344 00000100:00100000:3.0:1788391205.840403:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481344 00000100:00100000:3.0:1788391205.840458:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788391205.840469:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103481344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391205.840503:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 153288704 pending 0 free 3804233728 avail 3802136576 00000100:00100000:3.0:1788391205.840560:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103481344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391205.840567:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788391205.840651:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103481344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391205.981144:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391205.981321:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239232 00000100:00100000:2.0:1788391205.981331:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239232 00000100:00080000:1.0:1788391205.981400:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391205.981422:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:2.0:1788391205.981434:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37145:x1875263094239232:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788391205.981537:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37145:x1875263094239232:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 104us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391205.981545:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:2.0:1788391205.992158:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391205.992942:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239488 00000100:00100000:0.0:1788391205.992954:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239488 00000100:00100000:0.0:1788391205.993109:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391205.993121:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37145:x1875263094239488:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788391205.993391:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:37145:x1875263094239488:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 263us (1234us total) trans 30064771394 rc 0/0 00000100:00100000:0.0:1788391205.993399:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788391206.176513:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.176792:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239616 00000100:00100000:2.0:1788391206.176802:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239616 00000100:00100000:2.0:1788391206.176915:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:2.0:1788391206.176926:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:37654:x1875263094239616:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788391206.176947:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391206.176990:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37cae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0028d expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177066:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177080:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177093:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391206.177127:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391206.177132:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391206.177162:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177187:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37cae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 7 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177207:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 6 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391206.177213:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:2.0:1788391206.177216:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391206.177218:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ee00, rc 0) 00000100:00100000:2.0:1788391206.177263:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:37654:x1875263094239616:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 340us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391206.177267:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00080000:1.0:1788391206.177434:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391206.518614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.518697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.518745:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.518775:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.518798:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391206.518827:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240000 00000100:00100000:2.0:1788391206.518836:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240000 00000100:00100000:2.0:1788391206.518884:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240256 00000100:00100000:2.0:1788391206.518887:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240256 00000100:00100000:2.0:1788391206.518905:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788391206.518914:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094240000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391206.519024:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094240000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391206.519031:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1788391206.519049:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788391206.519055:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094240256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391206.519079:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094240256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391206.519084:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1788391206.519371:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239872 00000100:00100000:1.0:1788391206.519384:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239872 00000100:00100000:1.0:1788391206.519666:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:1.0:1788391206.519691:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094239872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391206.519724:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094239872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391206.519731:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1788391206.519811:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094239744 00000100:00100000:0.0:1788391206.519817:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094239744 00002000:00100000:0.0:1788391206.519873:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff95d58b28ca80 x1875263094239744/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:67/0 lens 504/0 e 0 to 0 dl 1788391217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391206.519885:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28ca80 with x1875263094239744 ext(0->11) 00002000:00010000:0.0:1788391206.519890:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b28ca80 00000100:00080000:1.0:1788391206.519906:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391206.519915:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1788391206.519930:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2358:x1875263094239744:12345-192.168.202.1@tcp:4:cat.0 00000100:00100000:0.0:1788391206.520710:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2358:x1875263094239744:12345-192.168.202.1@tcp:4:cat.0 Request processed in 786us (2104us total) trans 30064771233 rc 0/0 00000100:00100000:0.0:1788391206.520718:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00002000:00100000:0.0:1788391206.520725:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff95d58b28ca80 x1875263094239744/t30064771233(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:67/0 lens 504/448 e 0 to 0 dl 1788391217 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391206.520743:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28ca80 with x1875263094239744 ext(0->11) 00002000:00010000:0.0:1788391206.520748:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b28ca80 00000100:00100000:3.0:1788391206.520873:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240128 00000100:00100000:3.0:1788391206.520880:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240128 00000100:00080000:1.0:1788391206.520954:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391206.521203:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1788391206.521213:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094240128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391206.521260:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:2359:x1875263094240128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391206.521267:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00010000:00010000:0.0:1788391206.863073:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391207.885506:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391207.945291:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771394 is committed 00000020:00080000:1.0:1788391207.945331:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d69191ee40 refcount 2 committed 0 result 0 batchid 25769803910 00000020:00080000:1.0:1788391207.945337:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d58ad54600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d69191e240 00000020:00080000:1.0:1788391207.945341:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d58ad54b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d5810bb400 00000020:00080000:1.0:1788391207.945358:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803909 batchid updated 00000020:00080000:3.0:1788391207.945591:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803910 committed batchid 25769803909 00000020:00080000:3.0:1788391207.945935:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000001:00080000:1.0:1788391207.946848:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771233 is committed 00000001:00080000:1.0:1788391207.946902:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771222 is committed 00000001:02000400:3.0:1788391208.076167:0:46251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 19:20:07 (1788391207) 00010000:00010000:0.0:1788391208.909979:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391209.267485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.267551:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240512 00000100:00100000:2.0:1788391209.267563:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240512 00000100:00100000:2.0:1788391209.267706:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:2.0:1788391209.267718:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:37937:x1875263094240512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391209.267739:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.267762:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37cbc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00294 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267839:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267853:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267865:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267880:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267887:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.267893:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788391209.268193:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391209.268754:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37cd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268767:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268774:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391209.268785:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788391209.268899:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268907:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268913:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268918:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.268922:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268928:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268944:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:2.0:1788391209.268947:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.268951:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.268957:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37cc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269223:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269232:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269237:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269243:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1fa00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.269246:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269253:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269262:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6830d2f00) 00010000:00010000:2.0:1788391209.269265:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.269268:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.269274:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.271239:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37cbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00294 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.271282:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00294 expref: 29 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.271293:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391209.271295:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.271300:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1f200, rc 0) 00000100:00100000:2.0:1788391209.271393:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37937:x1875263094240512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3675us (3917us total) trans 30064771395 rc 0/0 00000100:00100000:2.0:1788391209.271403:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:0.0:1788391209.275145:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.275179:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240640 00000100:00100000:1.0:1788391209.275199:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240640 00000100:00100000:1.0:1788391209.275262:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1788391209.275273:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2359:x1875263094240640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391209.275287:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391209.275309:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37cd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00294 expref: 29 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.275330:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391209.275335:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391209.275404:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094240640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 132us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391209.275654:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1788391209.276040:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.276108:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094240768 00000100:00100000:2.0:1788391209.276113:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094240768 00000100:00100000:2.0:1788391209.276158:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:2.0:1788391209.276167:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:37937:x1875263094240768:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788391209.276248:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:37937:x1875263094240768:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.276261:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:3.0:1788391209.381290:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.381639:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241024 00000100:00100000:0.0:1788391209.381650:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241024 00000100:00100000:0.0:1788391209.382134:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:0.0:1788391209.382148:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:37952:x1875263094241024:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:0.0:1788391209.382203:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391209.382229:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd37a07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc001bb expref: 28 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.382250:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:0.0:1788391209.382255:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391209.382642:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.382658:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 5 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.382667:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.382701:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 5 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.382861:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 5 pid: 42646 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.382876:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68527ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103481472:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391209.383079:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a691cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788391209.385194:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68527ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103481472:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391209.385230:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391209.385937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.386216:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241152 00000100:00100000:2.0:1788391209.386224:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241152 00000100:00080000:1.0:1788391209.386275:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391209.386405:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 6 pid: 42646 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391209.386506:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1788391209.386517:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094241152:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391209.386531:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391209.386537:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 6 pid: 42646 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386548:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 6 pid: 42646 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386567:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37cb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0028d expref: 6 pid: 42646 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386583:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391209.386587:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386593:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386598:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.386653:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391209.386698:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094241152:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391209.386703:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:0.0:1788391209.386748:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.386753:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.386772:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.386778:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.386784:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391209.388157:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:0.0:1788391209.388168:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388174:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388184:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388188:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391209.388191:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388195:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388204:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29900) 00010000:00010000:0.0:1788391209.388206:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391209.388209:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.388213:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37cdf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391209.388223:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000046c2d94 reply state 000000008e528ec0 transno 30064771396 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.388229:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391209.388289:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37952:x1875263094241024:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 6143us (7007us total) trans 30064771396 rc 0/0 00000100:00100000:0.0:1788391209.388295:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 364 00010000:00010000:1.0:1788391209.391954:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392063:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392073:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392078:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391209.392083:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392091:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392106:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff95d6a704c200) 00010000:00010000:1.0:1788391209.392109:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391209.392113:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391209.392119:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37ce6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391209.399254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.399327:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241280 00000100:00100000:0.0:1788391209.399338:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241280 00000100:00100000:0.0:1788391209.399416:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:0.0:1788391209.399428:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:37953:x1875263094241280:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391209.399475:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.399500:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0029b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399568:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399582:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399594:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391209.399629:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391209.399632:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391209.399651:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399676:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0029b expref: 30 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399696:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0029b expref: 29 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.399705:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391209.399708:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391209.399712:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:0.0:1788391209.399840:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37953:x1875263094241280:12345-192.168.202.1@tcp:101:dd.0 Request processed in 406us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.399848:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:3.0:1788391209.401808:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.401910:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241408 00000100:00100000:2.0:1788391209.401920:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241408 00000100:00100000:2.0:1788391209.402057:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:2.0:1788391209.402069:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:37953:x1875263094241408:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391209.402087:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.402105:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002a2 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402165:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402178:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402189:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402203:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402210:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402216:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402306:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37d10 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402314:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37d10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402321:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37d10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391209.402345:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788391209.402376:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391209.402394:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37d10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402407:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402414:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402421:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402427:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.402431:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402439:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402452:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391209.402455:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.402460:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402466:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402484:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402494:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402500:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402504:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1e800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.402507:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402513:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402520:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391209.402523:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.402526:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402532:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402561:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37cfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002a2 expref: 31 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402574:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ee00/0x9aafc5f04cd37d10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002a2 expref: 30 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.402582:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391209.402584:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788391209.402587:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ee00, rc 0) 00000100:00100000:2.0:1788391209.402643:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37953:x1875263094241408:12345-192.168.202.1@tcp:101:dd.0 Request processed in 577us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.402650:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:3.0:1788391209.404757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.404825:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241664 00000100:00100000:0.0:1788391209.404835:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241664 00000100:00100000:0.0:1788391209.404894:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 367 00000100:00100000:0.0:1788391209.404904:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:37953:x1875263094241664:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391209.404921:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.404936:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37d17 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002a9 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405134:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405144:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405152:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405189:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405194:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.405198:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391209.405687:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xca:0x0], index 0: 0 00010000:00010000:0.0:1788391209.406026:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37d2c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406036:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37d2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406052:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37d2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406088:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406095:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406101:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406106:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391209.406110:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406117:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406138:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:0.0:1788391209.406141:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391209.406145:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406150:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d1e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391209.406166:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000161ebc53 reply state 00000000041ab0a2 transno 30064771397 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.406174:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391209.406209:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa200/0x9aafc5f04cd37d17 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002a9 expref: 33 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406222:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37d2c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002a9 expref: 32 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.406229:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.406232:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391209.406234:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:0.0:1788391209.406302:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37953:x1875263094241664:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1398us (1550us total) trans 30064771397 rc 0/0 00000100:00100000:0.0:1788391209.406310:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 367 00010000:00010000:2.0:1788391209.407636:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407649:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407656:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407662:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fac00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.407665:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407670:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407680:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff95d6a704cb00) 00010000:00010000:2.0:1788391209.407682:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.407684:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.407688:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37d25 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391209.411713:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.411802:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241792 00000100:00100000:0.0:1788391209.411813:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241792 00000100:00100000:0.0:1788391209.411893:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788391209.411908:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+7:37953:x1875263094241792:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391209.411925:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.411946:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca931a2c/0x9aafc5f04cd37d3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002b0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788391209.412060:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788391209.412215:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391209.412237:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=1026s v=(0 0) 00010000:00010000:0.0:1788391209.412243:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391209.412254:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca931a2c/0x9aafc5f04cd37d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002b0 expref: 8 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.412271:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca931a2c/0x9aafc5f04cd37d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002b0 expref: 8 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.412297:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64faa00, rc 0) 00000100:00100000:0.0:1788391209.412346:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:37953:x1875263094241792:12345-192.168.202.1@tcp:101:dd.0 Request processed in 445us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.412500:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788391209.431693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.431795:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094241920 00000100:00100000:2.0:1788391209.431874:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094241920 00002000:00100000:2.0:1788391209.431927:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff95d58cb19500 x1875263094241920/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.431943:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19500 with x1875263094241920 ext(0->1048575) 00002000:00010000:2.0:1788391209.431950:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19500 00000100:00100000:2.0:1788391209.432137:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:2.0:1788391209.432150:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2357:x1875263094241920:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.441038:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391209.441409:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242048 00000100:00100000:3.0:1788391209.441428:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242048 00002000:00100000:3.0:1788391209.441473:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff95d68527ad80 x1875263094242048/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391209.441484:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527ad80 with x1875263094242048 ext(1048576->2097151) 00002000:00010000:3.0:1788391209.441490:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68527ad80 00000100:00100000:3.0:1788391209.441565:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:3.0:1788391209.441578:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094242048:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.446860:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094241920:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14700us (15166us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1788391209.446876:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00002000:00100000:2.0:1788391209.446889:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff95d58cb19500 x1875263094241920/t30064771166(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.446900:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19500 with x1875263094241920 ext(0->1048575) 00002000:00010000:2.0:1788391209.446907:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb19500 00000100:00100000:3.0:1788391209.449528:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2359:x1875263094242048:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7945us (8491us total) trans 30064771167 rc 0/0 00000100:00100000:3.0:1788391209.449542:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00002000:00100000:3.0:1788391209.449552:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff95d68527ad80 x1875263094242048/t30064771167(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391209.449563:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527ad80 with x1875263094242048 ext(1048576->2097151) 00002000:00010000:3.0:1788391209.449568:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68527ad80 00000100:00100000:1.0:1788391209.459679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.459762:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242176 00000100:00100000:0.0:1788391209.459770:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242176 00002000:00100000:0.0:1788391209.459860:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff95d58cb1bb80 x1875263094242176/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.459868:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1bb80 with x1875263094242176 ext(2097152->3145727) 00002000:00010000:0.0:1788391209.459872:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1bb80 00000100:00100000:0.0:1788391209.459925:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:0.0:1788391209.459932:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2358:x1875263094242176:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.468451:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2358:x1875263094242176:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8510us (8771us total) trans 30064771168 rc 0/0 00000100:00100000:2.0:1788391209.468461:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00002000:00100000:2.0:1788391209.468471:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff95d58cb1bb80 x1875263094242176/t30064771168(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.468479:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1bb80 with x1875263094242176 ext(2097152->3145727) 00002000:00010000:2.0:1788391209.468484:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1bb80 00000100:00100000:1.0:1788391209.473571:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.473676:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242304 00000100:00100000:0.0:1788391209.473686:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242304 00002000:00100000:0.0:1788391209.473747:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff95d58cb18380 x1875263094242304/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.473758:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18380 with x1875263094242304 ext(3145728->4194303) 00002000:00010000:0.0:1788391209.473763:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb18380 00000100:00100000:0.0:1788391209.473800:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:0.0:1788391209.473811:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2358:x1875263094242304:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.480518:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2358:x1875263094242304:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6699us (6948us total) trans 30064771169 rc 0/0 00000100:00100000:2.0:1788391209.480532:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00002000:00100000:2.0:1788391209.480544:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff95d58cb18380 x1875263094242304/t30064771169(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.480559:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18380 with x1875263094242304 ext(3145728->4194303) 00002000:00010000:2.0:1788391209.480564:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb18380 00000100:00100000:1.0:1788391209.484565:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391209.484908:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242432 00000100:00100000:3.0:1788391209.484918:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242432 00002000:00100000:3.0:1788391209.485002:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff95d58cb18a80 x1875263094242432/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391209.485013:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18a80 with x1875263094242432 ext(4194304->5242879) 00002000:00010000:3.0:1788391209.485020:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb18a80 00000100:00100000:3.0:1788391209.485091:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:3.0:1788391209.485100:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2359:x1875263094242432:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.493215:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2359:x1875263094242432:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8092us (8637us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1788391209.493247:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00002000:00100000:0.0:1788391209.493270:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff95d58cb18a80 x1875263094242432/t30064771170(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.493279:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb18a80 with x1875263094242432 ext(4194304->5242879) 00002000:00010000:0.0:1788391209.493285:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb18a80 00000100:00100000:3.0:1788391209.499034:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.499233:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242560 00000100:00100000:2.0:1788391209.499243:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242560 00002000:00100000:2.0:1788391209.499308:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff95d58d2f9c00 x1875263094242560/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.499321:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9c00 with x1875263094242560 ext(5242880->6291455) 00002000:00010000:2.0:1788391209.499327:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9c00 00000100:00100000:2.0:1788391209.499414:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1788391209.499424:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094242560:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.507817:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2356:x1875263094242560:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8382us (8781us total) trans 30064771171 rc 0/0 00000100:00100000:2.0:1788391209.507834:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00002000:00100000:2.0:1788391209.507847:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff95d58d2f9c00 x1875263094242560/t30064771171(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.507857:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9c00 with x1875263094242560 ext(5242880->6291455) 00002000:00010000:2.0:1788391209.507863:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9c00 00000100:00100000:3.0:1788391209.513363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.513638:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242688 00000100:00100000:2.0:1788391209.513648:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242688 00002000:00100000:2.0:1788391209.513695:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff95d5853d2d80 x1875263094242688/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.513707:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2d80 with x1875263094242688 ext(6291456->7340031) 00002000:00010000:2.0:1788391209.513713:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d2d80 00000100:00100000:2.0:1788391209.513795:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:2.0:1788391209.513806:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094242688:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.519906:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2357:x1875263094242688:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6093us (6557us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1788391209.519917:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00002000:00100000:2.0:1788391209.519926:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff95d5853d2d80 x1875263094242688/t30064771172(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.519934:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2d80 with x1875263094242688 ext(6291456->7340031) 00002000:00010000:2.0:1788391209.519938:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d2d80 00000100:00100000:3.0:1788391209.524782:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.524893:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242816 00000100:00100000:0.0:1788391209.524904:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242816 00002000:00100000:0.0:1788391209.525003:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff95d5853d0000 x1875263094242816/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.525015:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d0000 with x1875263094242816 ext(7340032->8388607) 00002000:00010000:0.0:1788391209.525021:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d0000 00000100:00100000:0.0:1788391209.525046:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:0.0:1788391209.525057:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2356:x1875263094242816:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.534218:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2356:x1875263094242816:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9151us (9434us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1788391209.534232:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00002000:00100000:2.0:1788391209.534244:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff95d5853d0000 x1875263094242816/t30064771173(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.534264:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d0000 with x1875263094242816 ext(7340032->8388607) 00002000:00010000:2.0:1788391209.534270:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d0000 00000100:00100000:3.0:1788391209.538639:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.538837:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094242944 00000100:00100000:2.0:1788391209.538847:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094242944 00002000:00100000:2.0:1788391209.538895:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff95d58c968e00 x1875263094242944/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.538906:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968e00 with x1875263094242944 ext(8388608->9437183) 00002000:00010000:2.0:1788391209.538913:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c968e00 00000100:00100000:2.0:1788391209.539069:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:2.0:1788391209.539079:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2357:x1875263094242944:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.548951:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2357:x1875263094242944:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9862us (10312us total) trans 30064771174 rc 0/0 00000100:00100000:2.0:1788391209.548989:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00002000:00100000:2.0:1788391209.549002:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff95d58c968e00 x1875263094242944/t30064771174(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.549012:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968e00 with x1875263094242944 ext(8388608->9437183) 00002000:00010000:2.0:1788391209.549018:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c968e00 00000100:00100000:0.0:1788391209.554768:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.554863:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243072 00000100:00100000:2.0:1788391209.554873:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243072 00002000:00100000:2.0:1788391209.554920:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff95d685278700 x1875263094243072/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.554931:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278700 with x1875263094243072 ext(9437184->10485759) 00002000:00010000:2.0:1788391209.554937:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278700 00000100:00100000:2.0:1788391209.554998:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:2.0:1788391209.555008:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2356:x1875263094243072:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391209.565594:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.565699:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243200 00000100:00100000:0.0:1788391209.565708:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243200 00002000:00100000:0.0:1788391209.565756:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff95d58c96a300 x1875263094243200/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.565767:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96a300 with x1875263094243200 ext(10485760->11534335) 00002000:00010000:0.0:1788391209.565772:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c96a300 00000100:00100000:0.0:1788391209.565806:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:0.0:1788391209.565816:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094243200:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.566044:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2356:x1875263094243072:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11037us (11285us total) trans 30064771175 rc 0/0 00000100:00100000:2.0:1788391209.566049:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00002000:00100000:2.0:1788391209.566055:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff95d685278700 x1875263094243072/t30064771175(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.566061:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278700 with x1875263094243072 ext(9437184->10485759) 00002000:00010000:2.0:1788391209.566063:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278700 00000100:00100000:2.0:1788391209.573259:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2357:x1875263094243200:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7436us (7663us total) trans 30064771176 rc 0/0 00000100:00100000:2.0:1788391209.573270:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00002000:00100000:2.0:1788391209.573281:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff95d58c96a300 x1875263094243200/t30064771176(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.573289:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96a300 with x1875263094243200 ext(10485760->11534335) 00002000:00010000:2.0:1788391209.573294:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c96a300 00000100:00100000:0.0:1788391209.578017:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.578151:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243328 00000100:00100000:2.0:1788391209.578160:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243328 00002000:00100000:2.0:1788391209.578219:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff95d685278a80 x1875263094243328/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.578230:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278a80 with x1875263094243328 ext(11534336->12582911) 00002000:00010000:2.0:1788391209.578236:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278a80 00000100:00100000:2.0:1788391209.578270:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:2.0:1788391209.578280:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2356:x1875263094243328:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.587849:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2356:x1875263094243328:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9559us (9827us total) trans 30064771177 rc 0/0 00000100:00100000:2.0:1788391209.587864:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00002000:00100000:2.0:1788391209.587876:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff95d685278a80 x1875263094243328/t30064771177(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.587887:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685278a80 with x1875263094243328 ext(11534336->12582911) 00002000:00010000:2.0:1788391209.587893:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685278a80 00000100:00100000:0.0:1788391209.594199:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.594582:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243456 00000100:00100000:1.0:1788391209.594593:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243456 00002000:00100000:1.0:1788391209.594642:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff95d685279880 x1875263094243456/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391209.594668:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279880 with x1875263094243456 ext(12582912->13631487) 00002000:00010000:1.0:1788391209.594674:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685279880 00000100:00100000:1.0:1788391209.594704:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:1.0:1788391209.594714:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2357:x1875263094243456:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391209.604954:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2357:x1875263094243456:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10230us (10754us total) trans 30064771178 rc 0/0 00000100:00100000:3.0:1788391209.604985:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00002000:00100000:3.0:1788391209.604999:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff95d685279880 x1875263094243456/t30064771178(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391209.605009:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279880 with x1875263094243456 ext(12582912->13631487) 00002000:00010000:3.0:1788391209.605016:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685279880 00000100:00100000:1.0:1788391209.611661:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.611780:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243584 00000100:00100000:2.0:1788391209.611791:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243584 00002000:00100000:2.0:1788391209.612061:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff95d58cb1b480 x1875263094243584/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.612079:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1b480 with x1875263094243584 ext(13631488->14680063) 00002000:00010000:2.0:1788391209.612086:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1b480 00000100:00100000:2.0:1788391209.612198:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:2.0:1788391209.612220:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2358:x1875263094243584:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.620324:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2358:x1875263094243584:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8096us (8661us total) trans 30064771179 rc 0/0 00000100:00100000:2.0:1788391209.620337:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00002000:00100000:2.0:1788391209.620363:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff95d58cb1b480 x1875263094243584/t30064771179(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.620373:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb1b480 with x1875263094243584 ext(13631488->14680063) 00002000:00010000:2.0:1788391209.620380:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58cb1b480 00000100:00100000:1.0:1788391209.623579:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.623745:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243840 00000100:00100000:0.0:1788391209.623756:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243840 00000100:00100000:0.0:1788391209.623817:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788391209.623828:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:37953:x1875263094243840:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:3.0:1788391209.623853:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.624154:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37953:x1875263094243840:12345-192.168.202.1@tcp:35:dd.0 Request processed in 328us (583us total) trans 30064771398 rc 0/0 00000100:00100000:0.0:1788391209.624166:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:2.0:1788391209.624469:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094243968 00000100:00100000:2.0:1788391209.624475:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094243968 00002000:00100000:2.0:1788391209.624506:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff95d58c96aa00 x1875263094243968/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.624517:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96aa00 with x1875263094243968 ext(14680064->15728639) 00002000:00010000:2.0:1788391209.624522:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c96aa00 00000100:00100000:2.0:1788391209.624546:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:2.0:1788391209.624554:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2359:x1875263094243968:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391209.636490:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.636582:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244224 00000100:00100000:0.0:1788391209.636593:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244224 00000100:00100000:0.0:1788391209.636658:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 368 00000100:00100000:0.0:1788391209.636671:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:37954:x1875263094244224:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391209.636695:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.636717:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d41 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002b7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636837:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636853:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636864:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636881:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636889:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.636909:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391209.637435:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xca:0x0], index 1: 0 00010000:00010000:0.0:1788391209.637610:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37d56 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637622:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637630:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637666:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637674:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637680:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637686:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391209.637690:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637698:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637710:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:0.0:1788391209.637714:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391209.637727:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637734:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d48 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391209.637748:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d304517 reply state 000000005d33521d transno 30064771399 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.637758:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391209.637788:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d41 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002b7 expref: 36 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637803:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37d56 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002b7 expref: 35 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.637811:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391209.637814:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391209.637816:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:0.0:1788391209.637878:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:37954:x1875263094244224:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1211us (1399us total) trans 30064771399 rc 0/0 00000100:00100000:0.0:1788391209.637886:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 368 00000100:00100000:2.0:1788391209.639578:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2359:x1875263094243968:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15018us (15719us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1788391209.639592:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00002000:00100000:2.0:1788391209.639605:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff95d58c96aa00 x1875263094243968/t30064771180(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.639616:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96aa00 with x1875263094243968 ext(14680064->15728639) 00002000:00010000:2.0:1788391209.639622:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c96aa00 00010000:00010000:2.0:1788391209.639993:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640002:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640009:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640015:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.640020:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640027:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640549:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff95d6a704c900) 00010000:00010000:2.0:1788391209.640553:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.640559:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.640892:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d4f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391209.642225:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.642401:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244352 00000100:00100000:0.0:1788391209.642411:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244352 00000100:00100000:0.0:1788391209.642493:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1788391209.642505:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:37954:x1875263094244352:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391209.642523:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.642543:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd37d64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002be expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391209.642591:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391209.642614:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=1026s v=(0 0) 00010000:00010000:0.0:1788391209.642620:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391209.642629:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd37d64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002be expref: 11 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.642644:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e6ff1f1/0x9aafc5f04cd37d64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002be expref: 11 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.642657:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa200, rc 0) 00000100:00100000:0.0:1788391209.642707:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:37954:x1875263094244352:12345-192.168.202.1@tcp:101:dd.0 Request processed in 205us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.642713:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00080000:1.0:1788391209.642776:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391209.661242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.661549:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244480 00000100:00100000:2.0:1788391209.661559:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244480 00002000:00100000:2.0:1788391209.661610:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff95d58c96ad80 x1875263094244480/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.661621:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96ad80 with x1875263094244480 ext(0->1048575) 00002000:00010000:2.0:1788391209.661628:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96ad80 00000100:00100000:2.0:1788391209.661659:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:2.0:1788391209.661670:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094244480:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.671906:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094244480:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10229us (10661us total) trans 30064771234 rc 0/0 00000100:00100000:2.0:1788391209.671917:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00002000:00100000:2.0:1788391209.671927:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff95d58c96ad80 x1875263094244480/t30064771234(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.671935:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96ad80 with x1875263094244480 ext(0->1048575) 00002000:00010000:2.0:1788391209.671941:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96ad80 00000100:00100000:1.0:1788391209.673014:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.673081:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244608 00000100:00100000:2.0:1788391209.673089:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244608 00002000:00100000:2.0:1788391209.673121:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff95d68f321500 x1875263094244608/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.673128:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321500 with x1875263094244608 ext(1048576->2097151) 00002000:00010000:2.0:1788391209.673131:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321500 00000100:00100000:2.0:1788391209.673157:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:2.0:1788391209.673163:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094244608:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.679890:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094244608:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6715us (6872us total) trans 30064771235 rc 0/0 00000100:00100000:2.0:1788391209.679905:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00002000:00100000:2.0:1788391209.679919:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff95d68f321500 x1875263094244608/t30064771235(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.679927:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321500 with x1875263094244608 ext(1048576->2097151) 00002000:00010000:2.0:1788391209.679932:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321500 00000100:00100000:3.0:1788391209.693184:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.693245:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244736 00000100:00100000:2.0:1788391209.693255:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244736 00002000:00100000:2.0:1788391209.693300:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff95d58c968700 x1875263094244736/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.693309:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968700 with x1875263094244736 ext(2097152->3145727) 00002000:00010000:2.0:1788391209.693314:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968700 00000100:00100000:2.0:1788391209.693341:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:2.0:1788391209.693360:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094244736:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.702444:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094244736:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9081us (9258us total) trans 30064771236 rc 0/0 00000100:00100000:2.0:1788391209.702460:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00002000:00100000:2.0:1788391209.702474:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff95d58c968700 x1875263094244736/t30064771236(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.702485:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968700 with x1875263094244736 ext(2097152->3145727) 00002000:00010000:2.0:1788391209.702492:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968700 00000100:00100000:0.0:1788391209.704457:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.705211:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244864 00000100:00100000:2.0:1788391209.705221:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244864 00002000:00100000:2.0:1788391209.705268:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff95d68527a300 x1875263094244864/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.705276:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527a300 with x1875263094244864 ext(3145728->4194303) 00002000:00010000:2.0:1788391209.705280:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527a300 00000100:00100000:2.0:1788391209.705311:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:2.0:1788391209.705322:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094244864:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.713734:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094244864:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8401us (9270us total) trans 30064771237 rc 0/0 00000100:00100000:2.0:1788391209.713749:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 243 00002000:00100000:2.0:1788391209.713761:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff95d68527a300 x1875263094244864/t30064771237(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.713771:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527a300 with x1875263094244864 ext(3145728->4194303) 00002000:00010000:2.0:1788391209.713776:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527a300 00000100:00100000:3.0:1788391209.717834:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.717940:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094244992 00000100:00100000:2.0:1788391209.717950:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094244992 00002000:00100000:2.0:1788391209.718028:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff95d58c96b100 x1875263094244992/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.718040:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b100 with x1875263094244992 ext(4194304->5242879) 00002000:00010000:2.0:1788391209.718045:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b100 00000100:00100000:2.0:1788391209.718075:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:2.0:1788391209.718086:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094244992:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.728491:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094244992:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10394us (10653us total) trans 30064771238 rc 0/0 00000100:00100000:0.0:1788391209.728506:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 244 00002000:00100000:0.0:1788391209.728521:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff95d58c96b100 x1875263094244992/t30064771238(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.728531:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b100 with x1875263094244992 ext(4194304->5242879) 00002000:00010000:0.0:1788391209.728537:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b100 00000100:00100000:1.0:1788391209.729009:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.732451:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245120 00000100:00100000:0.0:1788391209.732465:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245120 00002000:00100000:0.0:1788391209.732530:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff95d68f322300 x1875263094245120/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.732558:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322300 with x1875263094245120 ext(5242880->6291455) 00002000:00010000:0.0:1788391209.732573:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322300 00000100:00100000:0.0:1788391209.732604:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:0.0:1788391209.732614:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2358:x1875263094245120:12345-192.168.202.1@tcp:4:dd.0 00000040:00080000:0.0:1788391209.741581:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391209.741590:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391209.742142:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:0.0:1788391209.742151:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391209.745808:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2358:x1875263094245120:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13186us (16789us total) trans 30064771239 rc 0/0 00000100:00100000:0.0:1788391209.745822:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 245 00002000:00100000:0.0:1788391209.745836:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff95d68f322300 x1875263094245120/t30064771239(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.745845:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322300 with x1875263094245120 ext(5242880->6291455) 00002000:00010000:0.0:1788391209.745852:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322300 00000100:00100000:3.0:1788391209.752068:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.752123:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245248 00000100:00100000:1.0:1788391209.752134:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245248 00002000:00100000:1.0:1788391209.752183:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff95d58c96b800 x1875263094245248/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391209.752195:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b800 with x1875263094245248 ext(6291456->7340031) 00002000:00010000:1.0:1788391209.752200:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b800 00000100:00100000:1.0:1788391209.752236:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:1.0:1788391209.752246:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2359:x1875263094245248:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391209.760470:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2359:x1875263094245248:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8217us (8401us total) trans 30064771240 rc 0/0 00000100:00100000:1.0:1788391209.760481:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00002000:00100000:1.0:1788391209.760491:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff95d58c96b800 x1875263094245248/t30064771240(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391209.760498:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b800 with x1875263094245248 ext(6291456->7340031) 00002000:00010000:1.0:1788391209.760514:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b800 00000100:00100000:3.0:1788391209.762816:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.762909:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245376 00000100:00100000:0.0:1788391209.762921:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245376 00002000:00100000:0.0:1788391209.763293:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff95d58c96a680 x1875263094245376/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.763306:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96a680 with x1875263094245376 ext(7340032->8388607) 00002000:00010000:0.0:1788391209.763311:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96a680 00000100:00100000:0.0:1788391209.763355:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:0.0:1788391209.763368:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2359:x1875263094245376:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.775355:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094245376:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11969us (12526us total) trans 30064771241 rc 0/0 00000100:00100000:0.0:1788391209.775368:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 247 00002000:00100000:0.0:1788391209.775381:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff95d58c96a680 x1875263094245376/t30064771241(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.775389:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96a680 with x1875263094245376 ext(7340032->8388607) 00002000:00010000:0.0:1788391209.775394:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96a680 00000100:00100000:1.0:1788391209.775799:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.775880:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245504 00000100:00100000:0.0:1788391209.775886:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245504 00002000:00100000:0.0:1788391209.775918:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff95d68f322d80 x1875263094245504/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.775924:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322d80 with x1875263094245504 ext(8388608->9437183) 00002000:00010000:0.0:1788391209.775927:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322d80 00000100:00100000:0.0:1788391209.775992:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:0.0:1788391209.776000:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2358:x1875263094245504:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.783387:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2358:x1875263094245504:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7376us (7577us total) trans 30064771242 rc 0/0 00000100:00100000:0.0:1788391209.783400:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 248 00002000:00100000:0.0:1788391209.783412:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff95d68f322d80 x1875263094245504/t30064771242(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.783423:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f322d80 with x1875263094245504 ext(8388608->9437183) 00002000:00010000:0.0:1788391209.783428:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f322d80 00000100:00100000:3.0:1788391209.789178:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.789357:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245632 00000100:00100000:1.0:1788391209.789367:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245632 00002000:00100000:1.0:1788391209.789410:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff95d58c96b480 x1875263094245632/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391209.789418:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b480 with x1875263094245632 ext(9437184->10485759) 00002000:00010000:1.0:1788391209.789423:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b480 00000100:00100000:1.0:1788391209.789484:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:1.0:1788391209.789491:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2358:x1875263094245632:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.797385:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2358:x1875263094245632:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7882us (8202us total) trans 30064771243 rc 0/0 00000100:00100000:2.0:1788391209.797398:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 249 00002000:00100000:2.0:1788391209.797408:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff95d58c96b480 x1875263094245632/t30064771243(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.797422:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96b480 with x1875263094245632 ext(9437184->10485759) 00002000:00010000:2.0:1788391209.797427:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96b480 00000100:00100000:3.0:1788391209.809257:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.809692:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245760 00000100:00100000:0.0:1788391209.809715:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245760 00002000:00100000:0.0:1788391209.809760:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff95d58c96bb80 x1875263094245760/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.809768:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96bb80 with x1875263094245760 ext(10485760->11534335) 00002000:00010000:0.0:1788391209.809772:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96bb80 00000100:00100000:0.0:1788391209.809832:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:0.0:1788391209.809840:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2359:x1875263094245760:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.818144:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2359:x1875263094245760:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8287us (8878us total) trans 30064771244 rc 0/0 00000100:00100000:0.0:1788391209.818159:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00002000:00100000:0.0:1788391209.818171:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff95d58c96bb80 x1875263094245760/t30064771244(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.818182:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c96bb80 with x1875263094245760 ext(10485760->11534335) 00002000:00010000:0.0:1788391209.818188:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c96bb80 00000100:00100000:3.0:1788391209.825002:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.825144:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094245888 00000100:00100000:0.0:1788391209.825153:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094245888 00002000:00100000:0.0:1788391209.825199:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff95d58c969880 x1875263094245888/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.825207:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c969880 with x1875263094245888 ext(11534336->12582911) 00002000:00010000:0.0:1788391209.825212:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c969880 00000100:00100000:0.0:1788391209.825245:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1788391209.825255:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094245888:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.834170:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094245888:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8906us (9205us total) trans 30064771245 rc 0/0 00000100:00100000:0.0:1788391209.834205:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00002000:00100000:0.0:1788391209.834218:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff95d58c969880 x1875263094245888/t30064771245(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.834229:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c969880 with x1875263094245888 ext(11534336->12582911) 00002000:00010000:0.0:1788391209.834236:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c969880 00000100:00100000:3.0:1788391209.838498:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.838561:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246016 00000100:00100000:2.0:1788391209.838582:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246016 00002000:00100000:2.0:1788391209.838635:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff95d58c968380 x1875263094246016/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.838647:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968380 with x1875263094246016 ext(12582912->13631487) 00002000:00010000:2.0:1788391209.838654:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968380 00000100:00100000:2.0:1788391209.838686:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:2.0:1788391209.838697:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094246016:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.847664:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2356:x1875263094246016:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8961us (9164us total) trans 30064771246 rc 0/0 00000100:00100000:2.0:1788391209.847674:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00002000:00100000:2.0:1788391209.847683:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff95d58c968380 x1875263094246016/t30064771246(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.847691:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968380 with x1875263094246016 ext(12582912->13631487) 00002000:00010000:2.0:1788391209.847696:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968380 00000100:00100000:3.0:1788391209.850226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.850315:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246144 00000100:00100000:0.0:1788391209.850323:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246144 00002000:00100000:0.0:1788391209.850384:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff95d58c968000 x1875263094246144/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391209.850395:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968000 with x1875263094246144 ext(13631488->14680063) 00002000:00010000:0.0:1788391209.850400:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968000 00000100:00100000:0.0:1788391209.850485:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:0.0:1788391209.850496:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2357:x1875263094246144:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391209.855392:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094246144:12345-192.168.202.1@tcp:4:dd.0 Request processed in 4889us (5164us total) trans 30064771247 rc 0/0 00000100:00100000:2.0:1788391209.855406:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00002000:00100000:2.0:1788391209.855418:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff95d58c968000 x1875263094246144/t30064771247(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.855434:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c968000 with x1875263094246144 ext(13631488->14680063) 00002000:00010000:2.0:1788391209.855440:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58c968000 00000100:00100000:0.0:1788391209.865877:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.866020:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246272 00000100:00100000:2.0:1788391209.866029:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246272 00002000:00100000:2.0:1788391209.866070:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff95d68527aa00 x1875263094246272/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/0 e 0 to 0 dl 1788391220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391209.866078:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527aa00 with x1875263094246272 ext(14680064->15728639) 00002000:00010000:2.0:1788391209.866083:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527aa00 00000100:00100000:2.0:1788391209.866109:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:2.0:1788391209.866117:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094246272:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391209.868267:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.868491:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246528 00000100:00100000:1.0:1788391209.868500:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246528 00000100:00100000:1.0:1788391209.868545:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:1.0:1788391209.868553:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37954:x1875263094246528:12345-192.168.202.1@tcp:35:dd.0 00000001:00080000:1.0:1788391209.868795:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771400 00000100:00100000:1.0:1788391209.868888:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:37954:x1875263094246528:12345-192.168.202.1@tcp:35:dd.0 Request processed in 336us (628us total) trans 30064771401 rc 0/0 00000100:00100000:1.0:1788391209.868893:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000020:00080000:1.0:1788391209.868897:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788391209.876088:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094246272:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9962us (10210us total) trans 30064771248 rc 0/0 00000100:00100000:3.0:1788391209.876098:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00002000:00100000:3.0:1788391209.876108:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff95d68527aa00 x1875263094246272/t30064771248(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:70/0 lens 488/448 e 0 to 0 dl 1788391220 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391209.876126:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527aa00 with x1875263094246272 ext(14680064->15728639) 00002000:00010000:3.0:1788391209.876130:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527aa00 00000100:00100000:0.0:1788391209.886014:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.886143:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246656 00000100:00100000:2.0:1788391209.886153:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246656 00000100:00100000:2.0:1788391209.886205:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:2.0:1788391209.886215:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:37955:x1875263094246656:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391209.886240:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.886266:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d6b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002c5 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886303:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d72 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886314:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886323:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886438:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d6b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002c5 expref: 39 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886457:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1e800/0x9aafc5f04cd37d72 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002c5 expref: 38 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.886463:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391209.886465:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391209.886467:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1e800, rc 0) 00000100:00100000:2.0:1788391209.886517:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37955:x1875263094246656:12345-192.168.202.1@tcp:101:chown.0 Request processed in 304us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.886524:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:0.0:1788391209.891624:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.891697:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094246912 00000100:00100000:2.0:1788391209.891707:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094246912 00000100:00100000:2.0:1788391209.891775:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 370 00000100:00100000:2.0:1788391209.891786:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37955:x1875263094246912:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:2.0:1788391209.891837:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391209.891859:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37d2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002a9 expref: 38 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.891873:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391209.891877:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391209.891899:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.891912:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.891922:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391209.892382:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].13, 88 off9168 00000004:00080000:2.0:1788391209.892393:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026999431656ns, next at 1027999428733ns, rc = 0 00000004:00010000:2.0:1788391209.892479:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd76ec1 reply state 00000000afb10f29 transno 30064771402 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391209.892486:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391209.892564:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:37955:x1875263094246912:12345-192.168.202.1@tcp:36:chown.0 Request processed in 779us (950us total) trans 30064771402 rc 0/0 00000100:00100000:2.0:1788391209.892571:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 370 00010000:00010000:2.0:1788391209.896918:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.896933:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.896939:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.896943:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.896947:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.896952:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.896992:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391209.896996:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391209.897001:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.897007:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.897827:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.897877:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247040 00000100:00100000:2.0:1788391209.897887:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247040 00000100:00100000:0.0:1788391209.898037:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00100000:0.0:1788391209.898055:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:37955:x1875263094247040:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1788391209.898078:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.898095:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d80 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002cc expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.898175:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d80 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002cc expref: 39 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.898188:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d80 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002cc expref: 39 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.898207:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.898210:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391209.898213:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788391209.898267:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:37955:x1875263094247040:12345-192.168.202.1@tcp:101:chown.0 Request processed in 219us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.898274:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00100000:0.0:1788391209.903582:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391209.903746:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247168 00000100:00100000:1.0:1788391209.903756:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247168 00000100:00100000:1.0:1788391209.903820:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788391209.903832:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2357:x1875263094247168:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:1.0:1788391209.904272:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1788391209.904276:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1788391209 00002000:00010000:1.0:1788391209.904279:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391209.904297:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1788391210 00002000:00010000:1.0:1788391209.904299:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391209.904369:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094247168:12345-192.168.202.1@tcp:2:chown.0 Request processed in 539us (797us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1788391209.904378:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788391209.920122:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.920210:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247296 00000100:00100000:0.0:1788391209.920221:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247296 00000100:00100000:0.0:1788391209.920528:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:0.0:1788391209.920541:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:37956:x1875263094247296:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1788391209.920574:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.920594:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d87 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002d3 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920637:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d8e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920653:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d8e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920682:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d8e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920780:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37d87 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002d3 expref: 41 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920799:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fae00/0x9aafc5f04cd37d8e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002d3 expref: 40 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.920809:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391209.920811:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391209.920815:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fae00, rc 0) 00000100:00100000:0.0:1788391209.920885:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:37956:x1875263094247296:12345-192.168.202.1@tcp:101:chown.0 Request processed in 347us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.920892:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:0.0:1788391209.924816:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.925066:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247552 00000100:00100000:2.0:1788391209.925074:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247552 00000100:00100000:2.0:1788391209.925396:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 373 00000100:00100000:2.0:1788391209.925408:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:37956:x1875263094247552:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:2.0:1788391209.925462:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391209.925669:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37d56 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002b7 expref: 40 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.925687:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391209.925692:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391209.925721:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.925735:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.925744:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391209.926288:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].13, 88 off9240 00000004:00080000:2.0:1788391209.926296:0:43348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027033335056ns, next at 1028033333107ns, rc = 0 00000004:00010000:2.0:1788391209.926388:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000620e7aed reply state 00000000718bc9e1 transno 30064771403 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391209.926403:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391209.926513:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:37956:x1875263094247552:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1104us (1703us total) trans 30064771403 rc 0/0 00000100:00100000:2.0:1788391209.926522:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 373 00010000:00010000:2.0:1788391209.928774:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928789:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928796:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928803:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4c1f400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.928807:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928815:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928830:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391209.928833:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391209.928837:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.928843:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37d95 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391209.929194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.929342:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247680 00000100:00100000:2.0:1788391209.929361:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247680 00000100:00100000:2.0:1788391209.929440:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 374 00000100:00100000:2.0:1788391209.929448:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:37956:x1875263094247680:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391209.929476:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.929490:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d9c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002da expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.929537:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d9c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002da expref: 41 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.929548:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d9c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002da expref: 41 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.929562:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391209.929565:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391209.929568:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1fa00, rc 0) 00000100:00100000:2.0:1788391209.929616:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:37956:x1875263094247680:12345-192.168.202.1@tcp:101:chown.0 Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.929622:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 374 00000100:00100000:1.0:1788391209.931264:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.931313:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247808 00000100:00100000:0.0:1788391209.931320:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247808 00000100:00100000:0.0:1788391209.931417:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788391209.931427:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094247808:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:0.0:1788391209.931596:0:44885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:0.0:1788391209.931599:0:44885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1788391210 00002000:00010000:0.0:1788391209.931602:0:44885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391209.931603:0:44885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1788391210 00002000:00010000:0.0:1788391209.931605:0:44885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391209.931661:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094247808:12345-192.168.202.1@tcp:2:chown.0 Request processed in 236us (417us total) trans 30064771249 rc 0/0 00000100:00100000:0.0:1788391209.931668:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00010000:00010000:3.0:1788391209.933067:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391209.933097:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103481728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391209.933098:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103481856:0@lo:400:kworker.0 00000100:00100000:1.0:1788391209.933190:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103481984:0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.933593:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103481600:0@lo:400:kworker.0 00000100:00100000:3.0:1788391209.933598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391209.933598:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391209.933640:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391209.933656:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103482240:0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.933676:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788391209.933689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391209.933708:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391209.933745:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481600 00000100:00100000:0.0:1788391209.933751:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481600 00000100:00100000:0.0:1788391209.933791:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788391209.933800:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103481600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391209.933840:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103482368:0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.933848:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103481600:12345-0@lo:400:kworker.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.933849:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481856 00000100:00100000:2.0:1788391209.933855:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481856 00000100:00100000:0.0:1788391209.933860:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788391209.933873:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391209.933898:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788391209.933907:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103481856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.933919:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103481600:0@lo:400:kworker.0 00000100:00080000:3.0:1788391209.933920:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391209.933934:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481728 00000100:00100000:3.0:1788391209.933939:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481728 00000100:00100000:2.0:1788391209.933948:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103481856:12345-0@lo:400:kworker.0 Request processed in 42us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.933950:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482240 00000100:00100000:0.0:1788391209.933957:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482240 00000100:00100000:2.0:1788391209.933958:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788391209.933999:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391209.934010:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103481728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391209.934026:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 308346880 pending 25559040 free 3749707776 avail 3747610624 00000100:00100000:0.0:1788391209.934035:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482112 00000100:00100000:0.0:1788391209.934040:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482112 00000100:00100000:0.0:1788391209.934059:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482368 00000100:00100000:0.0:1788391209.934062:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482368 00000100:00100000:2.0:1788391209.934065:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103481856:0@lo:400:kworker.0 00000100:00100000:3.0:1788391209.934066:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103481728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391209.934073:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788391209.934083:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788391209.934090:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391209.934091:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771222 gen 2 00000100:00100000:0.0:1788391209.934092:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103482240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391209.934094:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788391209.934096:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771222 committed transno 30064771222 00000100:00100000:3.0:1788391209.934115:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788391209.934117:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103481728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391209.934123:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391209.934138:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103482240:0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.934139:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103482240:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.934150:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788391209.934164:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103482112:12345-0@lo:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391209.934172:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788391209.934183:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788391209.934383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391209.934445:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788391209.934556:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103481984 00000100:00100000:2.0:1788391209.934561:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103481984 00000100:00100000:2.0:1788391209.934595:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788391209.934603:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103481984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391209.934648:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103481984:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.934653:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788391209.934747:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103481984:0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.934790:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103482368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391209.934833:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103482368:12345-0@lo:400:kworker.0 Request processed in 644us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391209.934839:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788391209.934900:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103482368:0@lo:400:kworker.0 00000100:00100000:3.0:1788391209.978721:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.979153:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094247936 00000100:00100000:2.0:1788391209.979163:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094247936 00000100:00100000:2.0:1788391209.979235:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 375 00000100:00100000:2.0:1788391209.979257:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:37962:x1875263094247936:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391209.979275:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.979296:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37da3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002e1 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979363:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37daa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979379:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37daa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979389:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37daa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391209.979427:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788391209.979432:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391209.979453:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37daa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979480:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f400/0x9aafc5f04cd37da3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002e1 expref: 43 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979503:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1ea00/0x9aafc5f04cd37daa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002e1 expref: 42 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.979512:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391209.979515:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391209.979518:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4c1ea00, rc 0) 00000100:00100000:2.0:1788391209.979585:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:37962:x1875263094247936:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 341us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.979594:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 375 00000100:00100000:1.0:1788391209.982793:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391209.982846:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248064 00000100:00100000:2.0:1788391209.982858:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248064 00000100:00100000:2.0:1788391209.982913:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 376 00000100:00100000:2.0:1788391209.982924:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:37962:x1875263094248064:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391209.982945:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391209.982990:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37db1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002e8 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983052:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983064:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983074:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983089:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983096:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983102:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983195:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983204:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983211:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391209.983236:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:2.0:1788391209.983240:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391209.983259:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983271:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983279:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983286:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983293:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983299:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.983302:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983309:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983389:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391209.983394:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.983399:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983405:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd0400/0x9aafc5f04cd37db8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983426:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983433:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983440:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983445:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d684cd1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391209.983448:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983454:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983462:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391209.983464:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391209.983467:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983472:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd37dbf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983503:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1f200/0x9aafc5f04cd37db1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002e8 expref: 44 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983517:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002e8 expref: 43 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391209.983524:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391209.983527:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391209.983529:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1e00, rc 0) 00000100:00100000:2.0:1788391209.983646:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:37962:x1875263094248064:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 722us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391209.983656:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 376 00000100:00100000:1.0:1788391209.986866:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.987064:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248320 00000100:00100000:0.0:1788391209.987074:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248320 00000100:00100000:0.0:1788391209.987135:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 377 00000100:00100000:0.0:1788391209.987147:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:37962:x1875263094248320:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391209.987176:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.987196:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37dcd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002ef expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.987303:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37dd4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.987316:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.987327:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391209.987338:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:0.0:1788391209.987481:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd37dcd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002ef expref: 46 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.987499:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002ef expref: 45 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.987530:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.987533:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391209.987536:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:0.0:1788391209.987597:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37962:x1875263094248320:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 452us (740us total) trans 30064771404 rc 0/0 00000100:00100000:0.0:1788391209.987606:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 377 00000100:00100000:3.0:1788391209.990848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391209.990926:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248576 00000100:00100000:0.0:1788391209.990936:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248576 00000100:00100000:0.0:1788391209.991027:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 378 00000100:00100000:0.0:1788391209.991041:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37962:x1875263094248576:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391209.991065:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391209.991068:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1788391209.991094:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd37d80 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002cc expref: 45 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991114:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd37dd4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002ef expref: 44 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991126:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1e00/0x9aafc5f04cd37dc6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002e8 expref: 43 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991139:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.991144:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391209.991157:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37de2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002f6 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991221:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991233:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991241:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991267:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991273:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991278:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991284:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391209.991288:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991295:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991302:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.991304:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391209.991307:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991311:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd37de9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991338:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37df0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991354:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37df0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991362:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37df0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991616:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37df0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002f6 expref: 45 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991625:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.991627:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391209.991641:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd37de2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002f6 expref: 45 pid: 42645 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991652:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fac00/0x9aafc5f04cd37df0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002f6 expref: 44 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391209.991684:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391209.991687:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391209.991695:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fac00, rc 0) 00000100:00100000:0.0:1788391209.991753:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:37962:x1875263094248576:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 716us (915us total) trans 30064771405 rc 0/0 00000100:00100000:0.0:1788391209.991760:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 378 00000100:00100000:1.0:1788391210.018268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.019634:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248704 00000100:00100000:2.0:1788391210.019647:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248704 00002000:00100000:2.0:1788391210.019698:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff95d58aef1180 x1875263094248704/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.019709:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1180 with x1875263094248704 ext(0->1048575) 00002000:00010000:2.0:1788391210.019714:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1180 00000100:00100000:2.0:1788391210.019742:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:2.0:1788391210.019752:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094248704:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391210.037155:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2359:x1875263094248704:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 17391us (18884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391210.037170:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00002000:00100000:1.0:1788391210.037184:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff95d58aef1180 x1875263094248704/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391210.037194:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef1180 with x1875263094248704 ext(0->1048575) 00002000:00010000:1.0:1788391210.037209:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef1180 00000100:00100000:3.0:1788391210.051599:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.051759:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248832 00000100:00100000:2.0:1788391210.051768:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248832 00002000:00100000:2.0:1788391210.051815:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff95d587d00000 x1875263094248832/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.051823:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00000 with x1875263094248832 ext(1048576->2097151) 00002000:00010000:2.0:1788391210.051827:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00000 00000100:00100000:2.0:1788391210.051881:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:2.0:1788391210.051889:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094248832:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.066795:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094248832:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 14895us (15193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.066810:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00002000:00100000:2.0:1788391210.066824:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff95d587d00000 x1875263094248832/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.066835:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00000 with x1875263094248832 ext(1048576->2097151) 00002000:00010000:2.0:1788391210.066842:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d00000 00000100:00100000:1.0:1788391210.083245:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.083392:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094248960 00000100:00100000:3.0:1788391210.083403:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094248960 00002000:00100000:3.0:1788391210.083453:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff95d58aef0000 x1875263094248960/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.083464:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0000 with x1875263094248960 ext(2097152->3145727) 00002000:00010000:3.0:1788391210.083470:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0000 00000100:00100000:3.0:1788391210.083502:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:3.0:1788391210.083512:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094248960:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391210.091504:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.091568:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249088 00000100:00100000:2.0:1788391210.091578:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249088 00002000:00100000:2.0:1788391210.091623:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff95d58aef2a00 x1875263094249088/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.091635:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2a00 with x1875263094249088 ext(3145728->4194303) 00002000:00010000:2.0:1788391210.091642:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2a00 00000100:00100000:2.0:1788391210.091712:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:2.0:1788391210.091722:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094249088:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.101501:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094248960:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 17978us (18253us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.101514:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00002000:00100000:2.0:1788391210.101527:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff95d58aef0000 x1875263094248960/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.101538:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef0000 with x1875263094248960 ext(2097152->3145727) 00002000:00010000:2.0:1788391210.101544:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef0000 00000100:00100000:2.0:1788391210.118467:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094249088:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 26735us (26959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.118482:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 258 00002000:00100000:2.0:1788391210.118495:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff95d58aef2a00 x1875263094249088/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.118507:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2a00 with x1875263094249088 ext(3145728->4194303) 00002000:00010000:2.0:1788391210.118513:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2a00 00000100:00100000:1.0:1788391210.135571:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.136425:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249216 00000100:00100000:2.0:1788391210.136437:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249216 00002000:00100000:2.0:1788391210.136491:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff95d58aef2680 x1875263094249216/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.136502:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2680 with x1875263094249216 ext(4194304->5242879) 00002000:00010000:2.0:1788391210.136508:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2680 00000100:00100000:2.0:1788391210.136548:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:2.0:1788391210.136558:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094249216:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391210.137410:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.137436:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249344 00000100:00100000:0.0:1788391210.137444:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249344 00002000:00100000:0.0:1788391210.137489:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff95d587d02a00 x1875263094249344/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.137499:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02a00 with x1875263094249344 ext(5242880->6291455) 00002000:00010000:0.0:1788391210.137503:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d02a00 00000100:00100000:0.0:1788391210.137522:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:0.0:1788391210.137531:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2359:x1875263094249344:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391210.138035:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.138477:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249472 00000100:00100000:0.0:1788391210.138483:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249472 00002000:00100000:0.0:1788391210.138509:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff95d58ad30700 x1875263094249472/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.138518:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30700 with x1875263094249472 ext(6291456->7340031) 00002000:00010000:0.0:1788391210.138522:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad30700 00000100:00100000:0.0:1788391210.138537:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:0.0:1788391210.138545:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2358:x1875263094249472:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.139637:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.140107:0:43332:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788391210.140118:0:43332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1788391210.140470:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249600 00000100:00100000:3.0:1788391210.140543:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249600 00002000:00100000:3.0:1788391210.140585:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff95d58b28dc00 x1875263094249600/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.140596:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28dc00 with x1875263094249600 ext(7340032->8388607) 00002000:00010000:3.0:1788391210.140600:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b28dc00 00000100:00100000:1.0:1788391210.140875:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:1.0:1788391210.140892:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2358:x1875263094249600:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.151626:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2358:x1875263094249216:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 15054us (16053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.151641:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00002000:00100000:2.0:1788391210.151654:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff95d58aef2680 x1875263094249216/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.151664:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58aef2680 with x1875263094249216 ext(4194304->5242879) 00002000:00010000:2.0:1788391210.151671:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58aef2680 00000100:00100000:0.0:1788391210.163499:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2359:x1875263094249344:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 25949us (26071us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391210.163512:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00002000:00100000:0.0:1788391210.163526:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff95d587d02a00 x1875263094249344/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.163539:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02a00 with x1875263094249344 ext(5242880->6291455) 00002000:00010000:0.0:1788391210.163547:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587d02a00 00000100:00100000:0.0:1788391210.172161:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2358:x1875263094249472:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 33606us (34119us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391210.172176:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00002000:00100000:0.0:1788391210.172219:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff95d58ad30700 x1875263094249472/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.172229:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30700 with x1875263094249472 ext(6291456->7340031) 00002000:00010000:0.0:1788391210.172236:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad30700 00000100:00100000:0.0:1788391210.181881:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094249600:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 40979us (42236us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391210.181895:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 262 00002000:00100000:0.0:1788391210.181908:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff95d58b28dc00 x1875263094249600/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.181919:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28dc00 with x1875263094249600 ext(7340032->8388607) 00002000:00010000:0.0:1788391210.181925:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b28dc00 00000100:00100000:1.0:1788391210.215213:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391210.215307:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.216754:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.217448:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249728 00000100:00100000:3.0:1788391210.217459:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249728 00002000:00100000:3.0:1788391210.217536:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff95d58ad33100 x1875263094249728/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.217547:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad33100 with x1875263094249728 ext(8388608->9437183) 00002000:00010000:3.0:1788391210.217553:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad33100 00000100:00100000:3.0:1788391210.217588:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249856 00000100:00100000:3.0:1788391210.217607:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249856 00002000:00100000:3.0:1788391210.217627:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff95d58ad30e00 x1875263094249856/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.217634:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30e00 with x1875263094249856 ext(9437184->10485759) 00002000:00010000:3.0:1788391210.217637:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad30e00 00000100:00100000:3.0:1788391210.217657:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00100000:3.0:1788391210.217669:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094249728:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391210.218401:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 264 00000100:00100000:1.0:1788391210.218412:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094249856:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391210.220419:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.220448:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.220470:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.220508:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.220534:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094249984 00000100:00100000:0.0:1788391210.220543:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094249984 00002000:00100000:0.0:1788391210.220608:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff95d58af8ce00 x1875263094249984/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.220688:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8ce00 with x1875263094249984 ext(10485760->11534335) 00000100:00100000:1.0:1788391210.220690:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250112 00002000:00010000:0.0:1788391210.220694:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8ce00 00000100:00100000:1.0:1788391210.220697:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250112 00000100:00100000:0.0:1788391210.220713:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250368 00000100:00100000:0.0:1788391210.220719:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250368 00002000:00100000:1.0:1788391210.220723:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff95d58af8c380 x1875263094250112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391210.220735:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8c380 with x1875263094250112 ext(11534336->12582911) 00002000:00010000:1.0:1788391210.220740:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8c380 00002000:00100000:0.0:1788391210.220742:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff95d58af8c000 x1875263094250368/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788391210.220757:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250240 00000100:00100000:1.0:1788391210.220761:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250240 00002000:00100000:0.0:1788391210.220772:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8c000 with x1875263094250368 ext(13631488->14680063) 00002000:00010000:0.0:1788391210.220776:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8c000 00000100:00100000:0.0:1788391210.220789:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250496 00002000:00100000:1.0:1788391210.220791:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff95d58af8d500 x1875263094250240/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788391210.220793:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250496 00002000:00100000:1.0:1788391210.220803:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8d500 with x1875263094250240 ext(12582912->13631487) 00002000:00010000:1.0:1788391210.220807:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8d500 00002000:00100000:0.0:1788391210.220816:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff95d58af8f480 x1875263094250496/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788391210.220824:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 265 00002000:00100000:0.0:1788391210.220829:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8f480 with x1875263094250496 ext(14680064->15728639) 00002000:00010000:0.0:1788391210.220833:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8f480 00000100:00100000:1.0:1788391210.220840:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2356:x1875263094249984:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391210.220848:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:0.0:1788391210.220858:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2356:x1875263094250112:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.229409:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2356:x1875263094249856:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 10989us (14091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.229423:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 264 00002000:00100000:2.0:1788391210.229437:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff95d58ad30e00 x1875263094249856/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.229448:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30e00 with x1875263094249856 ext(9437184->10485759) 00002000:00010000:2.0:1788391210.229454:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad30e00 00000100:00100000:2.0:1788391210.229485:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:2.0:1788391210.229498:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2356:x1875263094250368:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.241080:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094249728:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 23400us (25873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.241096:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 263 00002000:00100000:2.0:1788391210.241109:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff95d58ad33100 x1875263094249728/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.241121:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad33100 with x1875263094249728 ext(8388608->9437183) 00002000:00010000:2.0:1788391210.241127:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ad33100 00000100:00100000:2.0:1788391210.241157:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 268 00000100:00100000:2.0:1788391210.241169:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2356:x1875263094250240:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.244557:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2356:x1875263094250112:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 23687us (24132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.244574:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 266 00002000:00100000:2.0:1788391210.244588:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff95d58af8c380 x1875263094250112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.244599:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8c380 with x1875263094250112 ext(11534336->12582911) 00002000:00010000:2.0:1788391210.244607:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8c380 00000100:00100000:2.0:1788391210.244638:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 269 00000100:00100000:2.0:1788391210.244650:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2356:x1875263094250496:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.254276:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2356:x1875263094249984:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 33427us (37513us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.254291:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 265 00002000:00100000:2.0:1788391210.254306:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff95d58af8ce00 x1875263094249984/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.254319:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8ce00 with x1875263094249984 ext(10485760->11534335) 00002000:00010000:2.0:1788391210.254326:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8ce00 00000100:00100000:2.0:1788391210.262423:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2356:x1875263094250368:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 32918us (41961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.262438:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 267 00002000:00100000:2.0:1788391210.262451:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff95d58af8c000 x1875263094250368/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.262466:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8c000 with x1875263094250368 ext(13631488->14680063) 00002000:00010000:2.0:1788391210.262527:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8c000 00000100:00100000:2.0:1788391210.269205:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2356:x1875263094250240:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 28026us (48720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.269220:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 268 00002000:00100000:2.0:1788391210.269234:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff95d58af8d500 x1875263094250240/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.269253:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8d500 with x1875263094250240 ext(12582912->13631487) 00002000:00010000:2.0:1788391210.269261:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8d500 00000100:00100000:2.0:1788391210.273295:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094250496:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 28636us (52773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.273307:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 269 00002000:00100000:2.0:1788391210.273317:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff95d58af8f480 x1875263094250496/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.273325:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58af8f480 with x1875263094250496 ext(14680064->15728639) 00002000:00010000:2.0:1788391210.273330:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58af8f480 00000100:00100000:3.0:1788391210.300656:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.300763:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250752 00000100:00100000:0.0:1788391210.300773:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250752 00000100:00100000:0.0:1788391210.300827:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:0.0:1788391210.300834:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:37962:x1875263094250752:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:0.0:1788391210.301090:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37962:x1875263094250752:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 256us (445us total) trans 30064771406 rc 0/0 00000100:00100000:0.0:1788391210.301096:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:1.0:1788391210.357413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.357570:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094250880 00000100:00100000:2.0:1788391210.357580:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094250880 00000100:00100000:2.0:1788391210.357642:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 379 00000100:00100000:2.0:1788391210.357652:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:37968:x1875263094250880:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391210.357677:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391210.357697:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd37df7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc002fd expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357764:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357777:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357788:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357803:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357810:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357816:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357916:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357926:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.357934:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391210.357983:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00000004:00200000:2.0:1788391210.357988:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391210.358010:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358021:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358028:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358034:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358040:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358045:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.358049:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358056:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358068:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391210.358070:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.358076:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358086:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37dfe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358105:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358111:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358117:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358122:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.358124:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358130:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358136:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391210.358138:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.358141:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358146:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e05 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358175:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd37df7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002fd expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358192:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002fd expref: 46 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.358199:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391210.358202:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391210.358204:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9c00, rc 0) 00000100:00100000:2.0:1788391210.358266:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:37968:x1875263094250880:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 615us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391210.358273:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 379 00000100:00100000:2.0:1788391210.363120:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.363685:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251136 00000100:00100000:0.0:1788391210.363696:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251136 00000100:00100000:0.0:1788391210.363799:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 380 00000100:00100000:0.0:1788391210.363811:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:37968:x1875263094251136:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391210.363832:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391210.363851:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd37e13 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00304 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.364004:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.364019:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.364029:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391210.364039:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00010000:00010000:0.0:1788391210.364158:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd37e13 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 49 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.364177:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.364185:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391210.364188:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391210.364192:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176000, rc 0) 00000100:00100000:0.0:1788391210.364270:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37968:x1875263094251136:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 462us (1162us total) trans 30064771407 rc 0/0 00000100:00100000:0.0:1788391210.364277:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 380 00000100:00100000:3.0:1788391210.368468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.368789:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251520 00000100:00100000:2.0:1788391210.368799:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251520 00000100:00100000:2.0:1788391210.368859:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 381 00000100:00100000:2.0:1788391210.368869:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37968:x1875263094251520:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391210.368896:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391210.368899:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788391210.368925:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4c1fa00/0x9aafc5f04cd37d9c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002da expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.368951:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd37e0c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc002fd expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.368993:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391210.368998:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391210.369014:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd37e28 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0030b expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369058:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369070:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369079:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369092:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369098:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369104:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369109:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.369113:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369119:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369126:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391210.369129:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391210.369133:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369139:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd37e2f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369161:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369171:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 47 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369180:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369209:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 47 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.369222:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 47 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391210.369236:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103482496:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391210.369358:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788391210.372061:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.372115:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251264 00000100:00100000:0.0:1788391210.372126:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251264 00010000:00010000:0.0:1788391210.372169:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 48 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391210.372250:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:0.0:1788391210.372276:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2356:x1875263094251264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391210.372291:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391210.372309:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 48 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372323:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 48 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372354:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391210.372360:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372370:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372377:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372397:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391210.372457:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2356:x1875263094251264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391210.372464:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00010000:00010000:0.0:1788391210.372980:0:42646:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.1@tcp) returned -22 from blocking AST (req@000000005c60a1fd x1875263103482496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 1/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 47 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.372997:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd37e1a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00304 expref: 47 pid: 42644 timeout: 1127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391210.373024:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103482496:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391210.373040:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391210.373046:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373054:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373059:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373384:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0030b expref: 48 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373392:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391210.373394:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391210.373407:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd37e28 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0030b expref: 48 pid: 42646 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373426:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8a00/0x9aafc5f04cd37e36 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0030b expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.373453:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:0.0:1788391210.373455:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391210.373458:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8a00, rc 0) 00000100:00100000:0.0:1788391210.373505:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:37968:x1875263094251520:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 4636us (5047us total) trans 30064771408 rc 0/0 00000100:00100000:0.0:1788391210.373522:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 381 00000100:00100000:2.0:1788391210.388118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.388204:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251648 00000100:00100000:0.0:1788391210.388215:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251648 00002000:00100000:0.0:1788391210.388275:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff95d58b28c700 x1875263094251648/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.388283:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28c700 with x1875263094251648 ext(0->1048575) 00002000:00010000:0.0:1788391210.388288:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b28c700 00000100:00100000:0.0:1788391210.388388:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 270 00000100:00100000:0.0:1788391210.388400:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2358:x1875263094251648:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391210.398360:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2358:x1875263094251648:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 9940us (10229us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391210.398374:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 270 00002000:00100000:0.0:1788391210.398387:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff95d58b28c700 x1875263094251648/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.398398:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b28c700 with x1875263094251648 ext(0->1048575) 00002000:00010000:0.0:1788391210.398404:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b28c700 00000100:00100000:3.0:1788391210.414215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.415082:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251776 00000100:00100000:2.0:1788391210.415091:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251776 00002000:00100000:2.0:1788391210.415133:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff95d587d03b80 x1875263094251776/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.415141:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03b80 with x1875263094251776 ext(1048576->2097151) 00002000:00010000:2.0:1788391210.415146:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d03b80 00000100:00100000:2.0:1788391210.415173:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:2.0:1788391210.415184:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094251776:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.428021:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094251776:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 12828us (13815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.428035:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 271 00002000:00100000:2.0:1788391210.428047:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff95d587d03b80 x1875263094251776/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.428058:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03b80 with x1875263094251776 ext(1048576->2097151) 00002000:00010000:2.0:1788391210.428065:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d03b80 00000100:00100000:3.0:1788391210.440475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.440542:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094251904 00000100:00100000:2.0:1788391210.440551:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094251904 00002000:00100000:2.0:1788391210.440602:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff95d587d02d80 x1875263094251904/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.440614:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02d80 with x1875263094251904 ext(2097152->3145727) 00002000:00010000:2.0:1788391210.440620:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d02d80 00000100:00100000:2.0:1788391210.440707:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 272 00000100:00100000:2.0:1788391210.440729:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094251904:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391210.441744:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.442109:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252032 00000100:00100000:0.0:1788391210.442116:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252032 00002000:00100000:0.0:1788391210.442151:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff95d587d00a80 x1875263094252032/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.442161:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00a80 with x1875263094252032 ext(3145728->4194303) 00002000:00010000:0.0:1788391210.442166:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d00a80 00000100:00100000:0.0:1788391210.442237:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:0.0:1788391210.442248:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2357:x1875263094252032:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.456178:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2357:x1875263094251904:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 15450us (15699us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.456192:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 272 00002000:00100000:2.0:1788391210.456206:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff95d587d02d80 x1875263094251904/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.456217:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d02d80 with x1875263094251904 ext(2097152->3145727) 00002000:00010000:2.0:1788391210.456223:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d02d80 00000100:00100000:0.0:1788391210.456951:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094252032:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 14703us (15207us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391210.457031:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 273 00002000:00100000:0.0:1788391210.457038:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff95d587d00a80 x1875263094252032/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391210.457044:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00a80 with x1875263094252032 ext(3145728->4194303) 00002000:00010000:0.0:1788391210.457047:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d00a80 00000100:00100000:1.0:1788391210.479843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.480128:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252160 00000100:00100000:2.0:1788391210.480140:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252160 00002000:00100000:2.0:1788391210.480196:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff95d58ad30000 x1875263094252160/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.480208:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30000 with x1875263094252160 ext(4194304->5242879) 00002000:00010000:2.0:1788391210.480215:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ad30000 00000100:00100000:2.0:1788391210.480254:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 274 00000100:00100000:2.0:1788391210.480267:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094252160:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391210.481377:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.481421:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391210.484298:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252288 00000100:00100000:1.0:1788391210.484312:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252288 00002000:00100000:1.0:1788391210.484374:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff95d587d00700 x1875263094252288/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391210.484468:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00700 with x1875263094252288 ext(5242880->6291455) 00002000:00010000:1.0:1788391210.484474:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d00700 00000100:00100000:1.0:1788391210.484504:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252416 00000100:00100000:1.0:1788391210.484508:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252416 00002000:00100000:1.0:1788391210.484530:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff95d587d03100 x1875263094252416/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391210.484538:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03100 with x1875263094252416 ext(6291456->7340031) 00002000:00010000:1.0:1788391210.484541:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d03100 00000100:00100000:1.0:1788391210.484560:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:1.0:1788391210.484570:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2356:x1875263094252288:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.485396:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:2.0:1788391210.485407:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2357:x1875263094252416:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391210.486075:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.486100:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252544 00000100:00100000:3.0:1788391210.486106:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252544 00002000:00100000:3.0:1788391210.486133:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff95d69111a680 x1875263094252544/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/0 e 0 to 0 dl 1788391221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.486143:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111a680 with x1875263094252544 ext(7340032->8388607) 00002000:00010000:3.0:1788391210.486148:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111a680 00000100:00100000:3.0:1788391210.486160:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:3.0:1788391210.486168:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2357:x1875263094252544:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391210.497139:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2357:x1875263094252160:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 16863us (17294us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.497153:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 274 00002000:00100000:2.0:1788391210.497166:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff95d58ad30000 x1875263094252160/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.497177:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ad30000 with x1875263094252160 ext(4194304->5242879) 00002000:00010000:2.0:1788391210.497184:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58ad30000 00000100:00100000:2.0:1788391210.497726:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2356:x1875263094252288:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 13155us (16350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391210.497734:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 275 00002000:00100000:2.0:1788391210.497741:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff95d587d00700 x1875263094252288/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391210.497750:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d00700 with x1875263094252288 ext(5242880->6291455) 00002000:00010000:2.0:1788391210.497754:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d00700 00000100:00100000:3.0:1788391210.503171:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2357:x1875263094252416:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 17752us (21735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391210.503198:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 276 00002000:00100000:3.0:1788391210.503212:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff95d587d03100 x1875263094252416/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.503224:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587d03100 with x1875263094252416 ext(6291456->7340031) 00002000:00010000:3.0:1788391210.503232:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587d03100 00000100:00100000:3.0:1788391210.508126:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094252544:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 21947us (22041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391210.508141:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 277 00002000:00100000:3.0:1788391210.508156:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff95d69111a680 x1875263094252544/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:71/0 lens 488/440 e 0 to 0 dl 1788391221 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391210.508168:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69111a680 with x1875263094252544 ext(7340032->8388607) 00002000:00010000:3.0:1788391210.508175:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69111a680 00000100:00100000:0.0:1788391210.528507:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.528595:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094252800 00000100:00100000:3.0:1788391210.528604:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094252800 00000100:00100000:3.0:1788391210.529122:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788391210.529133:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:37968:x1875263094252800:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:2.0:1788391210.531389:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37968:x1875263094252800:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 2251us (2881us total) trans 30064771409 rc 0/0 00000100:00100000:2.0:1788391210.531401:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391210.583815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.584011:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253056 00000100:00100000:2.0:1788391210.584021:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253056 00000100:00100000:2.0:1788391210.584072:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 382 00000100:00100000:2.0:1788391210.584084:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:37978:x1875263094253056:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391210.584107:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391210.584126:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00312 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391210.584225:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:2.0:1788391210.584351:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00312 expref: 50 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.584366:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391210.584369:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391210.584375:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00312 expref: 50 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.584393:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b130400, rc 0) 00000100:00100000:2.0:1788391210.584460:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:37978:x1875263094253056:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 378us (655us total) trans 30064771410 rc 301/301 00000100:00100000:2.0:1788391210.584468:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 382 00000100:00100000:0.0:1788391210.586687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.587040:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253184 00000100:00100000:2.0:1788391210.587049:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253184 00000100:00100000:2.0:1788391210.587117:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 383 00000100:00100000:2.0:1788391210.587125:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:37978:x1875263094253184:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391210.587182:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587195:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587206:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587220:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587227:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587233:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587318:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587326:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587333:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391210.587381:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587391:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587402:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587408:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587415:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.587419:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587426:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587438:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391210.587441:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.587445:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587451:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e4b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587467:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587473:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587479:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587484:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.587487:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587493:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587500:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391210.587502:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.587505:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587510:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e52 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587524:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587531:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587537:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587542:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.587544:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587550:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587558:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:2.0:1788391210.587560:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.587564:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.587570:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e59 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391210.587639:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:37978:x1875263094253184:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 513us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391210.587647:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 383 00000100:00100000:1.0:1788391210.590428:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391210.590530:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253440 00000100:00100000:3.0:1788391210.590538:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253440 00000100:00100000:3.0:1788391210.590581:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391210.590591:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:37978:x1875263094253440:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391210.590794:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:37978:x1875263094253440:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 204us (372us total) trans 30064771411 rc 0/0 00000100:00100000:3.0:1788391210.590806:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:1.0:1788391210.663855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.664005:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253696 00000100:00100000:2.0:1788391210.664016:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253696 00000100:00100000:2.0:1788391210.664071:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 384 00000100:00100000:2.0:1788391210.664082:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:37988:x1875263094253696:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391210.664108:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391210.664127:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00319 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.664325:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e67 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.664365:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e67 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.664376:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e67 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391210.664428:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:2.0:1788391210.664533:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00319 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.664615:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131000/0x9aafc5f04cd37e67 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00319 expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.664625:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391210.664628:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391210.664632:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131000, rc 0) 00000100:00100000:2.0:1788391210.664695:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37988:x1875263094253696:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 615us (849us total) trans 30064771412 rc 0/0 00000100:00100000:2.0:1788391210.664701:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 384 00000100:00100000:0.0:1788391210.668393:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391210.668443:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253824 00000100:00100000:2.0:1788391210.668453:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253824 00000100:00100000:2.0:1788391210.668511:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 385 00000100:00100000:2.0:1788391210.668522:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37988:x1875263094253824:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391210.668609:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668625:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668636:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668651:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668658:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668678:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.668994:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669005:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669012:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391210.669050:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669063:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669069:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669075:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669080:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.669084:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669091:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669103:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:2.0:1788391210.669106:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.669110:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669116:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131a00/0x9aafc5f04cd37e75 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669133:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669139:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669145:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669150:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.669152:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669158:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669165:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391210.669167:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.669170:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669175:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37e7c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669190:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669197:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669203:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669208:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391210.669211:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669217:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669224:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff95d6a704c800) 00010000:00010000:2.0:1788391210.669226:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391210.669229:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391210.669235:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37e83 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391210.669457:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37988:x1875263094253824:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 935us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391210.669464:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 385 00000100:00100000:1.0:1788391210.725799:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.725905:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094253952 00000100:00100000:0.0:1788391210.725915:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094253952 00000100:00100000:0.0:1788391210.726002:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 386 00000100:00100000:0.0:1788391210.726014:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:37994:x1875263094253952:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391210.726034:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391210.726054:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37e8a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00320 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726118:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726132:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726141:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726166:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726171:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726175:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726268:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726276:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726283:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391210.726314:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:0.0:1788391210.726319:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391210.726347:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726359:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726368:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726374:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726392:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726398:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391210.726402:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726410:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726424:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff95d6830d2900) 00010000:00010000:0.0:1788391210.726427:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391210.726432:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726438:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37e91 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726452:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726458:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726465:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726470:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391210.726473:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726491:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726500:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff95d6a704cd00) 00010000:00010000:0.0:1788391210.726502:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391210.726504:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726510:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37e98 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726540:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37e8a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00320 expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726553:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93400/0x9aafc5f04cd37e9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00320 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.726559:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391210.726561:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391210.726564:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93400, rc 0) 00000100:00100000:0.0:1788391210.726628:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37994:x1875263094253952:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 617us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391210.726636:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 386 00000100:00100000:1.0:1788391210.729878:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.729976:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254208 00000100:00100000:0.0:1788391210.729986:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254208 00000100:00100000:0.0:1788391210.730041:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 387 00000100:00100000:0.0:1788391210.730050:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:37994:x1875263094254208:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391210.730079:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391210.730093:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ea6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00327 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.730169:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ead lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.730179:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ead lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.730186:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ead lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391210.730193:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:0.0:1788391210.730387:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ea6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00327 expref: 56 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.730405:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ead lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00327 expref: 55 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391210.730413:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:0.0:1788391210.730416:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391210.730419:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93800, rc 0) 00000100:00100000:0.0:1788391210.730513:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:37994:x1875263094254208:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 463us (641us total) trans 30064771413 rc 0/0 00000100:00100000:0.0:1788391210.730521:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 387 00000100:00100000:2.0:1788391210.732809:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391210.735839:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254464 00000100:00100000:0.0:1788391210.735855:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254464 00000100:00100000:2.0:1788391210.735945:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391210.736121:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254592 00000100:00100000:1.0:1788391210.736126:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254592 00000100:00100000:1.0:1788391210.736219:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1788391210.736230:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094254592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391210.736244:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391210.736266:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ead lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00327 expref: 56 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391210.736285:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff95d6a704c500) 00010000:00010000:1.0:1788391210.736354:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391210.736422:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788391210.736440:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:37994:x1875263094254464:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391210.736467:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2359:x1875263094254592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 236us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391210.736475:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1788391210.736752:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:37994:x1875263094254464:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 314us (3951us total) trans 30064771414 rc 0/0 00000100:00100000:0.0:1788391210.736760:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000004:00080000:0.0:1788391210.957557:0:42667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028064593690ns, next at 1029064591265ns, rc = 0 00000100:00100000:1.0:1788391210.957638:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103482624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391210.957718:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391210.957860:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482624 00000100:00100000:3.0:1788391210.957869:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482624 00000100:00100000:3.0:1788391210.957941:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788391210.957951:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103482624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391210.958002:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 204406784 pending 25559040 free 3804233728 avail 3802136576 00000100:00100000:3.0:1788391210.958055:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103482624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391210.958062:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391210.958285:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103482624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391210.958448:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391211.640507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640602:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391211.640623:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254976 00000100:00100000:2.0:1788391211.640631:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254976 00000100:00100000:2.0:1788391211.640670:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255104 00000100:00100000:2.0:1788391211.640671:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255104 00000100:00100000:2.0:1788391211.640684:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788391211.640691:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094254976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391211.640754:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2358:x1875263094254976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391211.640761:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1788391211.640778:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391211.640784:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2358:x1875263094255104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391211.640806:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2358:x1875263094255104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391211.640812:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1788391211.640829:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255232 00000100:00100000:2.0:1788391211.640832:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255232 00000100:00100000:2.0:1788391211.640857:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788391211.640864:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094255232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391211.640891:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094255232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391211.640897:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1788391211.640907:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254848 00000100:00100000:2.0:1788391211.640910:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254848 00000100:00100000:2.0:1788391211.640933:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1788391211.640938:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2358:x1875263094254848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391211.640986:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2358:x1875263094254848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391211.640993:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1788391211.641017:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255360 00000100:00100000:2.0:1788391211.641020:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255360 00002000:00100000:2.0:1788391211.641046:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff95d58cb19c00 x1875263094255360/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:72/0 lens 488/0 e 0 to 0 dl 1788391222 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391211.641057:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19c00 with x1875263094255360 ext(42811392->42991615) 00002000:00010000:2.0:1788391211.641063:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb19c00 00000100:00100000:2.0:1788391211.641077:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 278 00000100:00100000:2.0:1788391211.641082:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2359:x1875263094255360:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391211.641629:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094254720 00000100:00100000:3.0:1788391211.641636:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094254720 00000100:00080000:2.0:1788391211.641663:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391211.641668:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391211.641670:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391211.641695:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1788391211.641705:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094254720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391211.641742:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094254720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391211.642721:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:2.0:1788391211.646690:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2359:x1875263094255360:12345-192.168.202.1@tcp:4:dd.0 Request processed in 5595us (6073us total) trans 30064771250 rc 0/0 00000100:00100000:2.0:1788391211.646703:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 278 00002000:00100000:2.0:1788391211.646717:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff95d58cb19c00 x1875263094255360/t30064771250(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:72/0 lens 488/448 e 0 to 0 dl 1788391222 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391211.646728:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58cb19c00 with x1875263094255360 ext(42811392->42991615) 00002000:00010000:2.0:1788391211.646735:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58cb19c00 00000040:00080000:3.0:1788391211.789249:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391211.789258:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391211.789914:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 7 00000040:00080000:3.0:1788391211.789921:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391211.981136:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391213.005142:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391213.055083:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000001:00080000:1.0:1788391213.055105:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771414 is committed 00000004:00080000:1.0:1788391213.055143:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000004:00080000:1.0:1788391213.055164:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:1.0:1788391213.055206:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803910 batchid updated 00000020:00080000:1.0:1788391213.055365:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000020:00080000:1.0:1788391213.055381:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000100:00100000:1.0:1788391213.055389:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391213.055408:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103482752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788391213.055474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391213.055545:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482752 00000100:00100000:1.0:1788391213.055552:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482752 00000100:00100000:1.0:1788391213.055609:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788391213.055619:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103482752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788391213.055818:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1788391213.055822:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 1788391210 -> 1788391210 00002000:00010000:1.0:1788391213.055825:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391213.055828:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 1788391210 -> 1788391210 00002000:00010000:1.0:1788391213.055830:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:1.0:1788391213.055868:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103482752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (393us total) trans 30064771251 rc 0/0 00000100:00100000:1.0:1788391213.055891:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000004:00080000:1.0:1788391213.055937:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58ad32d80/2, rc 0, transno 30064771251 00000100:00100000:1.0:1788391213.055943:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103482752:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788391213.056724:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391213.058880:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58af8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103482880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788391213.058949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391213.059185:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103482880 00000100:00100000:0.0:1788391213.059193:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103482880 00000100:00100000:0.0:1788391213.059392:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788391213.059402:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103482880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788391213.059550:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1788391213.059554:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 1788391209 -> 1788391209 00002000:00010000:0.0:1788391213.059557:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391213.059559:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 1788391210 -> 1788391210 00002000:00010000:0.0:1788391213.059562:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391213.059715:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103482880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (766us total) trans 30064771182 rc 0/0 00000100:00100000:0.0:1788391213.059723:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000004:00080000:1.0:1788391213.059785:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58af8ca80/2, rc 0, transno 30064771182 00000100:00100000:1.0:1788391213.059792:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58af8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103482880:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788391213.059864:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788391213.083827:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771249 is committed 00000001:00080000:1.0:1788391213.083871:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771250 is committed 00000100:00100000:1.0:1788391214.007606:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391214.007712:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255488 00000100:00100000:2.0:1788391214.007722:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255488 00000100:00100000:2.0:1788391214.007805:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 388 00000100:00100000:2.0:1788391214.007817:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37937:x1875263094255488:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788391214.007924:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37937:x1875263094255488:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391214.007931:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 388 00000100:00080000:3.0:1788391214.008339:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391214.012331:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391214.012442:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255744 00000100:00100000:1.0:1788391214.012454:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255744 00000100:00100000:1.0:1788391214.012561:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:1.0:1788391214.012572:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:37937:x1875263094255744:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391214.012870:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:37937:x1875263094255744:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 299us (565us total) trans 30064771415 rc 0/0 00000100:00100000:1.0:1788391214.012878:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00010000:00010000:0.0:1788391214.032564:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391214.109369:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771182 is committed 00000001:00080000:1.0:1788391214.109384:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771170 is committed 00000001:00080000:1.0:1788391214.109584:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771181 is committed 00000100:00100000:1.0:1788391214.215654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391214.216439:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094255872 00000100:00100000:2.0:1788391214.216451:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094255872 00000100:00100000:2.0:1788391214.216597:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 389 00000100:00100000:2.0:1788391214.216608:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:38434:x1875263094255872:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788391214.216629:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391214.216649:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0032e expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216716:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216730:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216741:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391214.216775:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391214.216778:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391214.216797:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216821:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 7 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216843:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 6 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391214.216851:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391214.216854:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391214.216858:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131400, rc 0) 00000100:00100000:2.0:1788391214.216921:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+6:38434:x1875263094255872:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 314us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391214.216927:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 389 00000100:00080000:3.0:1788391214.217051:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391215.053253:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391215.053279:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103483008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391215.053360:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391215.053474:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483008 00000100:00100000:3.0:1788391215.053483:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483008 00000100:00100000:0.0:1788391215.053493:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788391215.053548:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391215.053557:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788391215.053566:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788391215.053573:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103483008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391215.053607:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788391215.053632:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 284491776 pending 0 free 3733979136 avail 3731881984 00000100:00100000:0.0:1788391215.053640:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103483136:0@lo:400:kworker.0 00000100:00100000:1.0:1788391215.053652:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483264 00000100:00100000:1.0:1788391215.053658:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483264 00000100:00100000:3.0:1788391215.053688:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103483008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391215.053695:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391215.053701:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788391215.053713:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788391215.053733:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103483264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391215.053759:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483136 00000100:00100000:0.0:1788391215.053764:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483136 00000100:00100000:1.0:1788391215.053799:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103483264:12345-0@lo:400:kworker.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391215.053809:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788391215.053816:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788391215.053826:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103483136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788391215.053835:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391215.053842:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771182 gen 2 00000004:00080000:3.0:1788391215.053849:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58af8ca80, transno 30064771182 00000100:00100000:3.0:1788391215.053862:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103483264:0@lo:400:kworker.0 00000100:00100000:1.0:1788391215.053870:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103483008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391215.053870:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103483136:12345-0@lo:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391215.053878:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103483136:0@lo:400:kworker.0 00000100:00100000:0.0:1788391215.053885:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788391215.055558:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103483520:0@lo:400:kworker.0 00000100:00100000:0.0:1788391215.055558:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103483392:0@lo:400:kworker.0 00000100:00100000:3.0:1788391215.055600:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391215.055615:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103483648:0@lo:400:kworker.0 00000100:00100000:0.0:1788391215.055632:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391215.055667:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483392 00000100:00100000:1.0:1788391215.055676:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483392 00000100:00100000:2.0:1788391215.055739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391215.055773:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483520 00000100:00100000:1.0:1788391215.055778:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483520 00000100:00100000:2.0:1788391215.055805:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788391215.055815:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103483392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391215.055856:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103483392:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391215.055868:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103483392:0@lo:400:kworker.0 00000100:00080000:0.0:1788391215.055892:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391215.057235:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391215.057276:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483648 00000100:00100000:3.0:1788391215.057280:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483648 00000100:00100000:1.0:1788391215.057403:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788391215.057414:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103483520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391215.057452:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788391215.057488:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103483520:12345-0@lo:400:kworker.0 Request processed in 77us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391215.057510:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1788391215.057530:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788391215.057540:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391215.057540:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103483520:0@lo:400:kworker.0 00000100:00100000:3.0:1788391215.057688:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788391215.057698:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391215.057745:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103483648:12345-0@lo:400:kworker.0 Request processed in 50us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391215.057752:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788391215.057819:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103483648:0@lo:400:kworker.0 00000100:00100000:2.0:1788391216.077929:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391216.077983:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103483776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391216.078097:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391216.078238:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103483776 00000100:00100000:0.0:1788391216.078249:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103483776 00000100:00100000:0.0:1788391216.078331:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788391216.078343:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103483776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391216.078387:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 178847744 pending 0 free 3788505088 avail 3786407936 00000100:00100000:0.0:1788391216.078440:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103483776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391216.078447:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788391216.078601:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103483776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391216.079411:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391216.207074:0:46452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 19:20:15 (1788391215) 00000100:00100000:2.0:1788391216.757513:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391216.757623:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391216.757659:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391216.757691:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391216.757745:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391216.757778:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256512 00000100:00100000:2.0:1788391216.757790:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256512 00000100:00100000:2.0:1788391216.757867:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256128 00000100:00100000:2.0:1788391216.757870:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256128 00000100:00100000:2.0:1788391216.757896:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391216.757909:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2358:x1875263094256512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391216.758068:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2358:x1875263094256512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 161us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391216.758077:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1788391216.758098:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391216.758106:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2358:x1875263094256128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391216.758322:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2358:x1875263094256128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 216us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391216.758330:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:2.0:1788391216.758354:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256256 00000100:00100000:2.0:1788391216.758358:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256256 00000100:00100000:2.0:1788391216.758388:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256384 00000100:00100000:2.0:1788391216.758391:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256384 00000100:00100000:2.0:1788391216.758412:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788391216.758419:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2358:x1875263094256256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391216.758449:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:2358:x1875263094256256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391216.758455:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1788391216.758467:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1788391216.758473:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094256384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391216.758501:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094256384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391216.758508:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00080000:2.0:1788391216.758526:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391216.758531:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391216.758534:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391216.759849:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256000 00000100:00100000:0.0:1788391216.759864:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256000 00000100:00100000:0.0:1788391216.759986:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788391216.760014:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094256000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391216.760088:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094256000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391216.760114:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00010000:00010000:2.0:1788391217.101136:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391217.274261:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.274346:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256768 00000100:00100000:0.0:1788391217.274355:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256768 00000100:00100000:0.0:1788391217.274418:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 390 00000100:00100000:0.0:1788391217.274430:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:38717:x1875263094256768:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391217.274452:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391217.274474:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ec9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00335 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274548:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274568:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274579:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274594:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274601:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274608:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274930:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37ede lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274952:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37ede lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.274987:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37ede lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391217.274996:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788391217.275065:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275070:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275075:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275078:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391217.275081:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275086:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275102:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:0.0:1788391217.275106:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.275110:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275116:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37ed0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275128:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275140:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275146:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275150:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391217.275153:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275157:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275162:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a704cd00) 00010000:00010000:0.0:1788391217.275164:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.275166:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275169:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37ed7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275666:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ec9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00335 expref: 39 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275680:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37ede lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00335 expref: 38 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.275685:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391217.275687:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.275694:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93c00, rc 0) 00000100:00100000:0.0:1788391217.275760:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:38717:x1875263094256768:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1332us (1508us total) trans 30064771416 rc 0/0 00000100:00100000:0.0:1788391217.275769:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 390 00000100:00100000:3.0:1788391217.278206:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.278309:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.278313:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094256896 00000100:00100000:2.0:1788391217.278327:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094256896 00000100:00100000:0.0:1788391217.278434:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1788391217.278452:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2356:x1875263094256896:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391217.278468:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391217.278492:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd37ede lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00335 expref: 38 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.278510:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391217.278514:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391217.278576:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2356:x1875263094256896:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391217.278583:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1788391217.279823:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257024 00000100:00100000:1.0:1788391217.279838:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257024 00000100:00100000:1.0:1788391217.279954:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 391 00000100:00100000:1.0:1788391217.279984:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:38717:x1875263094257024:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788391217.280115:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:38717:x1875263094257024:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 151us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391217.280123:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 391 00000100:00100000:3.0:1788391217.360203:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.360327:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257280 00000100:00100000:2.0:1788391217.360351:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257280 00000100:00100000:2.0:1788391217.360435:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 392 00000100:00100000:2.0:1788391217.360447:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:38732:x1875263094257280:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:2.0:1788391217.360501:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391217.360527:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd37cf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0029b expref: 37 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.360547:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391217.360550:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391217.360845:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.360859:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 5 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.360868:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.360904:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 5 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.360917:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 5 pid: 42646 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391217.360931:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103483904:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391217.361073:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b6405540 going to sleep for 11 seconds 00000100:00100000:0.0:1788391217.362522:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103483904:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391217.362545:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391217.362954:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.363034:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257408 00000100:00100000:2.0:1788391217.363042:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257408 00010000:00010000:2.0:1788391217.363072:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 6 pid: 42646 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391217.363101:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1788391217.363108:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094257408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391217.363118:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391217.363122:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 6 pid: 42646 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363131:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 6 pid: 42646 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363146:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37ec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0032e expref: 6 pid: 42646 timeout: 1134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363161:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391217.363166:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363175:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363182:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.363200:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391217.363247:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094257408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.363254:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00010000:00010000:0.0:1788391217.365565:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.365579:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.365606:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.365631:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.365641:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391217.366668:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:0.0:1788391217.366680:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366687:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366694:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366700:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391217.366704:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366711:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366722:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391217.366724:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.366728:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.366731:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37eec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391217.366752:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cfa31d5 reply state 000000009733341b transno 30064771417 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391217.366758:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391217.366837:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:38732:x1875263094257280:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 6389us (6641us total) trans 30064771417 rc 0/0 00000100:00100000:0.0:1788391217.366844:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 392 00010000:00010000:2.0:1788391217.368212:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368224:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368231:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368245:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.368250:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368257:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368269:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff95d6a704cd00) 00010000:00010000:2.0:1788391217.368273:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.368285:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.368291:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd37ef3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391217.374080:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.374152:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257536 00000100:00100000:0.0:1788391217.374163:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257536 00000100:00100000:0.0:1788391217.374447:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 393 00000100:00100000:0.0:1788391217.374457:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:38733:x1875263094257536:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391217.374477:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391217.374494:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37efa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0033c expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374544:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374553:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374561:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391217.374588:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391217.374590:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391217.374605:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374644:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd37efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0033c expref: 39 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374660:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0033c expref: 38 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.374665:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391217.374667:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391217.374669:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:0.0:1788391217.374719:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:38733:x1875263094257536:12345-192.168.202.1@tcp:101:dd.0 Request processed in 264us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391217.374727:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 393 00000100:00100000:3.0:1788391217.376242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.377888:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257664 00000100:00100000:0.0:1788391217.377901:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257664 00000100:00100000:0.0:1788391217.378003:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 394 00000100:00100000:0.0:1788391217.378016:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:38733:x1875263094257664:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391217.378038:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391217.378060:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37f08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00343 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378127:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378154:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378166:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378200:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378209:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378216:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378321:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd37f1d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378327:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd37f1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378332:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd37f1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391217.378353:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00000004:00200000:0.0:1788391217.378356:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391217.378373:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd37f1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378384:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378391:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378397:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378413:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391217.378418:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378424:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378436:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391217.378439:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.378443:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378448:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd37f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378458:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378463:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378469:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378473:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391217.378475:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378480:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378494:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391217.378496:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391217.378499:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378504:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd37f16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378529:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92000/0x9aafc5f04cd37f08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00343 expref: 40 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378540:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93a00/0x9aafc5f04cd37f1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00343 expref: 39 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391217.378546:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:0.0:1788391217.378548:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788391217.378550:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93a00, rc 0) 00000100:00100000:0.0:1788391217.378614:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:38733:x1875263094257664:12345-192.168.202.1@tcp:101:dd.0 Request processed in 598us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391217.378621:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 394 00000100:00100000:2.0:1788391217.385653:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.385828:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094257920 00000100:00100000:1.0:1788391217.385838:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094257920 00000100:00100000:1.0:1788391217.385912:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 395 00000100:00100000:1.0:1788391217.385923:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:38733:x1875263094257920:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391217.385943:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391217.386104:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813dea00/0x9aafc5f04cd37f24 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0034a expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386236:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386250:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386261:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386287:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386295:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.386303:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391217.386846:0:42645:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcb:0x0], index 0: 0 00010000:00010000:1.0:1788391217.387022:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de000/0x9aafc5f04cd37f39 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387032:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de000/0x9aafc5f04cd37f39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387040:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de000/0x9aafc5f04cd37f39 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387080:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387087:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387093:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387099:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813de200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391217.387103:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387109:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387121:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:1.0:1788391217.387124:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391217.387129:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387135:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f2b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391217.387148:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6ec81a5 reply state 000000003b11ed07 transno 30064771418 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391217.387156:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391217.387182:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813dea00/0x9aafc5f04cd37f24 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0034a expref: 42 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387211:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de000/0x9aafc5f04cd37f39 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0034a expref: 41 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.387219:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391217.387221:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391217.387224:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813de000, rc 0) 00000100:00100000:1.0:1788391217.387300:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:38733:x1875263094257920:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1378us (1658us total) trans 30064771418 rc 0/0 00000100:00100000:1.0:1788391217.387308:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 395 00010000:00010000:2.0:1788391217.389131:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389143:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389150:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389156:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.389160:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389168:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389182:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff95d6a0d29100) 00010000:00010000:2.0:1788391217.389185:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.389189:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.389195:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df800/0x9aafc5f04cd37f32 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391217.396198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.396267:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258048 00000100:00100000:1.0:1788391217.396292:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258048 00000100:00100000:1.0:1788391217.396352:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788391217.396363:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+8:38733:x1875263094258048:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391217.396382:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391217.396403:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fae95ce/0x9aafc5f04cd37f47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00351 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391217.396429:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391217.396450:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=1034s v=(0 0) 00010000:00010000:1.0:1788391217.396455:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391217.396465:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fae95ce/0x9aafc5f04cd37f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00351 expref: 9 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.396480:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fae95ce/0x9aafc5f04cd37f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00351 expref: 9 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.396513:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813dea00, rc 0) 00000100:00100000:1.0:1788391217.396568:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:38733:x1875263094258048:12345-192.168.202.1@tcp:101:dd.0 Request processed in 207us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391217.396577:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1788391217.414133:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.414334:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258176 00000100:00100000:2.0:1788391217.414346:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258176 00002000:00100000:2.0:1788391217.414395:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff95d6bc68dc00 x1875263094258176/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.414406:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68dc00 with x1875263094258176 ext(0->1048575) 00002000:00010000:2.0:1788391217.414412:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68dc00 00000100:00100000:2.0:1788391217.414443:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:2.0:1788391217.414450:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094258176:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.425107:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.425345:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258304 00000100:00100000:0.0:1788391217.425355:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258304 00002000:00100000:0.0:1788391217.425423:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff95d6bc68c700 x1875263094258304/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.425435:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68c700 with x1875263094258304 ext(1048576->2097151) 00002000:00010000:0.0:1788391217.425440:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68c700 00000100:00100000:0.0:1788391217.425531:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 280 00000100:00100000:0.0:1788391217.425555:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094258304:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.425991:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094258176:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11539us (11867us total) trans 30064771183 rc 0/0 00000100:00100000:2.0:1788391217.425998:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 279 00002000:00100000:2.0:1788391217.426004:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff95d6bc68dc00 x1875263094258176/t30064771183(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.426010:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68dc00 with x1875263094258176 ext(0->1048575) 00002000:00010000:2.0:1788391217.426012:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68dc00 00000100:00100000:3.0:1788391217.434808:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094258304:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9248us (9700us total) trans 30064771184 rc 0/0 00000100:00100000:3.0:1788391217.434818:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 280 00002000:00100000:3.0:1788391217.434828:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff95d6bc68c700 x1875263094258304/t30064771184(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.434835:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68c700 with x1875263094258304 ext(1048576->2097151) 00002000:00010000:3.0:1788391217.434844:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68c700 00000100:00100000:1.0:1788391217.443746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.443931:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258432 00000100:00100000:2.0:1788391217.443940:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258432 00002000:00100000:2.0:1788391217.444009:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff95d587136d80 x1875263094258432/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.444018:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587136d80 with x1875263094258432 ext(2097152->3145727) 00002000:00010000:2.0:1788391217.444022:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587136d80 00000100:00100000:2.0:1788391217.444049:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:2.0:1788391217.444056:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094258432:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.453429:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094258432:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9352us (9669us total) trans 30064771185 rc 0/0 00000100:00100000:0.0:1788391217.453443:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00002000:00100000:0.0:1788391217.453457:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff95d587136d80 x1875263094258432/t30064771185(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.453467:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587136d80 with x1875263094258432 ext(2097152->3145727) 00002000:00010000:0.0:1788391217.453472:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587136d80 00000100:00100000:1.0:1788391217.471328:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.471451:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258560 00000100:00100000:2.0:1788391217.471461:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258560 00002000:00100000:2.0:1788391217.471503:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff95d587134a80 x1875263094258560/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.471512:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134a80 with x1875263094258560 ext(3145728->4194303) 00002000:00010000:2.0:1788391217.471516:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587134a80 00000100:00100000:2.0:1788391217.471574:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:2.0:1788391217.471581:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094258560:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.484656:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2358:x1875263094258560:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13063us (13325us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1788391217.484670:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 282 00002000:00100000:2.0:1788391217.484682:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff95d587134a80 x1875263094258560/t30064771186(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.484692:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134a80 with x1875263094258560 ext(3145728->4194303) 00002000:00010000:2.0:1788391217.484698:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587134a80 00000100:00100000:0.0:1788391217.495793:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.495893:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258688 00000100:00100000:2.0:1788391217.495904:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258688 00002000:00100000:2.0:1788391217.495952:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff95d58d2f8700 x1875263094258688/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.495990:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8700 with x1875263094258688 ext(4194304->5242879) 00002000:00010000:2.0:1788391217.495995:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8700 00000100:00100000:2.0:1788391217.496029:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:2.0:1788391217.496040:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094258688:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.507137:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2359:x1875263094258688:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11088us (11343us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1788391217.507152:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 283 00002000:00100000:1.0:1788391217.507164:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff95d58d2f8700 x1875263094258688/t30064771187(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.507175:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f8700 with x1875263094258688 ext(4194304->5242879) 00002000:00010000:1.0:1788391217.507181:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f8700 00000100:00100000:3.0:1788391217.510089:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.510342:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258816 00000100:00100000:0.0:1788391217.510352:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258816 00002000:00100000:0.0:1788391217.510403:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc68e300 x1875263094258816/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.510413:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68e300 with x1875263094258816 ext(5242880->6291455) 00002000:00010000:0.0:1788391217.510418:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68e300 00000100:00100000:0.0:1788391217.510487:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:0.0:1788391217.510498:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094258816:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.519103:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094258816:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8596us (9013us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1788391217.519117:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 284 00002000:00100000:0.0:1788391217.519142:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc68e300 x1875263094258816/t30064771188(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.519153:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68e300 with x1875263094258816 ext(5242880->6291455) 00002000:00010000:0.0:1788391217.519159:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68e300 00000100:00100000:3.0:1788391217.525337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391217.525465:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094258944 00000100:00100000:0.0:1788391217.525475:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094258944 00002000:00100000:0.0:1788391217.525527:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff95d6bc68c380 x1875263094258944/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.525539:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68c380 with x1875263094258944 ext(6291456->7340031) 00002000:00010000:0.0:1788391217.525545:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68c380 00000100:00100000:0.0:1788391217.525618:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:0.0:1788391217.525626:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094258944:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.537353:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094258944:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11715us (12015us total) trans 30064771189 rc 0/0 00000100:00100000:0.0:1788391217.537367:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 285 00002000:00100000:0.0:1788391217.537379:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff95d6bc68c380 x1875263094258944/t30064771189(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.537390:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68c380 with x1875263094258944 ext(6291456->7340031) 00002000:00010000:0.0:1788391217.537396:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68c380 00000100:00100000:2.0:1788391217.549822:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.549884:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259072 00000100:00100000:3.0:1788391217.549894:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259072 00002000:00100000:3.0:1788391217.549945:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff95d58afd5f80 x1875263094259072/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.549995:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd5f80 with x1875263094259072 ext(7340032->8388607) 00002000:00010000:3.0:1788391217.550002:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58afd5f80 00000100:00100000:3.0:1788391217.550088:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:3.0:1788391217.550098:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2357:x1875263094259072:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.563142:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.563359:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259200 00000100:00100000:1.0:1788391217.563368:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259200 00002000:00100000:1.0:1788391217.563415:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff95d58d2f9f80 x1875263094259200/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.563427:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9f80 with x1875263094259200 ext(8388608->9437183) 00002000:00010000:1.0:1788391217.563433:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9f80 00000100:00100000:1.0:1788391217.563502:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:1.0:1788391217.563513:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2356:x1875263094259200:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.563815:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094259072:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13717us (13999us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788391217.563826:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 286 00002000:00100000:2.0:1788391217.563832:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff95d58afd5f80 x1875263094259072/t30064771190(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.563841:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd5f80 with x1875263094259072 ext(7340032->8388607) 00002000:00010000:2.0:1788391217.563844:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58afd5f80 00000100:00100000:1.0:1788391217.574771:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2356:x1875263094259200:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11251us (11630us total) trans 30064771191 rc 0/0 00000100:00100000:1.0:1788391217.574794:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 287 00002000:00100000:1.0:1788391217.574805:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff95d58d2f9f80 x1875263094259200/t30064771191(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.574813:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58d2f9f80 with x1875263094259200 ext(8388608->9437183) 00002000:00010000:1.0:1788391217.574819:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58d2f9f80 00000100:00100000:2.0:1788391217.581053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.581116:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259328 00000100:00100000:1.0:1788391217.581125:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259328 00002000:00100000:1.0:1788391217.581186:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff95d58afd7800 x1875263094259328/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.581205:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd7800 with x1875263094259328 ext(9437184->10485759) 00002000:00010000:1.0:1788391217.581211:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58afd7800 00000100:00100000:1.0:1788391217.581244:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 288 00000100:00100000:1.0:1788391217.581252:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094259328:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.586018:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094259328:12345-192.168.202.1@tcp:4:dd.0 Request processed in 4752us (4960us total) trans 30064771192 rc 0/0 00000100:00100000:1.0:1788391217.586029:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 288 00002000:00100000:1.0:1788391217.586040:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff95d58afd7800 x1875263094259328/t30064771192(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.586048:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd7800 with x1875263094259328 ext(9437184->10485759) 00002000:00010000:1.0:1788391217.586053:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58afd7800 00000100:00100000:0.0:1788391217.593296:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.593389:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259456 00000100:00100000:1.0:1788391217.593401:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259456 00002000:00100000:1.0:1788391217.593557:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff95d5853d2680 x1875263094259456/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.593592:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2680 with x1875263094259456 ext(10485760->11534335) 00002000:00010000:1.0:1788391217.593597:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d2680 00000100:00100000:1.0:1788391217.593629:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:1.0:1788391217.593640:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094259456:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.604394:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2356:x1875263094259456:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10744us (11094us total) trans 30064771193 rc 0/0 00000100:00100000:1.0:1788391217.604409:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 289 00002000:00100000:1.0:1788391217.604423:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff95d5853d2680 x1875263094259456/t30064771193(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.604435:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d2680 with x1875263094259456 ext(10485760->11534335) 00002000:00010000:1.0:1788391217.604442:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d5853d2680 00000100:00100000:3.0:1788391217.605846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.606509:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259584 00000100:00100000:2.0:1788391217.606520:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259584 00002000:00100000:2.0:1788391217.606572:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff95d6bc68ea00 x1875263094259584/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.606582:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ea00 with x1875263094259584 ext(11534336->12582911) 00002000:00010000:2.0:1788391217.606587:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ea00 00000100:00100000:2.0:1788391217.606624:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 290 00000100:00100000:2.0:1788391217.606635:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094259584:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.624537:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.624575:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259712 00000100:00100000:1.0:1788391217.624587:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259712 00002000:00100000:1.0:1788391217.624632:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff95d6bc68ca80 x1875263094259712/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.624643:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ca80 with x1875263094259712 ext(12582912->13631487) 00002000:00010000:1.0:1788391217.624649:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ca80 00000100:00100000:1.0:1788391217.624687:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:1.0:1788391217.624697:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+33:2357:x1875263094259712:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.625645:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2357:x1875263094259584:12345-192.168.202.1@tcp:4:dd.0 Request processed in 19008us (19801us total) trans 30064771194 rc 0/0 00000100:00100000:2.0:1788391217.625654:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 290 00002000:00100000:2.0:1788391217.625662:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff95d6bc68ea00 x1875263094259584/t30064771194(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.625670:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ea00 with x1875263094259584 ext(11534336->12582911) 00002000:00010000:2.0:1788391217.625674:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ea00 00000100:00100000:1.0:1788391217.628842:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.629734:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259840 00000100:00100000:2.0:1788391217.629745:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259840 00002000:00100000:2.0:1788391217.629791:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff95d587137480 x1875263094259840/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.629801:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137480 with x1875263094259840 ext(13631488->14680063) 00002000:00010000:2.0:1788391217.629806:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137480 00000100:00100000:2.0:1788391217.629840:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:2.0:1788391217.629849:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+35:2356:x1875263094259840:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.637212:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2357:x1875263094259712:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12359us (12528us total) trans 30064771195 rc 0/0 00000100:00100000:1.0:1788391217.637245:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00002000:00100000:1.0:1788391217.637260:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff95d6bc68ca80 x1875263094259712/t30064771195(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.637271:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68ca80 with x1875263094259712 ext(12582912->13631487) 00002000:00010000:1.0:1788391217.637287:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc68ca80 00000100:00100000:1.0:1788391217.640686:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.640754:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094259968 00000100:00100000:3.0:1788391217.640765:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094259968 00002000:00100000:3.0:1788391217.640813:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff95d587135c00 x1875263094259968/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.640824:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135c00 with x1875263094259968 ext(14680064->15728639) 00002000:00010000:3.0:1788391217.640839:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587135c00 00000100:00100000:3.0:1788391217.640876:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:3.0:1788391217.640885:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+37:2357:x1875263094259968:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.641429:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.645012:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2356:x1875263094259840:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15154us (16170us total) trans 30064771196 rc 0/0 00000100:00100000:2.0:1788391217.645025:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 292 00002000:00100000:2.0:1788391217.645037:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff95d587137480 x1875263094259840/t30064771196(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.645045:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137480 with x1875263094259840 ext(13631488->14680063) 00002000:00010000:2.0:1788391217.645050:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137480 00000100:00100000:1.0:1788391217.647945:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260224 00000100:00100000:1.0:1788391217.647972:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260224 00000100:00100000:1.0:1788391217.648024:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:1.0:1788391217.648034:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:38733:x1875263094260224:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:1.0:1788391217.648377:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:38733:x1875263094260224:12345-192.168.202.1@tcp:35:dd.0 Request processed in 342us (6947us total) trans 30064771419 rc 0/0 00000100:00100000:1.0:1788391217.648385:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391217.649760:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094259968:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8870us (9077us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1788391217.649771:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 293 00002000:00100000:2.0:1788391217.649780:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff95d587135c00 x1875263094259968/t30064771197(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.649789:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135c00 with x1875263094259968 ext(14680064->15728639) 00002000:00010000:2.0:1788391217.649794:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587135c00 00000100:00100000:3.0:1788391217.662509:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.662582:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260480 00000100:00100000:2.0:1788391217.662593:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260480 00000100:00100000:2.0:1788391217.662655:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 396 00000100:00100000:2.0:1788391217.662667:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:38734:x1875263094260480:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391217.662693:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.662714:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37f4e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00358 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663024:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663036:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663044:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663054:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663058:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663062:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391217.663451:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcb:0x0], index 1: 0 00010000:00010000:2.0:1788391217.663568:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37f63 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663574:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37f63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663579:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37f63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663604:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663609:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663613:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663616:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.663619:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663623:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663631:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:2.0:1788391217.663632:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.663635:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663639:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130000/0x9aafc5f04cd37f55 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391217.663648:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003df981d0 reply state 00000000f76374b6 transno 30064771420 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391217.663654:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788391217.663673:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131200/0x9aafc5f04cd37f4e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00358 expref: 45 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663688:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37f63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00358 expref: 44 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.663696:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391217.663698:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391217.663701:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131e00, rc 0) 00000100:00100000:2.0:1788391217.663765:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:38734:x1875263094260480:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1100us (1266us total) trans 30064771420 rc 0/0 00000100:00100000:2.0:1788391217.663773:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 396 00010000:00010000:2.0:1788391217.668426:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668448:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668455:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668460:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.668464:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668471:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668488:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff95d6830d2c00) 00010000:00010000:2.0:1788391217.668490:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.668495:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.668501:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131600/0x9aafc5f04cd37f5c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391217.678028:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.678075:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260608 00000100:00100000:2.0:1788391217.678086:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260608 00000100:00100000:2.0:1788391217.678148:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:2.0:1788391217.678158:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:38734:x1875263094260608:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391217.678175:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.678197:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d449cbc/0x9aafc5f04cd37f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0035f expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391217.678305:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391217.678327:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=1034s v=(0 0) 00010000:00010000:2.0:1788391217.678332:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391217.678341:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d449cbc/0x9aafc5f04cd37f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0035f expref: 12 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.678358:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d449cbc/0x9aafc5f04cd37f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0035f expref: 12 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.678371:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131200, rc 0) 00000100:00100000:2.0:1788391217.678437:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:38734:x1875263094260608:12345-192.168.202.1@tcp:101:dd.0 Request processed in 280us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.678444:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1788391217.692130:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.692344:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260736 00000100:00100000:2.0:1788391217.692354:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260736 00002000:00100000:2.0:1788391217.692402:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff95d685279f80 x1875263094260736/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.692411:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279f80 with x1875263094260736 ext(0->1048575) 00002000:00010000:2.0:1788391217.692417:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685279f80 00000100:00100000:2.0:1788391217.692454:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:2.0:1788391217.692463:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094260736:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.700815:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.701014:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260864 00000100:00100000:1.0:1788391217.701022:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260864 00002000:00100000:1.0:1788391217.701061:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff95d68527bb80 x1875263094260864/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.701069:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527bb80 with x1875263094260864 ext(1048576->2097151) 00002000:00010000:1.0:1788391217.701073:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527bb80 00000100:00100000:1.0:1788391217.701104:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:1.0:1788391217.701114:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094260864:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.702230:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094260736:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9762us (10104us total) trans 30064771252 rc 0/0 00000100:00100000:2.0:1788391217.702240:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 294 00002000:00100000:2.0:1788391217.702249:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff95d685279f80 x1875263094260736/t30064771252(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.702259:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685279f80 with x1875263094260736 ext(0->1048575) 00002000:00010000:2.0:1788391217.702263:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685279f80 00000100:00100000:1.0:1788391217.706607:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094260864:12345-192.168.202.1@tcp:4:dd.0 Request processed in 5483us (5788us total) trans 30064771253 rc 0/0 00000100:00100000:1.0:1788391217.706634:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 295 00002000:00100000:1.0:1788391217.706648:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff95d68527bb80 x1875263094260864/t30064771253(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.706658:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68527bb80 with x1875263094260864 ext(1048576->2097151) 00002000:00010000:1.0:1788391217.706664:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68527bb80 00000100:00100000:3.0:1788391217.713904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.713993:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094260992 00000100:00100000:2.0:1788391217.714003:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094260992 00002000:00100000:2.0:1788391217.714053:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff95d68a7e7b80 x1875263094260992/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.714064:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7b80 with x1875263094260992 ext(2097152->3145727) 00002000:00010000:2.0:1788391217.714070:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7b80 00000100:00100000:2.0:1788391217.714104:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:2.0:1788391217.714117:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094260992:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.721429:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094260992:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7303us (7521us total) trans 30064771254 rc 0/0 00000100:00100000:2.0:1788391217.721444:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 296 00002000:00100000:2.0:1788391217.721457:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff95d68a7e7b80 x1875263094260992/t30064771254(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.721469:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7b80 with x1875263094260992 ext(2097152->3145727) 00002000:00010000:2.0:1788391217.721475:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7b80 00000100:00100000:0.0:1788391217.722415:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.722468:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261120 00000100:00100000:1.0:1788391217.722477:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261120 00002000:00100000:1.0:1788391217.722515:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff95d586dc0a80 x1875263094261120/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.722526:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0a80 with x1875263094261120 ext(3145728->4194303) 00002000:00010000:1.0:1788391217.722530:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0a80 00000100:00100000:1.0:1788391217.722563:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:1.0:1788391217.722573:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094261120:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.727476:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094261120:12345-192.168.202.1@tcp:4:dd.0 Request processed in 4896us (5055us total) trans 30064771255 rc 0/0 00000100:00100000:1.0:1788391217.727487:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 297 00002000:00100000:1.0:1788391217.727496:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff95d586dc0a80 x1875263094261120/t30064771255(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.727503:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586dc0a80 with x1875263094261120 ext(3145728->4194303) 00002000:00010000:1.0:1788391217.727508:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d586dc0a80 00000100:00100000:0.0:1788391217.731672:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.731824:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261248 00000100:00100000:2.0:1788391217.731833:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261248 00002000:00100000:2.0:1788391217.731890:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff95d68f321f80 x1875263094261248/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.731900:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321f80 with x1875263094261248 ext(4194304->5242879) 00002000:00010000:2.0:1788391217.731905:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321f80 00000100:00100000:2.0:1788391217.732003:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:2.0:1788391217.732012:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2357:x1875263094261248:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.740674:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2357:x1875263094261248:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8636us (8985us total) trans 30064771256 rc 0/0 00000100:00100000:3.0:1788391217.740691:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 298 00002000:00100000:3.0:1788391217.740707:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff95d68f321f80 x1875263094261248/t30064771256(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.740719:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f321f80 with x1875263094261248 ext(4194304->5242879) 00002000:00010000:3.0:1788391217.740728:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f321f80 00000100:00100000:2.0:1788391217.746322:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.746410:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261376 00000100:00100000:3.0:1788391217.746427:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261376 00002000:00100000:2.0:1788391217.746624:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff95d58afd6680 x1875263094261376/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.746636:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd6680 with x1875263094261376 ext(5242880->6291455) 00002000:00010000:2.0:1788391217.746643:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd6680 00000100:00100000:2.0:1788391217.746684:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:2.0:1788391217.746699:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2358:x1875263094261376:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.762270:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2358:x1875263094261376:12345-192.168.202.1@tcp:4:dd.0 Request processed in 15558us (15939us total) trans 30064771257 rc 0/0 00000100:00100000:3.0:1788391217.762302:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 299 00002000:00100000:3.0:1788391217.762321:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff95d58afd6680 x1875263094261376/t30064771257(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.762334:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd6680 with x1875263094261376 ext(5242880->6291455) 00002000:00010000:3.0:1788391217.762342:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd6680 00000100:00100000:0.0:1788391217.762614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.763530:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261504 00000100:00100000:3.0:1788391217.763544:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261504 00002000:00100000:3.0:1788391217.763618:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff95d68f320e00 x1875263094261504/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.763630:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320e00 with x1875263094261504 ext(6291456->7340031) 00002000:00010000:3.0:1788391217.763636:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320e00 00000100:00100000:3.0:1788391217.763679:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:3.0:1788391217.763692:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2359:x1875263094261504:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.772606:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094261504:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8899us (9975us total) trans 30064771258 rc 0/0 00000100:00100000:3.0:1788391217.772625:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 300 00002000:00100000:3.0:1788391217.772642:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff95d68f320e00 x1875263094261504/t30064771258(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.772655:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320e00 with x1875263094261504 ext(6291456->7340031) 00002000:00010000:3.0:1788391217.772662:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320e00 00000100:00100000:2.0:1788391217.778067:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.778165:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261632 00000100:00100000:1.0:1788391217.778178:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261632 00002000:00100000:1.0:1788391217.778242:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff95d58afd4e00 x1875263094261632/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.778270:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd4e00 with x1875263094261632 ext(7340032->8388607) 00002000:00010000:1.0:1788391217.778286:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd4e00 00000100:00100000:1.0:1788391217.778318:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:1.0:1788391217.778327:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094261632:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.789846:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.789927:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261760 00000100:00100000:1.0:1788391217.789945:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261760 00002000:00100000:1.0:1788391217.790032:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff95d68f320700 x1875263094261760/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.790045:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320700 with x1875263094261760 ext(8388608->9437183) 00002000:00010000:1.0:1788391217.790052:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320700 00000100:00100000:1.0:1788391217.790101:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:1.0:1788391217.790113:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2357:x1875263094261760:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.793137:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2358:x1875263094261632:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14793us (15064us total) trans 30064771259 rc 0/0 00000100:00100000:1.0:1788391217.793155:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00002000:00100000:1.0:1788391217.793172:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff95d58afd4e00 x1875263094261632/t30064771259(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391217.793186:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd4e00 with x1875263094261632 ext(7340032->8388607) 00002000:00010000:1.0:1788391217.793194:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd4e00 00000100:00100000:3.0:1788391217.803515:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.803826:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094261888 00000100:00100000:2.0:1788391217.803840:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094261888 00002000:00100000:2.0:1788391217.803903:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff95d68a7e6300 x1875263094261888/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.803922:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6300 with x1875263094261888 ext(9437184->10485759) 00002000:00010000:2.0:1788391217.803929:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e6300 00000100:00100000:2.0:1788391217.804007:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:2.0:1788391217.804020:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+30:2359:x1875263094261888:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391217.815423:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2357:x1875263094261760:12345-192.168.202.1@tcp:4:dd.0 Request processed in 25284us (25560us total) trans 30064771260 rc 0/0 00000100:00100000:0.0:1788391217.815475:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00002000:00100000:0.0:1788391217.815503:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff95d68f320700 x1875263094261760/t30064771260(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.815519:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f320700 with x1875263094261760 ext(8388608->9437183) 00002000:00010000:0.0:1788391217.815531:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f320700 00000100:00100000:3.0:1788391217.818087:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.818228:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262016 00000100:00100000:2.0:1788391217.818241:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262016 00002000:00100000:2.0:1788391217.818313:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff95d68a7e5180 x1875263094262016/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.818326:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5180 with x1875263094262016 ext(10485760->11534335) 00002000:00010000:2.0:1788391217.818333:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e5180 00000100:00100000:2.0:1788391217.818374:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00100000:2.0:1788391217.818387:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+32:2359:x1875263094262016:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391217.831086:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.831315:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262144 00000100:00100000:3.0:1788391217.831329:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262144 00002000:00100000:3.0:1788391217.831395:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff95d587135180 x1875263094262144/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.831410:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135180 with x1875263094262144 ext(11534336->12582911) 00002000:00010000:3.0:1788391217.831417:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587135180 00000100:00100000:3.0:1788391217.831450:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 305 00000100:00100000:3.0:1788391217.831461:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+34:2357:x1875263094262144:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.835849:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2359:x1875263094261888:12345-192.168.202.1@tcp:4:dd.0 Request processed in 31814us (32331us total) trans 30064771261 rc 0/0 00000100:00100000:3.0:1788391217.835880:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 303 00002000:00100000:3.0:1788391217.835896:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff95d68a7e6300 x1875263094261888/t30064771261(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.835908:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6300 with x1875263094261888 ext(9437184->10485759) 00002000:00010000:3.0:1788391217.835915:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e6300 00000100:00100000:2.0:1788391217.844854:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2359:x1875263094262016:12345-192.168.202.1@tcp:4:dd.0 Request processed in 26453us (26765us total) trans 30064771262 rc 0/0 00000100:00100000:2.0:1788391217.844872:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 304 00002000:00100000:2.0:1788391217.844890:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff95d68a7e5180 x1875263094262016/t30064771262(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.844904:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5180 with x1875263094262016 ext(10485760->11534335) 00002000:00010000:2.0:1788391217.844912:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e5180 00000100:00100000:2.0:1788391217.846313:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.847780:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262272 00000100:00100000:2.0:1788391217.847796:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262272 00002000:00100000:2.0:1788391217.847858:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff95d58afd5500 x1875263094262272/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.847872:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd5500 with x1875263094262272 ext(12582912->13631487) 00002000:00010000:2.0:1788391217.847879:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd5500 00000100:00100000:2.0:1788391217.847916:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:2.0:1788391217.847928:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+36:2357:x1875263094262272:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.852292:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2357:x1875263094262144:12345-192.168.202.1@tcp:4:dd.0 Request processed in 20805us (21193us total) trans 30064771263 rc 0/0 00000100:00100000:3.0:1788391217.852310:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 305 00002000:00100000:3.0:1788391217.852326:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff95d587135180 x1875263094262144/t30064771263(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.852338:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135180 with x1875263094262144 ext(11534336->12582911) 00002000:00010000:3.0:1788391217.852346:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587135180 00000100:00100000:3.0:1788391217.858076:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2357:x1875263094262272:12345-192.168.202.1@tcp:4:dd.0 Request processed in 10135us (11755us total) trans 30064771264 rc 0/0 00000100:00100000:3.0:1788391217.858096:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 306 00002000:00100000:3.0:1788391217.858112:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff95d58afd5500 x1875263094262272/t30064771264(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.858126:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58afd5500 with x1875263094262272 ext(12582912->13631487) 00002000:00010000:3.0:1788391217.858134:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58afd5500 00000100:00100000:1.0:1788391217.862477:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.862555:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262400 00000100:00100000:3.0:1788391217.862568:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262400 00002000:00100000:3.0:1788391217.862637:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff95d587134700 x1875263094262400/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.862679:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134700 with x1875263094262400 ext(13631488->14680063) 00002000:00010000:3.0:1788391217.862687:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587134700 00000100:00100000:3.0:1788391217.862822:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00100000:3.0:1788391217.862835:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+38:2356:x1875263094262400:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391217.870422:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094262400:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7574us (7943us total) trans 30064771265 rc 0/0 00000100:00100000:3.0:1788391217.870440:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 307 00002000:00100000:3.0:1788391217.870457:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff95d587134700 x1875263094262400/t30064771265(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.870470:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587134700 with x1875263094262400 ext(13631488->14680063) 00002000:00010000:3.0:1788391217.870478:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587134700 00000100:00100000:1.0:1788391217.873061:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.873097:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.873185:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262528 00000100:00100000:2.0:1788391217.873196:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262528 00002000:00100000:2.0:1788391217.873249:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff95d587135500 x1875263094262528/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.873258:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135500 with x1875263094262528 ext(14680064->15728639) 00002000:00010000:2.0:1788391217.873263:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587135500 00000100:00100000:0.0:1788391217.873365:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262784 00000100:00100000:0.0:1788391217.873370:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262784 00000100:00100000:0.0:1788391217.873417:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1788391217.873425:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:38734:x1875263094262784:12345-192.168.202.1@tcp:35:dd.0 00000001:00080000:0.0:1788391217.873729:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771421 00000100:00100000:0.0:1788391217.873841:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38734:x1875263094262784:12345-192.168.202.1@tcp:35:dd.0 Request processed in 416us (742us total) trans 30064771422 rc 0/0 00000100:00100000:0.0:1788391217.873847:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000020:00080000:0.0:1788391217.873851:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788391217.873913:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 308 00000100:00100000:2.0:1788391217.873918:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094262528:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391217.884971:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2356:x1875263094262528:12345-192.168.202.1@tcp:4:dd.0 Request processed in 11021us (11890us total) trans 30064771266 rc 0/0 00000100:00100000:2.0:1788391217.884996:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 308 00002000:00100000:2.0:1788391217.885020:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff95d587135500 x1875263094262528/t30064771266(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/448 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.885038:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587135500 with x1875263094262528 ext(14680064->15728639) 00002000:00010000:2.0:1788391217.885047:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d587135500 00000100:00100000:0.0:1788391217.889780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.889883:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094262912 00000100:00100000:3.0:1788391217.889897:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094262912 00000100:00100000:3.0:1788391217.890003:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 397 00000100:00100000:3.0:1788391217.890016:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38736:x1875263094262912:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:3.0:1788391217.890050:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391217.890080:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd37f78 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00366 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890127:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9e00/0x9aafc5f04cd37f7f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890144:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9e00/0x9aafc5f04cd37f7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890198:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9e00/0x9aafc5f04cd37f7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890341:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd37f78 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00366 expref: 48 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890361:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9e00/0x9aafc5f04cd37f7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00366 expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.890370:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:3.0:1788391217.890373:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391217.890377:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9e00, rc 0) 00000100:00100000:3.0:1788391217.890459:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:38736:x1875263094262912:12345-192.168.202.1@tcp:101:chown.0 Request processed in 445us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391217.890467:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 397 00000100:00100000:0.0:1788391217.892467:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.892563:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263168 00000100:00100000:2.0:1788391217.892574:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263168 00000100:00100000:2.0:1788391217.892636:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 398 00000100:00100000:2.0:1788391217.892648:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:38736:x1875263094263168:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:2.0:1788391217.892724:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391217.892754:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de000/0x9aafc5f04cd37f39 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0034a expref: 47 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.892772:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.892775:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391217.892804:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.892815:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.892821:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391217.893332:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].14, 88 off9256 00000004:00080000:2.0:1788391217.893345:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1035000383743ns, next at 1036000380540ns, rc = 0 00000004:00010000:2.0:1788391217.893458:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e438be2 reply state 00000000492cca31 transno 30064771423 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391217.893470:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391217.893594:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:38736:x1875263094263168:12345-192.168.202.1@tcp:36:chown.0 Request processed in 948us (1138us total) trans 30064771423 rc 0/0 00000100:00100000:2.0:1788391217.893602:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 398 00010000:00010000:1.0:1788391217.894735:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894748:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894756:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894762:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391217.894768:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894777:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894795:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391217.894798:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391217.894803:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.894810:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37f86 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391217.895441:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.895477:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263296 00000100:00100000:3.0:1788391217.895489:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263296 00000100:00100000:1.0:1788391217.895570:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 399 00000100:00100000:1.0:1788391217.895580:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:38736:x1875263094263296:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391217.895605:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391217.895624:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f8d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0036d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.895674:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0036d expref: 48 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.895700:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0036d expref: 48 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.895722:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391217.895725:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391217.895728:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6813de200, rc 0) 00000100:00100000:1.0:1788391217.895782:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:38736:x1875263094263296:12345-192.168.202.1@tcp:101:chown.0 Request processed in 205us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391217.895788:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 399 00000100:00100000:2.0:1788391217.897260:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.897321:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263424 00000100:00100000:3.0:1788391217.897331:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263424 00000100:00100000:3.0:1788391217.897379:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1788391217.897390:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+39:2357:x1875263094263424:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:3.0:1788391217.897605:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1788391217.897608:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1788391217 00002000:00010000:3.0:1788391217.897610:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391217.897611:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1788391218 00002000:00010000:3.0:1788391217.897613:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391217.897658:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094263424:12345-192.168.202.1@tcp:2:chown.0 Request processed in 271us (404us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1788391217.897679:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1788391217.907941:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.908130:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263552 00000100:00100000:2.0:1788391217.908141:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263552 00000100:00100000:2.0:1788391217.908243:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 400 00000100:00100000:2.0:1788391217.908253:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:38737:x1875263094263552:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391217.908287:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.908320:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37f94 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00374 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908369:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37f9b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908383:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37f9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908394:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37f9b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908518:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37f94 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00374 expref: 50 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908536:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131c00/0x9aafc5f04cd37f9b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00374 expref: 49 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.908543:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391217.908545:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391217.908548:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131c00, rc 0) 00000100:00100000:2.0:1788391217.908618:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38737:x1875263094263552:12345-192.168.202.1@tcp:101:chown.0 Request processed in 367us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.908623:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 400 00000100:00100000:0.0:1788391217.910391:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391217.910765:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263808 00000100:00100000:1.0:1788391217.910776:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263808 00000100:00100000:1.0:1788391217.910862:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 401 00000100:00100000:1.0:1788391217.910871:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38737:x1875263094263808:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:1.0:1788391217.910929:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391217.910953:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37f63 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00358 expref: 49 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.910997:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:1.0:1788391217.911001:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391217.911031:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.911043:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391217.911050:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391217.911694:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].14, 88 off9328 00000004:00080000:1.0:1788391217.911708:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1035018746398ns, next at 1036018742563ns, rc = 0 00000004:00010000:1.0:1788391217.911815:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005215a180 reply state 00000000e85f885b transno 30064771424 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391217.911827:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391217.911954:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:38737:x1875263094263808:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1080us (1569us total) trans 30064771424 rc 0/0 00000100:00100000:1.0:1788391217.911994:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 401 00010000:00010000:2.0:1788391217.913356:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913373:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913382:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913388:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6813df600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.913393:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913400:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913419:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391217.913422:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391217.913427:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.913433:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813df600/0x9aafc5f04cd37fa2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391217.914438:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.914516:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094263936 00000100:00100000:2.0:1788391217.914527:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094263936 00000100:00100000:2.0:1788391217.914585:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 402 00000100:00100000:2.0:1788391217.914597:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38737:x1875263094263936:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391217.914627:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.914648:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37fa9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0037b expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.914711:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37fa9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0037b expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.914732:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37fa9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0037b expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.914755:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391217.914759:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391217.914762:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131400, rc 0) 00000100:00100000:2.0:1788391217.914818:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:38737:x1875263094263936:12345-192.168.202.1@tcp:101:chown.0 Request processed in 224us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.914826:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 402 00000100:00100000:1.0:1788391217.916123:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.916293:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264064 00000100:00100000:2.0:1788391217.916302:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264064 00000100:00100000:2.0:1788391217.916402:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:2.0:1788391217.916413:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094264064:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:2.0:1788391217.916651:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1788391217.916656:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1788391218 00002000:00010000:2.0:1788391217.916658:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391217.916660:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1788391218 00002000:00010000:2.0:1788391217.916663:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391217.916719:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:2357:x1875263094264064:12345-192.168.202.1@tcp:2:chown.0 Request processed in 308us (603us total) trans 30064771267 rc 0/0 00000100:00100000:2.0:1788391217.916727:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000040:00080000:2.0:1788391217.936116:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391217.936128:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391217.936897:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 7 00000040:00080000:2.0:1788391217.936910:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391217.945417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.945539:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264192 00000100:00100000:3.0:1788391217.945553:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264192 00000100:00100000:3.0:1788391217.945624:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 403 00000100:00100000:3.0:1788391217.945638:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:38743:x1875263094264192:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391217.945665:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391217.945689:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd37fb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00382 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945787:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9600/0x9aafc5f04cd37fb7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945803:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9600/0x9aafc5f04cd37fb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945814:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9600/0x9aafc5f04cd37fb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391217.945851:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00000004:00200000:3.0:1788391217.945854:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391217.945874:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9600/0x9aafc5f04cd37fb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945899:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd37fb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00382 expref: 52 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945915:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9600/0x9aafc5f04cd37fb7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00382 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391217.945939:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788391217.945941:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391217.945944:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9600, rc 0) 00000100:00100000:3.0:1788391217.946051:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:38743:x1875263094264192:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 416us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391217.946057:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 403 00000100:00100000:0.0:1788391217.947777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.947882:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264320 00000100:00100000:2.0:1788391217.947894:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264320 00000100:00100000:2.0:1788391217.948040:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 404 00000100:00100000:2.0:1788391217.948052:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:38743:x1875263094264320:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391217.948077:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.948114:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131800/0x9aafc5f04cd37fbe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00389 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948199:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948212:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948224:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948241:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948247:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948254:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948391:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948401:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948412:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391217.948444:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:2.0:1788391217.948449:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391217.948468:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948480:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948488:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948494:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948500:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948505:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b131e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.948510:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948518:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948542:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:2.0:1788391217.948546:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.948551:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948561:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37fc5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948574:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948580:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948585:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948590:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.948592:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948598:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948604:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff95d6830d2c00) 00010000:00010000:2.0:1788391217.948607:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391217.948609:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948615:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37fcc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948644:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131800/0x9aafc5f04cd37fbe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00389 expref: 53 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948662:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00389 expref: 52 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.948669:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.948672:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391217.948674:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b130800, rc 0) 00000100:00100000:2.0:1788391217.948753:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38743:x1875263094264320:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 704us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.948760:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 404 00000100:00100000:1.0:1788391217.951476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.951541:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264576 00000100:00100000:2.0:1788391217.951554:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264576 00000100:00100000:2.0:1788391217.951674:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 405 00000100:00100000:2.0:1788391217.951687:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38743:x1875263094264576:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391217.951713:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.951739:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37fda lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00390 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.951862:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37fe1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.951876:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37fe1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.951886:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37fe1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391217.951896:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:2.0:1788391217.952062:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130e00/0x9aafc5f04cd37fda lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00390 expref: 55 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.952076:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37fe1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00390 expref: 54 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.952083:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.952085:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391217.952088:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b130400, rc 0) 00000100:00100000:2.0:1788391217.952155:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:38743:x1875263094264576:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 472us (689us total) trans 30064771425 rc 0/0 00000100:00100000:2.0:1788391217.952162:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 405 00000100:00100000:1.0:1788391217.954299:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.954384:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264704 00000100:00100000:2.0:1788391217.954396:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264704 00000100:00100000:2.0:1788391217.954465:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1788391217.954476:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2356:x1875263094264704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391217.954496:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391217.954524:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130400/0x9aafc5f04cd37fe1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00390 expref: 54 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.954583:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.954588:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391217.954636:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094264704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 163us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391217.954641:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1788391217.955701:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.955747:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094264960 00000100:00100000:2.0:1788391217.955755:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094264960 00000100:00100000:2.0:1788391217.955810:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 406 00000100:00100000:2.0:1788391217.955819:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:38743:x1875263094264960:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391217.955848:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391217.955850:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788391217.955870:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6813de200/0x9aafc5f04cd37f8d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0036d expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.955886:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130800/0x9aafc5f04cd37fd3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00389 expref: 52 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.955893:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.955896:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391217.955908:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131800/0x9aafc5f04cd37fef lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00397 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.955944:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.955955:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.955990:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956006:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956013:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956025:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956033:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58b130600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391217.956037:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956045:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956053:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.956055:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391217.956059:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956064:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b130600/0x9aafc5f04cd37ff6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956086:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37ffd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956091:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37ffd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956097:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37ffd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956377:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37ffd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00397 expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956383:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.956386:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391217.956394:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131800/0x9aafc5f04cd37fef lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00397 expref: 54 pid: 42644 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956404:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131e00/0x9aafc5f04cd37ffd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00397 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391217.956428:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391217.956430:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391217.956432:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58b131e00, rc 0) 00000100:00100000:2.0:1788391217.956520:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:38743:x1875263094264960:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 703us (823us total) trans 30064771426 rc 0/0 00000100:00100000:2.0:1788391217.956526:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 406 00000100:00100000:1.0:1788391217.970645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391217.970699:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265088 00000100:00100000:3.0:1788391217.970759:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265088 00002000:00100000:3.0:1788391217.970826:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff95d587137100 x1875263094265088/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391217.970839:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137100 with x1875263094265088 ext(0->1048575) 00002000:00010000:3.0:1788391217.970847:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137100 00000100:00100000:3.0:1788391217.970884:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:3.0:1788391217.970896:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094265088:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391217.981779:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2356:x1875263094265088:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 10866us (11128us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391217.981815:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 309 00002000:00100000:0.0:1788391217.981832:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff95d587137100 x1875263094265088/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/440 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.981844:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137100 with x1875263094265088 ext(0->1048575) 00002000:00010000:0.0:1788391217.981852:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137100 00000100:00100000:3.0:1788391217.992033:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391217.992258:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265216 00000100:00100000:2.0:1788391217.992269:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265216 00002000:00100000:2.0:1788391217.992338:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff95d68a7e4e00 x1875263094265216/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/0 e 0 to 0 dl 1788391228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391217.992348:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4e00 with x1875263094265216 ext(1048576->2097151) 00002000:00010000:2.0:1788391217.992353:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e4e00 00000100:00100000:2.0:1788391217.992412:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 310 00000100:00100000:2.0:1788391217.992420:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094265216:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391217.999260:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094265216:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 6821us (7223us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391217.999290:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 310 00002000:00100000:0.0:1788391217.999308:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff95d68a7e4e00 x1875263094265216/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:78/0 lens 488/440 e 0 to 0 dl 1788391228 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391217.999322:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4e00 with x1875263094265216 ext(1048576->2097151) 00002000:00010000:0.0:1788391217.999330:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e4e00 00000100:00100000:2.0:1788391218.010079:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.010113:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.010289:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265344 00000100:00100000:3.0:1788391218.010303:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265344 00002000:00100000:3.0:1788391218.010381:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff95d58b144380 x1875263094265344/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.010390:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144380 with x1875263094265344 ext(2097152->3145727) 00002000:00010000:3.0:1788391218.010396:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b144380 00000100:00100000:3.0:1788391218.010424:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265472 00000100:00100000:3.0:1788391218.010428:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265472 00002000:00100000:3.0:1788391218.010441:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff95d58b144a80 x1875263094265472/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.010471:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144a80 with x1875263094265472 ext(3145728->4194303) 00002000:00010000:3.0:1788391218.010475:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b144a80 00000100:00100000:1.0:1788391218.010477:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:1.0:1788391218.010493:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094265344:12345-192.168.202.1@tcp:3:lfs.0 00000100:00080000:2.0:1788391218.010513:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391218.010652:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:3.0:1788391218.010661:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:2357:x1875263094265472:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391218.022577:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094265344:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 12071us (12494us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.022597:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00002000:00100000:1.0:1788391218.022616:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff95d58b144380 x1875263094265344/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.022628:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144380 with x1875263094265344 ext(2097152->3145727) 00002000:00010000:1.0:1788391218.022636:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b144380 00000100:00100000:3.0:1788391218.023449:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094265472:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 12785us (13329us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391218.023461:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 312 00002000:00100000:3.0:1788391218.023470:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff95d58b144a80 x1875263094265472/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.023479:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b144a80 with x1875263094265472 ext(3145728->4194303) 00002000:00010000:3.0:1788391218.023484:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b144a80 00000100:00100000:0.0:1788391218.047691:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.047745:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.048011:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265600 00000100:00100000:2.0:1788391218.048025:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265600 00002000:00100000:2.0:1788391218.048098:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff95d6bc64b480 x1875263094265600/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.048113:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64b480 with x1875263094265600 ext(4194304->5242879) 00002000:00010000:2.0:1788391218.048121:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc64b480 00000100:00100000:2.0:1788391218.048211:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265728 00000100:00100000:2.0:1788391218.048216:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265728 00002000:00100000:2.0:1788391218.048239:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc649500 x1875263094265728/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.048249:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649500 with x1875263094265728 ext(5242880->6291455) 00002000:00010000:2.0:1788391218.048264:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc649500 00000100:00100000:1.0:1788391218.048439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.050045:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265856 00000100:00100000:2.0:1788391218.050062:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 313 00000100:00100000:0.0:1788391218.050062:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265856 00000100:00100000:2.0:1788391218.050078:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2359:x1875263094265600:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.050087:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 314 00000100:00100000:0.0:1788391218.050105:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2359:x1875263094265728:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391218.050214:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391218.050243:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094265984 00000100:00100000:1.0:1788391218.050266:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094265984 00002000:00100000:1.0:1788391218.050320:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff95d58b17ad80 x1875263094265984/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.050332:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17ad80 with x1875263094265984 ext(7340032->8388607) 00002000:00010000:1.0:1788391218.050336:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b17ad80 00000100:00100000:1.0:1788391218.050366:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 315 00000100:00100000:1.0:1788391218.050375:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2359:x1875263094265984:12345-192.168.202.1@tcp:3:lfs.0 00002000:00100000:3.0:1788391218.051048:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff95d587137800 x1875263094265856/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.051060:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137800 with x1875263094265856 ext(6291456->7340031) 00002000:00010000:3.0:1788391218.051065:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137800 00000100:00100000:3.0:1788391218.051090:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 316 00000100:00100000:3.0:1788391218.051111:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2359:x1875263094265856:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391218.063255:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2359:x1875263094265728:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 13143us (15492us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391218.063283:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 314 00002000:00100000:3.0:1788391218.063299:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc649500 x1875263094265728/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.063333:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649500 with x1875263094265728 ext(5242880->6291455) 00002000:00010000:3.0:1788391218.063341:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc649500 00000100:00100000:2.0:1788391218.074568:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2359:x1875263094265600:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 24483us (26876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391218.074581:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 313 00002000:00100000:2.0:1788391218.074595:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff95d6bc64b480 x1875263094265600/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.074603:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64b480 with x1875263094265600 ext(4194304->5242879) 00002000:00010000:2.0:1788391218.074610:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc64b480 00000100:00100000:1.0:1788391218.080458:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2359:x1875263094265984:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 30067us (30228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.080476:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 315 00002000:00100000:1.0:1788391218.080494:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff95d58b17ad80 x1875263094265984/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.080507:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17ad80 with x1875263094265984 ext(7340032->8388607) 00002000:00010000:1.0:1788391218.080515:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b17ad80 00000100:00100000:1.0:1788391218.086317:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2359:x1875263094265856:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 35203us (37861us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.086335:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 316 00002000:00100000:1.0:1788391218.086351:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff95d587137800 x1875263094265856/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.086363:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d587137800 with x1875263094265856 ext(6291456->7340031) 00002000:00010000:1.0:1788391218.086370:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d587137800 00010000:00010000:0.0:1788391218.125482:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391218.137408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.137466:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266112 00000100:00100000:3.0:1788391218.137481:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266112 00002000:00100000:3.0:1788391218.137558:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff95d68a7e4a80 x1875263094266112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.137572:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4a80 with x1875263094266112 ext(8388608->9437183) 00002000:00010000:3.0:1788391218.137580:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e4a80 00000100:00100000:3.0:1788391218.137619:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 317 00000100:00100000:3.0:1788391218.137633:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094266112:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391218.139601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.139888:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266240 00000100:00100000:3.0:1788391218.139900:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266240 00002000:00100000:3.0:1788391218.140139:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff95d68a7e5f80 x1875263094266240/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.140154:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5f80 with x1875263094266240 ext(9437184->10485759) 00002000:00010000:3.0:1788391218.140161:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5f80 00000100:00100000:3.0:1788391218.140197:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 318 00000100:00100000:3.0:1788391218.140208:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094266240:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391218.142957:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.143213:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.143237:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.143294:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.143310:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.143376:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266368 00000100:00100000:3.0:1788391218.143390:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266368 00002000:00100000:3.0:1788391218.143456:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff95d68a7e5880 x1875263094266368/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.143470:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5880 with x1875263094266368 ext(10485760->11534335) 00002000:00010000:3.0:1788391218.143477:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5880 00000100:00100000:3.0:1788391218.143498:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266624 00000100:00100000:3.0:1788391218.143501:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266624 00002000:00100000:3.0:1788391218.143514:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff95d68a7e5500 x1875263094266624/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.143522:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5500 with x1875263094266624 ext(12582912->13631487) 00002000:00010000:3.0:1788391218.143526:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5500 00000100:00100000:3.0:1788391218.143531:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266496 00000100:00100000:3.0:1788391218.143534:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266496 00002000:00100000:3.0:1788391218.143544:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff95d68a7e5c00 x1875263094266496/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.143552:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5c00 with x1875263094266496 ext(11534336->12582911) 00002000:00010000:3.0:1788391218.143555:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5c00 00000100:00100000:3.0:1788391218.144131:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266880 00000100:00100000:3.0:1788391218.144138:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266880 00002000:00100000:3.0:1788391218.144164:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff95d68a7e6680 x1875263094266880/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.144173:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6680 with x1875263094266880 ext(14680064->15728639) 00002000:00010000:3.0:1788391218.144177:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6680 00000100:00100000:3.0:1788391218.144195:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094266752 00000100:00100000:3.0:1788391218.144198:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094266752 00002000:00100000:3.0:1788391218.144213:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff95d68a7e6a00 x1875263094266752/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.144221:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6a00 with x1875263094266752 ext(13631488->14680063) 00002000:00010000:3.0:1788391218.144224:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6a00 00000100:00100000:3.0:1788391218.144235:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 319 00000100:00100000:3.0:1788391218.144318:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2357:x1875263094266368:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.146202:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 320 00000100:00100000:0.0:1788391218.146234:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:2357:x1875263094266624:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391218.155096:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:2357:x1875263094266112:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 17448us (17731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391218.155115:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 317 00002000:00100000:2.0:1788391218.155132:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff95d68a7e4a80 x1875263094266112/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.155153:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4a80 with x1875263094266112 ext(8388608->9437183) 00002000:00010000:2.0:1788391218.155162:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e4a80 00000100:00100000:2.0:1788391218.155202:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 321 00000100:00100000:2.0:1788391218.155219:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2357:x1875263094266496:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391218.164468:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:2357:x1875263094266240:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 24243us (24861us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391218.164518:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 318 00002000:00100000:2.0:1788391218.164535:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff95d68a7e5f80 x1875263094266240/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.164548:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5f80 with x1875263094266240 ext(9437184->10485759) 00002000:00010000:2.0:1788391218.165419:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5f80 00000100:00100000:2.0:1788391218.165709:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 322 00000100:00100000:2.0:1788391218.165725:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094266880:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.171381:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:2357:x1875263094266368:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 27117us (28427us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391218.171412:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 319 00002000:00100000:0.0:1788391218.171430:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff95d68a7e5880 x1875263094266368/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391218.171444:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5880 with x1875263094266368 ext(10485760->11534335) 00002000:00010000:0.0:1788391218.171452:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5880 00000100:00100000:0.0:1788391218.171488:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 323 00000100:00100000:0.0:1788391218.171510:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2357:x1875263094266752:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.184099:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:2357:x1875263094266624:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 37864us (40867us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391218.185928:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 320 00002000:00100000:0.0:1788391218.185954:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff95d68a7e5500 x1875263094266624/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391218.185983:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5500 with x1875263094266624 ext(12582912->13631487) 00002000:00010000:0.0:1788391218.185992:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5500 00000001:00080000:1.0:1788391218.187587:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771422 is committed 00000001:00080000:1.0:1788391218.187629:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771424 is committed 00000004:00080000:1.0:1788391218.187638:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000100:00100000:3.0:1788391218.189135:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2357:x1875263094266496:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 33911us (45883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391218.189150:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 321 00002000:00100000:3.0:1788391218.189165:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff95d68a7e5c00 x1875263094266496/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.189184:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e5c00 with x1875263094266496 ext(11534336->12582911) 00002000:00010000:3.0:1788391218.189192:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e5c00 00000100:00100000:3.0:1788391218.190549:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391218.190577:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103484032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391218.190655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391218.190731:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484032 00000100:00100000:2.0:1788391218.190743:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484032 00000100:00080000:3.0:1788391218.190821:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391218.190829:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788391218.190843:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103484032:12345-0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788391218.190915:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771426 is committed 00000004:00080000:1.0:1788391218.190928:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000100:00100000:1.0:1788391218.191736:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391218.191754:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103484160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391218.191806:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788391218.191830:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1788391218.191835:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 1788391218 -> 1788391218 00002000:00010000:2.0:1788391218.191838:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391218.191841:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 1788391218 -> 1788391218 00002000:00010000:2.0:1788391218.191844:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:1.0:1788391218.191851:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484160 00000100:00100000:1.0:1788391218.191858:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484160 00000100:00100000:2.0:1788391218.191894:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103484032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1053us (1238us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1788391218.191906:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788391218.191914:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788391218.191925:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103484160:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788391218.192075:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788391218.192094:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1788391218.192099:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 1788391217 -> 1788391217 00002000:00010000:1.0:1788391218.192101:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391218.192103:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 1788391218 -> 1788391218 00002000:00010000:1.0:1788391218.192105:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391218.192146:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103484160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (339us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1788391218.192154:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000004:00080000:2.0:1788391218.192201:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc648000/2, rc 0, transno 30064771199 00000100:00100000:2.0:1788391218.192209:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103484160:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788391218.192427:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d6bc649c00/2, rc 0, transno 30064771268 00000100:00100000:3.0:1788391218.192433:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103484032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788391218.194937:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:2357:x1875263094266880:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 29192us (51617us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.194953:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 322 00002000:00100000:1.0:1788391218.194995:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff95d68a7e6680 x1875263094266880/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.195008:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6680 with x1875263094266880 ext(14680064->15728639) 00002000:00010000:1.0:1788391218.195016:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6680 00000100:00100000:2.0:1788391218.197786:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+40:2357:x1875263094266752:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 26272us (54457us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391218.197803:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 323 00002000:00100000:2.0:1788391218.197816:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff95d68a7e6a00 x1875263094266752/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.197836:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e6a00 with x1875263094266752 ext(13631488->14680063) 00002000:00010000:2.0:1788391218.197845:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d68a7e6a00 00000001:00080000:0.0:1788391218.207028:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771260 is committed 00000001:00080000:0.0:1788391218.207091:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771251 is committed 00000001:00080000:0.0:1788391218.207099:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771267 is committed 00000100:00100000:2.0:1788391218.235484:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.235608:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094267136 00000100:00100000:0.0:1788391218.235621:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094267136 00000100:00100000:0.0:1788391218.235748:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788391218.235770:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+41:38743:x1875263094267136:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:1.0:1788391218.236326:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:38743:x1875263094267136:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 563us (853us total) trans 30064771427 rc 0/0 00000100:00100000:1.0:1788391218.236356:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00080000:2.0:1788391218.238172:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391218.287292:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.287486:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094267264 00000100:00100000:3.0:1788391218.287500:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094267264 00000100:00100000:3.0:1788391218.287576:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 407 00000100:00100000:3.0:1788391218.287588:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+42:38749:x1875263094267264:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391218.287633:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391218.287659:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9400/0x9aafc5f04cd38004 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0039e expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287743:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287761:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287775:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287793:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287801:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.287808:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288360:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288371:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288379:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391218.288411:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00000004:00200000:3.0:1788391218.288420:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391218.288443:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288457:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288466:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288473:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288481:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288487:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391218.288491:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288499:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288513:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:3.0:1788391218.288516:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391218.288521:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288527:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd3800b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288542:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288558:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288565:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288570:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391218.288573:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288578:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288585:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff95d686a70d00) 00010000:00010000:3.0:1788391218.288587:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391218.288589:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288595:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38012 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288630:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9400/0x9aafc5f04cd38004 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0039e expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288643:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0039e expref: 43 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.288651:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391218.288653:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391218.288661:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9a00, rc 0) 00000100:00100000:3.0:1788391218.288746:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:38749:x1875263094267264:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 1158us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391218.288755:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 407 00000100:00100000:3.0:1788391218.294721:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.295072:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094267520 00000100:00100000:0.0:1788391218.295085:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094267520 00000100:00100000:0.0:1788391218.295187:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 408 00000100:00100000:0.0:1788391218.295199:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:38749:x1875263094267520:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391218.295228:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391218.295255:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255a00/0x9aafc5f04cd38020 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003a5 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.295397:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255000/0x9aafc5f04cd38027 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.295414:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255000/0x9aafc5f04cd38027 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.295429:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255000/0x9aafc5f04cd38027 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391218.295440:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00010000:00010000:0.0:1788391218.295575:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255a00/0x9aafc5f04cd38020 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003a5 expref: 46 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.295591:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255000/0x9aafc5f04cd38027 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003a5 expref: 45 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.295599:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:0.0:1788391218.295601:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391218.295604:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d255000, rc 0) 00000100:00100000:0.0:1788391218.295675:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:38749:x1875263094267520:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 480us (970us total) trans 30064771428 rc 0/0 00000100:00100000:0.0:1788391218.295680:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 408 00000100:00100000:0.0:1788391218.299158:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.299404:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.299544:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094267648 00000100:00100000:2.0:1788391218.299557:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094267648 00000100:00100000:2.0:1788391218.299641:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1788391218.299653:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:2358:x1875263094267648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391218.299674:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391218.299707:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d255000/0x9aafc5f04cd38027 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003a5 expref: 45 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.299736:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:2.0:1788391218.299743:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391218.299821:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:2358:x1875263094267648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 169us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391218.299835:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1788391218.300351:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094267904 00000100:00100000:3.0:1788391218.300356:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094267904 00000100:00100000:3.0:1788391218.300419:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 409 00000100:00100000:3.0:1788391218.300426:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:38749:x1875263094267904:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391218.300447:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391218.300449:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1788391218.300461:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58b131400/0x9aafc5f04cd37fa9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0037b expref: 44 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300473:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38019 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0039e expref: 43 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300484:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391218.300487:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391218.300502:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9400/0x9aafc5f04cd38035 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003ac expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300548:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300560:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300568:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300592:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300597:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300602:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300606:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391218.300609:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300614:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300619:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391218.300621:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391218.300623:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300627:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd3803c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300645:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd38043 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300650:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd38043 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300656:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd38043 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300940:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd38043 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003ac expref: 45 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.300949:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391218.300952:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788391218.301249:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9400/0x9aafc5f04cd38035 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003ac expref: 45 pid: 42646 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.301281:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9c00/0x9aafc5f04cd38043 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003ac expref: 44 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391218.301311:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:3.0:1788391218.301314:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788391218.301317:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9c00, rc 0) 00000100:00100000:3.0:1788391218.301379:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:38749:x1875263094267904:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 952us (1974us total) trans 30064771429 rc 0/0 00000100:00100000:3.0:1788391218.301386:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 409 00000100:00100000:0.0:1788391218.317082:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.317314:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268032 00000100:00100000:3.0:1788391218.317328:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268032 00002000:00100000:3.0:1788391218.317420:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff95d6bc649f80 x1875263094268032/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.317433:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649f80 with x1875263094268032 ext(0->1048575) 00002000:00010000:3.0:1788391218.317441:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc649f80 00000100:00080000:2.0:1788391218.317449:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391218.317482:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 324 00000100:00100000:3.0:1788391218.317495:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094268032:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:2.0:1788391218.328139:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094268032:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 10613us (11035us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391218.328158:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 324 00002000:00100000:2.0:1788391218.328184:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff95d6bc649f80 x1875263094268032/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391218.328197:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649f80 with x1875263094268032 ext(0->1048575) 00002000:00010000:2.0:1788391218.328205:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc649f80 00000100:00100000:1.0:1788391218.352260:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.352394:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268160 00000100:00100000:0.0:1788391218.352407:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268160 00002000:00100000:0.0:1788391218.352481:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff95d58b17a300 x1875263094268160/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391218.352494:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17a300 with x1875263094268160 ext(1048576->2097151) 00002000:00010000:0.0:1788391218.352501:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b17a300 00000100:00100000:0.0:1788391218.352538:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 325 00000100:00100000:0.0:1788391218.352552:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094268160:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.363738:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094268160:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 11173us (11477us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788391218.363756:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 325 00002000:00100000:0.0:1788391218.363772:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff95d58b17a300 x1875263094268160/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391218.363783:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b17a300 with x1875263094268160 ext(1048576->2097151) 00002000:00010000:0.0:1788391218.363792:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d58b17a300 00000100:00100000:3.0:1788391218.375587:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.375622:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391218.375665:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268416 00000100:00100000:1.0:1788391218.375679:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268416 00002000:00100000:1.0:1788391218.375752:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff95d68a7e7100 x1875263094268416/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.375765:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7100 with x1875263094268416 ext(3145728->4194303) 00002000:00010000:1.0:1788391218.375772:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7100 00000100:00100000:1.0:1788391218.375805:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268288 00000100:00100000:1.0:1788391218.375809:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268288 00002000:00100000:1.0:1788391218.375827:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff95d68a7e4700 x1875263094268288/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.375835:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4700 with x1875263094268288 ext(2097152->3145727) 00002000:00010000:1.0:1788391218.375839:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e4700 00000100:00100000:2.0:1788391218.375855:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 326 00000100:00100000:2.0:1788391218.375874:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094268416:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391218.375892:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 327 00000100:00100000:1.0:1788391218.375904:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094268288:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391218.383893:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2358:x1875263094268288:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 7975us (8252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.383910:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 327 00002000:00100000:1.0:1788391218.383925:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff95d68a7e4700 x1875263094268288/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.383938:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e4700 with x1875263094268288 ext(2097152->3145727) 00002000:00010000:1.0:1788391218.383946:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e4700 00000100:00100000:1.0:1788391218.392891:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2359:x1875263094268416:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 17003us (17299us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.392910:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 326 00002000:00100000:1.0:1788391218.392928:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff95d68a7e7100 x1875263094268416/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.392940:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68a7e7100 with x1875263094268416 ext(3145728->4194303) 00002000:00010000:1.0:1788391218.392948:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68a7e7100 00000100:00100000:0.0:1788391218.417059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.417148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.417347:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391218.417397:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268544 00000100:00100000:1.0:1788391218.417406:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268800 00000100:00100000:1.0:1788391218.417414:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268800 00000100:00100000:3.0:1788391218.417415:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268544 00002000:00100000:3.0:1788391218.417488:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff95d6bc64a680 x1875263094268544/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.417488:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff95d6bc649880 x1875263094268800/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.417510:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649880 with x1875263094268800 ext(6291456->7340031) 00002000:00010000:1.0:1788391218.417518:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc649880 00000100:00100000:1.0:1788391218.417563:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 328 00000100:00100000:1.0:1788391218.417575:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094268800:12345-192.168.202.1@tcp:3:lfs.0 00002000:00100000:3.0:1788391218.417630:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64a680 with x1875263094268544 ext(4194304->5242879) 00002000:00010000:3.0:1788391218.417635:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64a680 00000100:00100000:3.0:1788391218.417668:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:3.0:1788391218.417677:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094268544:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391218.418876:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268672 00000100:00100000:3.0:1788391218.418887:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268672 00002000:00100000:3.0:1788391218.418923:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc64bb80 x1875263094268672/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391218.418936:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64bb80 with x1875263094268672 ext(5242880->6291455) 00002000:00010000:3.0:1788391218.418941:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64bb80 00000100:00100000:3.0:1788391218.418987:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:3.0:1788391218.418997:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2358:x1875263094268672:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:0.0:1788391218.420629:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391218.420731:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094268928 00000100:00100000:1.0:1788391218.420742:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094268928 00002000:00100000:1.0:1788391218.420788:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff95d6bc64b100 x1875263094268928/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/0 e 0 to 0 dl 1788391229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.420799:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64b100 with x1875263094268928 ext(7340032->8388607) 00002000:00010000:1.0:1788391218.420804:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64b100 00000100:00100000:1.0:1788391218.420841:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:1.0:1788391218.420853:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2358:x1875263094268928:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:1.0:1788391218.440812:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2358:x1875263094268544:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 23120us (23749us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.440846:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 329 00002000:00100000:1.0:1788391218.440864:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff95d6bc64a680 x1875263094268544/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.440877:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64a680 with x1875263094268544 ext(4194304->5242879) 00002000:00010000:1.0:1788391218.440885:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64a680 00000100:00100000:1.0:1788391218.444143:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2358:x1875263094268800:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 26554us (26979us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.444159:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 328 00002000:00100000:1.0:1788391218.444171:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff95d6bc649880 x1875263094268800/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.444183:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc649880 with x1875263094268800 ext(6291456->7340031) 00002000:00010000:1.0:1788391218.444190:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc649880 00000100:00100000:1.0:1788391218.453516:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2358:x1875263094268672:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 34502us (36150us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.453530:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 330 00002000:00100000:1.0:1788391218.453546:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff95d6bc64bb80 x1875263094268672/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.453558:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64bb80 with x1875263094268672 ext(5242880->6291455) 00002000:00010000:1.0:1788391218.453566:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64bb80 00000100:00100000:1.0:1788391218.458982:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2358:x1875263094268928:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 38096us (38326us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391218.459001:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 331 00002000:00100000:1.0:1788391218.459020:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff95d6bc64b100 x1875263094268928/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:79/0 lens 488/440 e 0 to 0 dl 1788391229 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391218.459053:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64b100 with x1875263094268928 ext(7340032->8388607) 00002000:00010000:1.0:1788391218.459060:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc64b100 00000100:00100000:3.0:1788391218.465506:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391218.465573:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094269184 00000100:00100000:1.0:1788391218.465587:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094269184 00000100:00100000:1.0:1788391218.465784:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1788391218.465798:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:38749:x1875263094269184:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:1.0:1788391218.466164:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:38749:x1875263094269184:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 367us (670us total) trans 30064771430 rc 0/0 00000100:00100000:1.0:1788391218.466181:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1788391218.517416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.517513:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094269440 00000100:00100000:0.0:1788391218.517527:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094269440 00000100:00100000:0.0:1788391218.517613:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 410 00000100:00100000:0.0:1788391218.517627:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:38759:x1875263094269440:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391218.517689:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391218.517718:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd3804a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003b3 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391218.517837:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:0.0:1788391218.518052:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd3804a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003b3 expref: 47 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.518070:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391218.518074:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391218.518079:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd3804a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003b3 expref: 47 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.518097:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173bc00, rc 0) 00000100:00100000:0.0:1788391218.518172:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38759:x1875263094269440:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 547us (767us total) trans 30064771431 rc 301/301 00000100:00100000:0.0:1788391218.518180:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 410 00000100:00100000:3.0:1788391218.523937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.524134:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094269568 00000100:00100000:2.0:1788391218.524147:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094269568 00000100:00100000:2.0:1788391218.524228:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 411 00000100:00100000:2.0:1788391218.524241:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38759:x1875263094269568:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391218.524364:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524385:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524400:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524418:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524426:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524432:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524914:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524924:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.524931:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391218.525005:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525020:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525028:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525035:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525042:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391218.525047:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525055:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525070:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:2.0:1788391218.525073:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391218.525078:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525084:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38058 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525098:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525104:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525110:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525115:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391218.525118:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525124:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525131:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff95d6830d2c00) 00010000:00010000:2.0:1788391218.525133:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391218.525136:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525142:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd3805f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525162:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525168:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525174:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525179:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391218.525182:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525189:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525196:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:2.0:1788391218.525199:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391218.525202:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.525208:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd38066 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391218.525311:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38759:x1875263094269568:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1071us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391218.525321:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 411 00000100:00100000:3.0:1788391218.527855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.528360:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094269824 00000100:00100000:2.0:1788391218.528372:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094269824 00000100:00100000:2.0:1788391218.528444:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1788391218.528458:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:38759:x1875263094269824:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391218.528761:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:38759:x1875263094269824:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 305us (918us total) trans 30064771432 rc 0/0 00000100:00100000:2.0:1788391218.528769:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788391218.610679:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.610921:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270080 00000100:00100000:2.0:1788391218.610934:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270080 00000100:00100000:2.0:1788391218.611042:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 412 00000100:00100000:2.0:1788391218.611055:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:38769:x1875263094270080:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391218.611090:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391218.611132:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3806d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003ba expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.611263:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd38074 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.611292:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd38074 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.611306:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd38074 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391218.611320:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:2.0:1788391218.611474:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd3806d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003ba expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.611497:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92e00/0x9aafc5f04cd38074 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003ba expref: 49 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391218.611513:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:2.0:1788391218.611528:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391218.611533:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92e00, rc 0) 00000100:00100000:2.0:1788391218.611613:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38769:x1875263094270080:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 560us (958us total) trans 30064771433 rc 0/0 00000100:00100000:2.0:1788391218.611620:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 412 00000100:00100000:3.0:1788391218.621182:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.621324:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270208 00000100:00100000:0.0:1788391218.621340:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270208 00000100:00100000:0.0:1788391218.621433:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 413 00000100:00100000:0.0:1788391218.621446:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38769:x1875263094270208:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391218.621554:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.621578:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.621619:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.621637:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.621645:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.621651:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622042:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622053:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622060:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391218.622112:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622127:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622135:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622142:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622160:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391218.622165:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622174:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622188:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:0.0:1788391218.622191:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391218.622196:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622202:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38082 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622216:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622222:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622227:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622233:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391218.622236:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622241:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622260:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391218.622263:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391218.622277:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622284:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38089 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622303:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622309:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622315:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622321:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173b400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391218.622324:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622330:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622339:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff95d6830d2700) 00010000:00010000:0.0:1788391218.622341:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391218.622344:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.622349:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38090 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391218.622450:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38769:x1875263094270208:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1005us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391218.622460:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 413 00000100:00100000:2.0:1788391218.668867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.668997:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270336 00000100:00100000:0.0:1788391218.669012:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270336 00000100:00100000:0.0:1788391218.669098:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 414 00000100:00100000:0.0:1788391218.669108:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:38775:x1875263094270336:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391218.669142:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391218.669166:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38097 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003c1 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669255:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669281:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669300:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669318:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669327:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669334:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669759:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669770:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669778:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391218.669823:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:0.0:1788391218.669829:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391218.669855:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669870:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669880:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669888:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669895:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669902:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391218.669908:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669917:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669941:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff95d6a704cb00) 00010000:00010000:0.0:1788391218.669944:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391218.669950:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.669957:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd3809e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670049:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670056:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670062:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670067:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391218.670070:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670076:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670084:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391218.670086:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391218.670089:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670095:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd380a5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670147:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd38097 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003c1 expref: 51 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670161:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a800/0x9aafc5f04cd380ac lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003c1 expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.670170:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:0.0:1788391218.670172:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391218.670175:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173a800, rc 0) 00000100:00100000:0.0:1788391218.670274:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:38775:x1875263094270336:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1157us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391218.670283:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 414 00000100:00100000:2.0:1788391218.674590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391218.675446:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270592 00000100:00100000:1.0:1788391218.675461:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270592 00000100:00100000:1.0:1788391218.675545:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 415 00000100:00100000:1.0:1788391218.675558:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:38775:x1875263094270592:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391218.675588:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391218.675616:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380b3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003c8 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391218.675754:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380ba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391218.675773:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391218.675787:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391218.675801:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:1.0:1788391218.676010:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380b3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003c8 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391218.676031:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003c8 expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391218.676042:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:1.0:1788391218.676045:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391218.676050:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:1.0:1788391218.676130:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38775:x1875263094270592:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 574us (1554us total) trans 30064771434 rc 0/0 00000100:00100000:1.0:1788391218.676138:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 415 00000100:00100000:3.0:1788391218.679713:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391218.681300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391218.681383:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270720 00000100:00100000:0.0:1788391218.681396:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270720 00000100:00100000:3.0:1788391218.681398:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094270976 00000100:00100000:3.0:1788391218.681405:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094270976 00000100:00100000:3.0:1788391218.681491:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788391218.681492:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391218.681509:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:38775:x1875263094270976:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1788391218.681511:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2359:x1875263094270720:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391218.681535:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391218.681568:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380ba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003c8 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391218.681593:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff95d6a0d29500) 00010000:00010000:0.0:1788391218.681599:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391218.681665:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2359:x1875263094270720:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 161us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391218.681673:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1788391218.681903:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38775:x1875263094270976:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 398us (791us total) trans 30064771435 rc 0/0 00000100:00100000:3.0:1788391218.681910:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00010000:00010000:2.0:1788391219.149278:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391219.205491:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771189 is committed 00000001:00080000:0.0:1788391219.205521:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771199 is committed 00000001:00080000:0.0:1788391219.205529:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771195 is committed 00000001:00080000:0.0:1788391219.205551:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771197 is committed 00000001:00080000:0.0:1788391219.205579:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771198 is committed 00000100:00100000:1.0:1788391220.174615:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391220.174679:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103484288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391220.174777:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391220.175310:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484288 00000100:00100000:2.0:1788391220.175321:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484288 00000100:00100000:2.0:1788391220.175403:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788391220.175415:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103484288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391220.175462:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3718250496 avail 3716153344 00000100:00100000:2.0:1788391220.175523:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103484288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391220.175531:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788391220.175608:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391220.175639:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771251 gen 2 00000004:00080000:2.0:1788391220.175646:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58ad32d80, transno 30064771251 00000100:00100000:2.0:1788391220.175661:0:3289:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d6bc649c00 x1875263103484032/t30064771268(30064771268) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788391234 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788391220.175681:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103484288:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788391220.176004:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391220.176614:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103484416:0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.176665:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391220.176741:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484416 00000100:00100000:0.0:1788391220.176747:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484416 00000100:00100000:2.0:1788391220.176781:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391220.176787:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103484800:0@lo:400:kworker.0 00000100:00100000:0.0:1788391220.176790:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788391220.176798:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103484416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.176817:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391220.176840:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103484416:12345-0@lo:400:kworker.0 Request processed in 44us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391220.176845:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788391220.176848:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788391220.176864:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103484544:0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.176891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391220.176929:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391220.176943:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.176986:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391220.176997:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484544 00000100:00100000:0.0:1788391220.177001:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484544 00000100:00100000:2.0:1788391220.177012:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484800 00000100:00100000:2.0:1788391220.177015:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484800 00000100:00100000:0.0:1788391220.177034:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788391220.177041:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484672 00000100:00100000:0.0:1788391220.177042:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103484544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.177044:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484672 00000100:00100000:2.0:1788391220.177063:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788391220.177070:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103484800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391220.177078:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103484544:12345-0@lo:400:kworker.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391220.177084:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788391220.177099:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391220.177101:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103484800:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00080000:0.0:1788391220.177103:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391220.177107:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788391220.177119:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788391220.177125:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103484672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.177150:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103484672:12345-0@lo:400:kworker.0 Request processed in 26us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391220.177156:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788391220.177192:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.177204:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771199 gen 2 00000004:00080000:2.0:1788391220.177209:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc648000, transno 30064771199 00000100:00100000:2.0:1788391220.177220:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103484544:0@lo:400:kworker.0 00000100:00100000:2.0:1788391220.177544:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103484800:0@lo:400:kworker.0 00000100:00100000:1.0:1788391220.177807:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391220.177817:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103484928:0@lo:400:kworker.0 00000100:00100000:1.0:1788391220.177852:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391220.177879:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103484928 00000100:00100000:1.0:1788391220.178147:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103484928 00000100:00100000:1.0:1788391220.178226:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788391220.178233:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103484928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391220.178284:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103484928:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391220.178291:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788391220.178320:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103484928:0@lo:400:kworker.0 00000100:00080000:2.0:1788391220.178358:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788391221.006950:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391221.007006:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391221.007432:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 6 00000040:00080000:3.0:1788391221.007441:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391221.203612:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391221.203682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391221.203763:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485056 00000100:00100000:0.0:1788391221.203771:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485056 00000100:00100000:0.0:1788391221.203819:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391221.203830:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103485056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391221.203875:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 204406784 pending 0 free 3772776448 avail 3770679296 00000100:00100000:0.0:1788391221.203914:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103485056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391221.203924:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391221.203995:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391221.205308:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391221.363438:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391221.363545:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271104 00000100:00100000:2.0:1788391221.363563:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271104 00000100:00080000:0.0:1788391221.363797:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391221.363862:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 416 00000100:00100000:2.0:1788391221.363874:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38717:x1875263094271104:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788391221.364032:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38717:x1875263094271104:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 161us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391221.364040:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 416 00000100:00100000:2.0:1788391221.368483:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391221.369042:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271360 00000100:00100000:3.0:1788391221.369060:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271360 00000100:00100000:2.0:1788391221.369195:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:3.0:1788391221.369210:0:42648:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788391221.369219:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:38717:x1875263094271360:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391221.369228:0:42648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788391221.370195:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:38717:x1875263094271360:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 984us (1719us total) trans 30064771436 rc 0/0 00000100:00100000:2.0:1788391221.370206:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1788391221.494076:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391221.494199:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271488 00000100:00100000:1.0:1788391221.494237:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271488 00000100:00100000:1.0:1788391221.494345:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 417 00000100:00100000:1.0:1788391221.494358:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:39215:x1875263094271488:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1788391221.494386:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391221.494409:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd380c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003cf expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494479:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494492:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494502:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391221.494540:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391221.494543:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391221.494562:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494582:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd380c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494598:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391221.494605:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391221.494608:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391221.494612:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:1.0:1788391221.494698:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:39215:x1875263094271488:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 343us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391221.494704:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 417 00000100:00080000:0.0:1788391221.494758:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391221.877845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391221.877904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391221.877946:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391221.878083:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271872 00000100:00100000:0.0:1788391221.878086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391221.878096:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271872 00000100:00100000:0.0:1788391221.878112:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272000 00000100:00100000:0.0:1788391221.878115:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272000 00000100:00100000:3.0:1788391221.878176:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1788391221.878188:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094271872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391221.878196:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271744 00000100:00100000:1.0:1788391221.878200:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271744 00000100:00100000:1.0:1788391221.878246:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1788391221.878254:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094271744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391221.878295:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:2356:x1875263094271872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391221.878304:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1788391221.878343:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094271616 00000100:00100000:2.0:1788391221.878348:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094271616 00000100:00100000:2.0:1788391221.878382:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1788391221.878390:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094271616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391221.881113:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1788391221.881141:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094272000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:0.0:1788391221.881503:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391221.881511:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391221.881579:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094271744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 3322us (3671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391221.881591:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1788391221.881823:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094272000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 696us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391221.881831:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1788391221.881834:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094271616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 3443us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391221.881846:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00010000:00010000:2.0:1788391222.221512:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391223.245179:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391223.280715:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771268 is committed 00000001:00080000:0.0:1788391223.288066:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771431 is committed 00000001:00080000:0.0:1788391223.288094:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771434 is committed 00000001:00080000:0.0:1788391223.288108:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771436 is committed 00000001:02000400:0.0:1788391223.451697:0:46659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 19:20:22 (1788391222) 00010000:00010000:2.0:1788391224.270307:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391224.498203:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.498429:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272256 00000100:00100000:1.0:1788391224.498443:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272256 00000100:00100000:1.0:1788391224.498592:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 418 00000100:00100000:1.0:1788391224.498608:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+43:39501:x1875263094272256:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391224.498635:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391224.498640:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391224.498685:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd37f01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0033c expref: 43 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.498712:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391224.498718:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391224.498736:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd380d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003d6 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.499244:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.499274:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.499284:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.499333:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788391224.499343:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788391224.499351:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 5 pid: 42644 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391224.499367:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103485184:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391224.499485:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391224.503465:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.503473:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103485184:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391224.503565:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272384 00010000:00010000:1.0:1788391224.503569:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391224.503575:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272384 00010000:00010000:2.0:1788391224.503651:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 6 pid: 42644 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391224.503691:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1788391224.503703:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2357:x1875263094272384:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391224.503722:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391224.503731:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 6 pid: 42644 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503746:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 6 pid: 42644 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503773:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd380cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003cf expref: 6 pid: 42644 timeout: 1141 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503792:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391224.503797:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503807:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503820:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.503849:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391224.503867:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.503876:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.503906:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.503918:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391224.503920:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b486f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094272384:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 216us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391224.503928:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:1.0:1788391224.503949:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788391224.504235:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788391224.505924:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcc:0x0], index 0: 0 00010000:00010000:1.0:1788391224.506326:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380eb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506343:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506355:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506402:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506410:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506417:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506424:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.506430:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506438:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506450:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391224.506454:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.506468:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506474:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd380dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391224.506552:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048f4d401 reply state 00000000078df258 transno 30064771437 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391224.506564:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391224.506608:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd380d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003d6 expref: 45 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506629:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380eb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003d6 expref: 44 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.506637:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.506640:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391224.506648:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:1.0:1788391224.506812:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:39501:x1875263094272256:12345-192.168.202.1@tcp:101:dd.0 Request processed in 8207us (8621us total) trans 30064771437 rc 0/0 00000100:00100000:1.0:1788391224.506822:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 418 00010000:00010000:1.0:1788391224.510956:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511010:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511020:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511054:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.511180:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511190:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511224:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391224.511228:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.511234:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.511241:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd380e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391224.513249:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.514684:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272512 00000100:00100000:2.0:1788391224.514753:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272512 00000100:00080000:0.0:1788391224.514825:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391224.514855:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1788391224.514868:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+9:39501:x1875263094272512:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391224.514892:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.514920:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd380f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003dd expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391224.514952:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391224.514997:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=1041s v=(0 0) 00010000:00010000:2.0:1788391224.515004:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391224.515015:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd380f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003dd expref: 10 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.515362:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b31d44f/0x9aafc5f04cd380f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003dd expref: 10 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.515379:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92000, rc 0) 00000100:00100000:2.0:1788391224.515505:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:39501:x1875263094272512:12345-192.168.202.1@tcp:101:dd.0 Request processed in 639us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391224.515514:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1788391224.532557:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391224.534401:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272640 00000100:00100000:3.0:1788391224.534436:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272640 00002000:00100000:3.0:1788391224.534520:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d58c3ea300 x1875263094272640/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391224.534533:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ea300 with x1875263094272640 ext(0->1048575) 00002000:00010000:3.0:1788391224.534539:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ea300 00000100:00100000:3.0:1788391224.534585:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:3.0:1788391224.534597:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094272640:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391224.562382:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.562453:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273024 00000100:00100000:1.0:1788391224.562465:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273024 00000100:00100000:1.0:1788391224.562532:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788391224.562544:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:39501:x1875263094273024:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:0.0:1788391224.562562:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.563239:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:39501:x1875263094273024:12345-192.168.202.1@tcp:35:dd.0 Request processed in 694us (870us total) trans 30064771438 rc 0/0 00000100:00100000:1.0:1788391224.563250:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788391224.563286:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094272768 00000100:00100000:1.0:1788391224.563291:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094272768 00002000:00100000:1.0:1788391224.563324:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d58c3ebb80 x1875263094272768/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391224.563336:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ebb80 with x1875263094272768 ext(1048576->2097151) 00002000:00010000:1.0:1788391224.563356:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ebb80 00000100:00100000:1.0:1788391224.563380:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:1.0:1788391224.563389:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094272768:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:0.0:1788391224.578321:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.578443:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273152 00000100:00100000:2.0:1788391224.578456:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273152 00000100:00100000:2.0:1788391224.578632:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 419 00000100:00100000:2.0:1788391224.578652:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:39502:x1875263094273152:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391224.578684:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.578844:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003e4 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.578990:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.579012:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.579035:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391224.579085:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391224.579091:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391224.579124:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.579162:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd38100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003e4 expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.579181:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003e4 expref: 46 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.579195:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391224.579198:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391224.579202:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92800, rc 0) 00000100:00100000:2.0:1788391224.579283:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39502:x1875263094273152:12345-192.168.202.1@tcp:101:chown.0 Request processed in 637us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391224.579291:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 419 00000100:00100000:2.0:1788391224.583031:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2359:x1875263094272640:12345-192.168.202.1@tcp:4:dd.0 Request processed in 48422us (50472us total) trans 30064771201 rc 0/0 00000100:00100000:1.0:1788391224.583031:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094272768:12345-192.168.202.1@tcp:4:dd.0 Request processed in 19635us (20463us total) trans 30064771200 rc 0/0 00000100:00100000:1.0:1788391224.583048:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:2.0:1788391224.583052:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 332 00002000:00100000:2.0:1788391224.583063:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d58c3ea300 x1875263094272640/t30064771201(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/448 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391224.583063:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d58c3ebb80 x1875263094272768/t30064771200(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/448 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391224.583075:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ea300 with x1875263094272640 ext(0->1048575) 00002000:00100000:1.0:1788391224.583075:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ebb80 with x1875263094272768 ext(1048576->2097151) 00002000:00010000:2.0:1788391224.583082:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ea300 00002000:00010000:1.0:1788391224.583082:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ebb80 00000100:00100000:0.0:1788391224.583807:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.583924:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273280 00000100:00100000:2.0:1788391224.583935:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273280 00000100:00100000:2.0:1788391224.584012:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 420 00000100:00100000:2.0:1788391224.584024:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39502:x1875263094273280:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1788391224.584047:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.584073:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3810e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003eb expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585315:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd38115 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585334:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd38115 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585346:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd38115 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585461:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd3810e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003eb expref: 48 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585474:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93200/0x9aafc5f04cd38115 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003eb expref: 47 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.585482:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.585484:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391224.585487:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93200, rc 0) 00000100:00100000:2.0:1788391224.585650:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:39502:x1875263094273280:12345-192.168.202.1@tcp:101:chown.0 Request processed in 1627us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391224.585656:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 420 00000100:00100000:0.0:1788391224.587920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.587999:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273536 00000100:00100000:1.0:1788391224.588011:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273536 00000100:00100000:1.0:1788391224.588078:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 421 00000100:00100000:1.0:1788391224.588089:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:39502:x1875263094273536:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:1.0:1788391224.588157:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391224.588191:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd380eb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003d6 expref: 47 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.588241:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.588247:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391224.588287:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.588303:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.588313:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391224.588878:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].15, 88 off9344 00000004:00080000:1.0:1788391224.588892:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041695930679ns, next at 1042695928005ns, rc = 0 00000004:00010000:1.0:1788391224.589040:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d7c1fa8 reply state 00000000a91a04dd transno 30064771439 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391224.589051:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391224.589169:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39502:x1875263094273536:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1080us (1255us total) trans 30064771439 rc 0/0 00000100:00100000:1.0:1788391224.589178:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 421 00010000:00010000:2.0:1788391224.591328:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591342:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591349:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591352:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391224.591356:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591362:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591379:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.591381:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391224.591384:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.591388:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3811c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391224.596391:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.596563:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273664 00000100:00100000:1.0:1788391224.596577:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273664 00000100:00100000:1.0:1788391224.596650:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 422 00000100:00100000:1.0:1788391224.596662:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:39502:x1875263094273664:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391224.596696:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391224.596735:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38123 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003f2 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.596823:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38123 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f2 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.596842:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38123 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f2 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.596880:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.596884:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391224.596888:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:1.0:1788391224.597000:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39502:x1875263094273664:12345-192.168.202.1@tcp:101:chown.0 Request processed in 339us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391224.597008:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 422 00000100:00100000:0.0:1788391224.602075:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.602222:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094273792 00000100:00100000:2.0:1788391224.602240:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094273792 00000100:00100000:2.0:1788391224.602324:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1788391224.602337:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094273792:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:2.0:1788391224.603038:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788391224.603044:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788391224 00002000:00010000:2.0:1788391224.603047:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391224.603049:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1788391224 00002000:00010000:2.0:1788391224.603052:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391224.603158:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094273792:12345-192.168.202.1@tcp:2:chown.0 Request processed in 822us (1092us total) trans 30064771202 rc 0/0 00000100:00100000:2.0:1788391224.603168:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1788391224.660314:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391224.660523:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274048 00000100:00100000:0.0:1788391224.660538:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274048 00000100:00100000:0.0:1788391224.660613:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 423 00000100:00100000:0.0:1788391224.660626:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39508:x1875263094274048:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391224.660648:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391224.660673:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd3812a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc003f9 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660746:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660760:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660771:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660784:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660792:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660798:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660919:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd3813f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660948:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd3813f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.660955:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd3813f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391224.661603:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:0.0:1788391224.661703:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661711:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661718:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661724:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173a400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391224.661728:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661735:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661749:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391224.661752:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391224.661756:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661761:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173a400/0x9aafc5f04cd38131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661785:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661791:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661797:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661802:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c173bc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391224.661805:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661811:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661818:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391224.661820:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391224.661823:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661827:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173bc00/0x9aafc5f04cd38138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661871:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b800/0x9aafc5f04cd3812a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f9 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661884:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd3813f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f9 expref: 50 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.661902:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391224.661905:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391224.661908:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c173b400, rc 0) 00000100:00100000:0.0:1788391224.662013:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39508:x1875263094274048:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1390us (1712us total) trans 30064771440 rc 0/0 00000100:00100000:0.0:1788391224.662021:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 423 00000100:00100000:1.0:1788391224.667363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.667515:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274304 00000100:00100000:2.0:1788391224.667525:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274304 00000100:00100000:2.0:1788391224.667670:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 424 00000100:00100000:2.0:1788391224.667681:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39508:x1875263094274304:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:2.0:1788391224.667705:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.667708:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788391224.667736:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38123 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f2 expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667757:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c173b400/0x9aafc5f04cd3813f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003f9 expref: 49 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667767:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.667771:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391224.667785:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3814d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00400 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667823:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667835:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667845:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667858:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667865:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667870:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667876:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391224.667880:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667888:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667897:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.667900:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788391224.667904:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667910:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd38154 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667933:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667938:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.667943:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.668718:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00400 expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.668727:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.668730:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.668741:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd3814d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00400 expref: 51 pid: 43348 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.668758:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00400 expref: 50 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.668794:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.668797:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.668800:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92c00, rc 0) 00000100:00100000:2.0:1788391224.668919:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39508:x1875263094274304:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1239us (1564us total) trans 30064771441 rc 0/0 00000100:00100000:2.0:1788391224.668927:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 424 00000100:00100000:2.0:1788391224.680738:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.682100:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274432 00000100:00100000:1.0:1788391224.682128:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274432 00002000:00100000:1.0:1788391224.682206:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d6bc64ad80 x1875263094274432/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391224.682230:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64ad80 with x1875263094274432 ext(0->1048575) 00002000:00010000:1.0:1788391224.682237:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc64ad80 00000100:00100000:1.0:1788391224.682284:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00100000:1.0:1788391224.682297:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094274432:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391224.696656:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094274432:12345-192.168.202.1@tcp:3:dd.0 Request processed in 14342us (15914us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391224.696675:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 334 00002000:00100000:1.0:1788391224.696691:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d6bc64ad80 x1875263094274432/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/440 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391224.696703:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc64ad80 with x1875263094274432 ext(0->1048575) 00002000:00010000:1.0:1788391224.696712:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bc64ad80 00000100:00100000:2.0:1788391224.711387:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391224.713080:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274560 00000100:00100000:3.0:1788391224.713098:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274560 00002000:00100000:3.0:1788391224.713371:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d6bbcf0700 x1875263094274560/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391224.713385:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0700 with x1875263094274560 ext(1048576->2097151) 00002000:00010000:3.0:1788391224.713393:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf0700 00000100:00100000:2.0:1788391224.713467:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:2.0:1788391224.713483:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094274560:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:3.0:1788391224.726251:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094274560:12345-192.168.202.1@tcp:3:dd.0 Request processed in 12483us (14587us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391224.726271:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 335 00002000:00100000:3.0:1788391224.726290:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d6bbcf0700 x1875263094274560/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/440 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391224.726306:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0700 with x1875263094274560 ext(1048576->2097151) 00002000:00010000:3.0:1788391224.726315:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf0700 00000100:00100000:0.0:1788391224.742952:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.743038:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274816 00000100:00100000:1.0:1788391224.743053:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274816 00000100:00100000:1.0:1788391224.743139:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1788391224.743153:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39508:x1875263094274816:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391224.743475:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39508:x1875263094274816:12345-192.168.202.1@tcp:35:dd.500 Request processed in 325us (533us total) trans 30064771442 rc 0/0 00000100:00100000:1.0:1788391224.743506:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1788391224.815282:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.815483:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094274944 00000100:00100000:1.0:1788391224.815498:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094274944 00000100:00100000:1.0:1788391224.815608:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 425 00000100:00100000:1.0:1788391224.815621:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39518:x1875263094274944:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391224.815731:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815748:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815759:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815771:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815776:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815780:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815870:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815878:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815883:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391224.815956:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.815996:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816003:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816011:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816018:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.816023:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816032:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816047:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391224.816050:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.816055:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816071:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816084:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816089:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816099:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816103:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.816106:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816120:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816130:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391224.816133:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.816136:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816142:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38169 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816156:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816160:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816164:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816166:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.816168:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816179:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816185:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.816186:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.816188:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.816191:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38170 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391224.816298:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39518:x1875263094274944:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 677us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391224.816307:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 425 00000100:00100000:2.0:1788391224.838063:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.838324:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094275200 00000100:00100000:1.0:1788391224.838341:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094275200 00000100:00100000:1.0:1788391224.838523:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 426 00000100:00100000:1.0:1788391224.838536:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39519:x1875263094275200:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391224.838565:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391224.838593:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00407 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838701:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838807:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838821:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838860:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838868:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.838876:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839061:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839071:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839078:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839085:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.839089:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839099:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839122:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391224.839126:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.839132:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839139:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3817e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839164:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839171:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839177:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839183:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.839186:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839192:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839199:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391224.839202:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.839205:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839220:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839257:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38177 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00407 expref: 52 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839268:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391224.839271:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391224.839285:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd38177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00407 expref: 52 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.839296:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:1.0:1788391224.839610:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39519:x1875263094275200:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1075us (1558us total) trans 0 rc 301/301 00000100:00100000:1.0:1788391224.839619:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 426 00000100:00100000:2.0:1788391224.842081:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391224.842148:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094275328 00000100:00100000:0.0:1788391224.842162:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094275328 00000100:00100000:0.0:1788391224.842296:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 427 00000100:00100000:0.0:1788391224.842308:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39519:x1875263094275328:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391224.842403:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842421:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842435:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842452:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842460:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842467:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842577:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842584:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842589:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391224.842621:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00000004:00200000:0.0:1788391224.842625:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391224.842638:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842649:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842654:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842659:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842663:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391224.842666:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842671:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842680:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391224.842687:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391224.842691:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842696:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3818c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842708:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842714:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842720:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842725:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391224.842728:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842734:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842741:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391224.842744:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391224.842746:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842751:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842767:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842779:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842785:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842789:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391224.842792:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842797:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842805:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391224.842807:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391224.842810:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391224.842816:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3819a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391224.842888:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39519:x1875263094275328:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 582us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391224.842897:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 427 00000100:00100000:0.0:1788391224.885703:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.885792:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094275584 00000100:00100000:2.0:1788391224.885806:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094275584 00000100:00100000:2.0:1788391224.885889:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 428 00000100:00100000:2.0:1788391224.885902:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:39525:x1875263094275584:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391224.885929:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.885932:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788391224.886003:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc003e4 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886027:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391224.886039:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391224.886058:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd381a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0040e expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886474:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886489:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886499:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886511:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886517:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886524:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886603:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd381b6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886612:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd381b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886620:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd381b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391224.886631:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:2.0:1788391224.886827:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886841:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886848:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886855:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391224.886860:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886868:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886877:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391224.886880:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391224.886885:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886891:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93e00/0x9aafc5f04cd381a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886903:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886908:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886915:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886921:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391224.886925:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886932:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886939:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391224.886941:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391224.886944:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.886950:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd381af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.887040:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92200/0x9aafc5f04cd381a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0040e expref: 53 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.887056:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd381b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0040e expref: 52 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.887233:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.887236:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391224.887239:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92600, rc 0) 00000100:00100000:2.0:1788391224.887321:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:39525:x1875263094275584:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1420us (1627us total) trans 30064771443 rc 0/0 00000100:00100000:2.0:1788391224.887330:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 428 00000100:00100000:2.0:1788391224.889544:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.889625:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094275840 00000100:00100000:1.0:1788391224.889638:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094275840 00000100:00100000:1.0:1788391224.889697:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 429 00000100:00100000:1.0:1788391224.889719:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:39525:x1875263094275840:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:1.0:1788391224.889786:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391224.889812:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92c00/0x9aafc5f04cd3815b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00400 expref: 52 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.889831:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92600/0x9aafc5f04cd381b6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0040e expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.889838:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.889841:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391224.890401:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.890418:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.890429:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391224.890505:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771444 00000004:00010000:1.0:1788391224.890526:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d093b02a reply state 0000000005ab82e4 transno 30064771445 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391224.890533:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391224.890632:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:39525:x1875263094275840:12345-192.168.202.1@tcp:36:dd.0 Request processed in 924us (1094us total) trans 30064771445 rc 0/0 00000100:00100000:1.0:1788391224.890641:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 429 00000020:00080000:1.0:1788391224.890646:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391224.892685:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892705:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892712:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892718:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391224.892724:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892732:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892753:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.892756:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391224.892761:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.892791:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381c4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391224.893243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.893308:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094275968 00000100:00100000:1.0:1788391224.893319:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094275968 00000100:00100000:1.0:1788391224.893389:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 430 00000100:00100000:1.0:1788391224.893400:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:39525:x1875263094275968:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391224.893430:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391224.893450:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd381cb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00415 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.893523:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd381cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00415 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.893540:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd381cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00415 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.893561:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.893565:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391224.893568:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1e00, rc 0) 00000100:00100000:1.0:1788391224.893697:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:39525:x1875263094275968:12345-192.168.202.1@tcp:101:dd.0 Request processed in 298us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391224.893705:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 430 00000100:00100000:0.0:1788391224.895337:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.895432:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276224 00000100:00100000:2.0:1788391224.895444:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276224 00000100:00100000:2.0:1788391224.895503:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 431 00000100:00100000:2.0:1788391224.895513:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:39525:x1875263094276224:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1788391224.895534:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391224.895538:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788391224.895568:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd381cb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00415 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895587:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.895592:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391224.895604:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd381d2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0041c expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895653:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895666:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895675:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895890:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0041c expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895898:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.895901:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.895910:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93c00/0x9aafc5f04cd381d2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0041c expref: 55 pid: 42646 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895923:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0041c expref: 54 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.895945:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.895948:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.895951:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a93000, rc 0) 00000100:00100000:2.0:1788391224.896033:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:39525:x1875263094276224:12345-192.168.202.1@tcp:101:dd.0 Request processed in 521us (705us total) trans 30064771446 rc 0/0 00000100:00100000:2.0:1788391224.896040:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 431 00000100:00100000:0.0:1788391224.906204:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.906346:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276480 00000100:00100000:1.0:1788391224.906359:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276480 00000100:00100000:1.0:1788391224.906430:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 432 00000100:00100000:1.0:1788391224.906442:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:39525:x1875263094276480:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391224.906497:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391224.906500:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391224.906531:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93000/0x9aafc5f04cd381d9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0041c expref: 54 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.906550:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391224.906554:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391224.906566:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381e0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00423 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.906620:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.906633:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391224.906640:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391224.907129:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].16, 88 off9432 00000004:00080000:1.0:1788391224.907140:0:42644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1042014178367ns, next at 1042695928005ns, rc = 0 00000001:00080000:3.0:1788391224.934623:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771440 is committed 00000001:00080000:3.0:1788391224.934648:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771447 is committed 00000004:00080000:3.0:1788391224.934668:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000004:00080000:3.0:1788391224.934700:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000100:00100000:1.0:1788391224.934858:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391224.934883:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391224.934997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391224.935088:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485312 00000100:00100000:1.0:1788391224.935097:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485312 00000100:00100000:1.0:1788391224.935298:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391224.935309:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103485312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788391224.935526:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1788391224.935541:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788391224 -> 1788391224 00002000:00010000:1.0:1788391224.935544:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391224.935547:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788391224 -> 1788391224 00002000:00010000:1.0:1788391224.935550:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391224.935599:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103485312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (602us total) trans 30064771203 rc 0/0 00000100:00100000:1.0:1788391224.935608:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788391224.935633:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788391224.935674:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58b179500/2, rc 0, transno 30064771203 00000100:00100000:1.0:1788391224.935686:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391224.935734:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103485440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391224.935763:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391224.935800:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485440 00000100:00100000:1.0:1788391224.935804:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485440 00000100:00100000:1.0:1788391224.935828:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788391224.935834:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103485440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788391224.935944:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1788391224.935948:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788391224 -> 1788391224 00002000:00010000:1.0:1788391224.935951:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391224.935953:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788391224 -> 1788391224 00002000:00010000:1.0:1788391224.935956:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391224.936011:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103485440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (246us total) trans 30064771204 rc 0/0 00000100:00100000:1.0:1788391224.936018:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000004:00080000:1.0:1788391224.936047:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58b178000/2, rc 0, transno 30064771204 00000100:00100000:1.0:1788391224.936052:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103485440:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788391224.936450:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00423 expref: 45 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.936466:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.936469:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.936491:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd381e0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00423 expref: 45 pid: 42644 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.936513:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00423 expref: 44 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391224.936552:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391224.936555:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788391224.936558:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:2.0:1788391224.936667:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:39525:x1875263094276480:12345-192.168.202.1@tcp:101:dd.0 Request processed in 30227us (30477us total) trans 30064771447 rc 0/0 00000100:00100000:2.0:1788391224.936676:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 432 00000100:00100000:0.0:1788391224.939698:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391224.939748:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276608 00000100:00100000:1.0:1788391224.939760:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276608 00002000:00010000:1.0:1788391224.939808:0:43331:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:1.0:1788391224.939812:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc6d80 with x1875263094276608 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391224.939825:0:43331:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc6d80. 00000100:00100000:1.0:1788391224.939855:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 336 00000100:00100000:1.0:1788391224.939864:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094276608:12345-192.168.202.1@tcp:10:dd.0 00002000:00010000:1.0:1788391224.940876:0:43331:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:1.0:1788391224.940883:0:43331:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788391224 -> 1788391225 00002000:00010000:1.0:1788391224.940886:0:43331:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391224.940889:0:43331:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788391224 -> 1788391225 00002000:00010000:1.0:1788391224.940891:0:43331:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391224.943184:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2358:x1875263094276608:12345-192.168.202.1@tcp:10:dd.0 Request processed in 3179us (3354us total) trans 30064771205 rc 0/0 00000100:00100000:1.0:1788391224.943206:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 336 00002000:00010000:1.0:1788391224.943223:0:43331:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:1.0:1788391224.943227:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc6d80 with x1875263094276608 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391224.943241:0:43331:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc6d80. 00000100:00100000:0.0:1788391224.965310:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391224.966277:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276736 00000100:00100000:2.0:1788391224.966294:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276736 00002000:00100000:2.0:1788391224.966369:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d685dc7100 x1875263094276736/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391224.966383:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7100 with x1875263094276736 ext(0->1048575) 00002000:00010000:2.0:1788391224.966390:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc7100 00000100:00100000:2.0:1788391224.966424:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:2.0:1788391224.966435:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2359:x1875263094276736:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391224.980326:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2359:x1875263094276736:12345-192.168.202.1@tcp:4:dd.0 Request processed in 13877us (15205us total) trans 30064771206 rc 0/0 00000100:00100000:1.0:1788391224.980343:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 337 00002000:00100000:1.0:1788391224.980360:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d685dc7100 x1875263094276736/t30064771206(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/448 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391224.980370:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7100 with x1875263094276736 ext(0->1048575) 00002000:00010000:1.0:1788391224.980377:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc7100 00000100:00100000:0.0:1788391224.992525:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391224.992650:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276864 00000100:00100000:3.0:1788391224.992662:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276864 00002000:00100000:3.0:1788391224.992721:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d685dc5180 x1875263094276864/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/0 e 0 to 0 dl 1788391235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391224.992734:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5180 with x1875263094276864 ext(1048576->2097151) 00002000:00010000:3.0:1788391224.992741:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5180 00000100:00100000:3.0:1788391224.992784:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 338 00000100:00100000:3.0:1788391224.992794:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2358:x1875263094276864:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391225.007757:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2358:x1875263094276864:12345-192.168.202.1@tcp:4:dd.0 Request processed in 14947us (15229us total) trans 30064771207 rc 0/0 00000100:00100000:3.0:1788391225.007775:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 338 00002000:00100000:3.0:1788391225.007791:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d685dc5180 x1875263094276864/t30064771207(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:85/0 lens 488/448 e 0 to 0 dl 1788391235 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.007802:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5180 with x1875263094276864 ext(1048576->2097151) 00002000:00010000:3.0:1788391225.007810:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5180 00000100:00100000:2.0:1788391225.011840:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.011919:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094276992 00000100:00100000:1.0:1788391225.011932:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094276992 00002000:00100000:1.0:1788391225.012528:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff95d6bbcf0a80 x1875263094276992/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.012545:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263094276992 ext(2097152->3145727) 00002000:00010000:1.0:1788391225.012552:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:1.0:1788391225.012606:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 339 00000100:00100000:1.0:1788391225.012619:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+20:2359:x1875263094276992:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391225.022324:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2359:x1875263094276992:12345-192.168.202.1@tcp:4:dd.0 Request processed in 9690us (10477us total) trans 30064771208 rc 0/0 00000100:00100000:1.0:1788391225.022344:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 339 00002000:00100000:1.0:1788391225.022361:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff95d6bbcf0a80 x1875263094276992/t30064771208(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/448 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.022374:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf0a80 with x1875263094276992 ext(2097152->3145727) 00002000:00010000:1.0:1788391225.022381:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf0a80 00000100:00100000:2.0:1788391225.028100:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391225.028461:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094277120 00000100:00100000:3.0:1788391225.028475:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094277120 00002000:00100000:3.0:1788391225.028541:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff95d6bbcf2300 x1875263094277120/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.028555:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf2300 with x1875263094277120 ext(3145728->4194303) 00002000:00010000:3.0:1788391225.028563:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf2300 00000100:00100000:3.0:1788391225.028604:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 340 00000100:00100000:3.0:1788391225.028615:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+22:2357:x1875263094277120:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391225.035931:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2357:x1875263094277120:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7300us (7830us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1788391225.035949:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 340 00002000:00100000:1.0:1788391225.035998:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff95d6bbcf2300 x1875263094277120/t30064771209(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/448 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.036011:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf2300 with x1875263094277120 ext(3145728->4194303) 00002000:00010000:1.0:1788391225.036019:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf2300 00000100:00100000:3.0:1788391225.040788:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391225.041105:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.041280:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094277248 00000100:00100000:2.0:1788391225.041292:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094277248 00002000:00100000:2.0:1788391225.041355:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff95d58c3ed180 x1875263094277248/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391225.041369:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ed180 with x1875263094277248 ext(4194304->5242879) 00002000:00010000:2.0:1788391225.041375:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ed180 00000100:00100000:2.0:1788391225.041416:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 341 00000100:00100000:2.0:1788391225.041427:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+24:2356:x1875263094277248:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391225.042000:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094277504 00000100:00100000:1.0:1788391225.042009:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094277504 00000100:00100000:1.0:1788391225.042118:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1788391225.042128:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+44:39525:x1875263094277504:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:1.0:1788391225.042586:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:39525:x1875263094277504:12345-192.168.202.1@tcp:35:dd.0 Request processed in 457us (1809us total) trans 30064771448 rc 0/0 00000100:00100000:1.0:1788391225.042595:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788391225.048343:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2356:x1875263094277248:12345-192.168.202.1@tcp:4:dd.0 Request processed in 6902us (7223us total) trans 30064771210 rc 0/0 00000100:00100000:2.0:1788391225.048359:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 341 00002000:00100000:2.0:1788391225.048373:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff95d58c3ed180 x1875263094277248/t30064771210(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/448 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391225.048386:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58c3ed180 with x1875263094277248 ext(4194304->5242879) 00002000:00010000:2.0:1788391225.048394:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58c3ed180 00000100:00100000:3.0:1788391225.095488:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.095617:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094277632 00000100:00100000:2.0:1788391225.095629:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094277632 00000100:00100000:2.0:1788391225.095806:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 433 00000100:00100000:2.0:1788391225.095821:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+45:39535:x1875263094277632:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391225.095853:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391225.095882:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd381ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0042a expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096119:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096136:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096149:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391225.096194:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391225.096199:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391225.096235:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096260:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93600/0x9aafc5f04cd381ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0042a expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096280:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0042a expref: 46 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.096290:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391225.096293:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391225.096298:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6a6a92400, rc 0) 00000100:00100000:2.0:1788391225.096401:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39535:x1875263094277632:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 583us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391225.096411:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 433 00000100:00100000:1.0:1788391225.098526:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.098764:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094277760 00000100:00100000:2.0:1788391225.098778:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094277760 00000100:00100000:2.0:1788391225.098891:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 434 00000100:00100000:2.0:1788391225.098902:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39535:x1875263094277760:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391225.099018:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099037:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099050:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099083:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099091:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099099:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099484:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099495:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099503:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391225.099559:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099575:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099582:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099590:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099596:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a93800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.099601:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099609:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099622:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391225.099625:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.099631:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099637:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a93800/0x9aafc5f04cd381fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099650:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099656:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099664:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099669:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.099672:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099678:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099686:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391225.099688:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.099691:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099697:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92800/0x9aafc5f04cd38203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099722:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099728:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099734:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099738:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6a6a92a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.099740:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099749:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099755:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391225.099757:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.099760:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.099765:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92a00/0x9aafc5f04cd3820a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391225.099853:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39535:x1875263094277760:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 951us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391225.099861:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 434 00000100:00100000:1.0:1788391225.157242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391225.157500:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278016 00000100:00100000:0.0:1788391225.157511:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278016 00000100:00100000:0.0:1788391225.157573:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 435 00000100:00100000:0.0:1788391225.157582:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+46:39541:x1875263094278016:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391225.157606:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391225.157627:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00431 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157707:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157723:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157738:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157755:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157762:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.157767:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158133:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38226 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158140:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38226 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158155:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38226 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391225.158165:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:0.0:1788391225.158296:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158305:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158312:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158318:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391225.158323:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158331:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158345:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391225.158348:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391225.158353:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158359:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158371:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158386:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158392:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158396:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391225.158400:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158406:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158412:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391225.158414:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391225.158416:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158421:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3821f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158466:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00431 expref: 49 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158479:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38226 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00431 expref: 48 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.158486:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391225.158488:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391225.158495:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:0.0:1788391225.158571:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39541:x1875263094278016:12345-192.168.202.1@tcp:101:dd.500 Request processed in 989us (1342us total) trans 30064771449 rc 0/0 00000100:00100000:0.0:1788391225.158579:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 435 00000100:00100000:3.0:1788391225.162609:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.162692:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278272 00000100:00100000:1.0:1788391225.162715:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278272 00000100:00100000:1.0:1788391225.162797:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 436 00000100:00100000:1.0:1788391225.162810:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39541:x1875263094278272:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391225.162842:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391225.162846:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788391225.162883:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd381e7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00423 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.162908:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38226 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00431 expref: 47 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.162921:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.162926:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391225.162943:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38234 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00438 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163056:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163434:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163465:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163483:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163489:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163497:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163502:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.163507:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163514:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163524:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.163527:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391225.163530:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163536:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd3823b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163566:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd38242 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163574:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd38242 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163587:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd38242 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163876:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd38242 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00438 expref: 49 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163884:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.163887:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391225.163900:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38234 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00438 expref: 49 pid: 42644 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163915:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0200/0x9aafc5f04cd38242 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00438 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.163947:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.163950:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391225.163953:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0200, rc 0) 00000100:00100000:1.0:1788391225.169571:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39541:x1875263094278272:12345-192.168.202.1@tcp:101:dd.500 Request processed in 6749us (6961us total) trans 30064771450 rc 0/0 00000100:00100000:1.0:1788391225.169588:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 436 00000100:00100000:1.0:1788391225.178714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.178797:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278400 00000100:00100000:2.0:1788391225.178811:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278400 00002000:00100000:2.0:1788391225.178884:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d58b147800 x1875263094278400/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391225.178896:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b147800 with x1875263094278400 ext(0->1048575) 00002000:00010000:2.0:1788391225.178903:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b147800 00000100:00100000:2.0:1788391225.178944:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 342 00000100:00100000:2.0:1788391225.178955:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094278400:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:2.0:1788391225.192008:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094278400:12345-192.168.202.1@tcp:3:dd.0 Request processed in 13044us (13300us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391225.192022:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 342 00002000:00100000:2.0:1788391225.192035:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff95d58b147800 x1875263094278400/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/440 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391225.192046:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b147800 with x1875263094278400 ext(0->1048575) 00002000:00010000:2.0:1788391225.192054:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b147800 00000100:00100000:2.0:1788391225.214721:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.214992:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278528 00000100:00100000:1.0:1788391225.215002:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278528 00002000:00100000:1.0:1788391225.215067:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d6bbcf3800 x1875263094278528/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.215080:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf3800 with x1875263094278528 ext(1048576->2097151) 00002000:00010000:1.0:1788391225.215086:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf3800 00000100:00100000:1.0:1788391225.215139:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 343 00000100:00100000:1.0:1788391225.215149:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094278528:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391225.231133:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2358:x1875263094278528:12345-192.168.202.1@tcp:3:dd.0 Request processed in 15974us (16411us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391225.231147:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 343 00002000:00100000:1.0:1788391225.231160:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff95d6bbcf3800 x1875263094278528/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/440 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.231340:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bbcf3800 with x1875263094278528 ext(1048576->2097151) 00002000:00010000:1.0:1788391225.231347:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d6bbcf3800 00000100:00100000:0.0:1788391225.263125:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391225.263597:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278784 00000100:00100000:3.0:1788391225.263607:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278784 00000100:00100000:0.0:1788391225.263760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00002000:00100000:3.0:1788391225.263935:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff95d685dc5f80 x1875263094278784/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.263947:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5f80 with x1875263094278784 ext(3145728->4194303) 00002000:00010000:3.0:1788391225.263953:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5f80 00000100:00100000:3.0:1788391225.264043:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278656 00000100:00100000:3.0:1788391225.264047:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278656 00002000:00100000:3.0:1788391225.264064:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff95d685dc7b80 x1875263094278656/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.264072:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7b80 with x1875263094278656 ext(2097152->3145727) 00002000:00010000:3.0:1788391225.264075:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc7b80 00000100:00100000:1.0:1788391225.264231:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 344 00000100:00100000:1.0:1788391225.264243:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2359:x1875263094278784:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:3.0:1788391225.265009:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 345 00000100:00100000:3.0:1788391225.265020:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094278656:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391225.279718:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+28:2359:x1875263094278784:12345-192.168.202.1@tcp:3:dd.0 Request processed in 15466us (19087us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391225.279732:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 344 00002000:00100000:1.0:1788391225.279745:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff95d685dc5f80 x1875263094278784/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/440 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.279755:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc5f80 with x1875263094278784 ext(3145728->4194303) 00002000:00010000:1.0:1788391225.279762:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc5f80 00000100:00100000:3.0:1788391225.281760:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094278656:12345-192.168.202.1@tcp:3:dd.0 Request processed in 16733us (17991us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788391225.281773:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 345 00002000:00100000:3.0:1788391225.281785:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff95d685dc7b80 x1875263094278656/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/440 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.281796:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7b80 with x1875263094278656 ext(2097152->3145727) 00002000:00010000:3.0:1788391225.281813:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d685dc7b80 00000100:00100000:0.0:1788391225.293586:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391225.293766:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391225.293835:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391225.293887:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391225.293894:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103485952:0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.293922:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391225.293991:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486080 00000100:00100000:1.0:1788391225.293998:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486080 00000100:00100000:1.0:1788391225.294056:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788391225.294065:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103486080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391225.294099:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3718250496 avail 3716153344 00000100:00100000:1.0:1788391225.294143:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103486080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.294151:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788391225.294175:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391225.294199:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771268 gen 2 00000004:00080000:1.0:1788391225.294216:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d6bc649c00, transno 30064771268 00000100:00100000:1.0:1788391225.294233:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391225.294561:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485696:0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294590:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391225.294612:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391225.294618:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103485824:0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391225.294668:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485952 00000100:00100000:1.0:1788391225.294672:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485952 00000100:00100000:1.0:1788391225.294705:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485824 00000100:00100000:1.0:1788391225.294708:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485824 00000100:00100000:1.0:1788391225.294727:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788391225.294733:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103485952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294771:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103485952:12345-0@lo:400:kworker.0 Request processed in 38us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.294778:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788391225.294791:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788391225.294805:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103485824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294838:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103485824:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.294845:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788391225.294859:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391225.294877:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103485952:0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294899:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103485824:0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.294932:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485696 00000100:00100000:1.0:1788391225.294935:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485696 00000100:00100000:1.0:1788391225.294975:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788391225.294982:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.295014:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103485696:12345-0@lo:400:kworker.0 Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.295020:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788391225.295041:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788391225.295447:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788391225.295479:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391225.295574:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103485568 00000100:00100000:1.0:1788391225.295579:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103485568 00000100:00100000:1.0:1788391225.295649:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788391225.295657:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103485568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391225.295693:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103485568:12345-0@lo:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.295699:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00010000:2.0:1788391225.295820:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391225.295832:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ac65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103486208:0@lo:400:kworker.0 00000100:00100000:2.0:1788391225.295859:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391225.296103:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788391225.296126:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486208 00000100:00100000:0.0:1788391225.296129:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486208 00000100:00100000:0.0:1788391225.296506:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788391225.296515:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103486208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391225.296567:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103486208:12345-0@lo:400:kworker.0 Request processed in 54us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391225.296574:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788391225.296631:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ac65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103486208:0@lo:400:kworker.0 00000100:00080000:2.0:1788391225.296673:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391225.309305:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391225.309408:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094278912 00000100:00100000:3.0:1788391225.309416:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094278912 00002000:00100000:3.0:1788391225.309458:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff95d58ac65880 x1875263094278912/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/0 e 0 to 0 dl 1788391236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391225.309466:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65880 with x1875263094278912 ext(4194304->5242879) 00002000:00010000:3.0:1788391225.309469:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ac65880 00000100:00100000:3.0:1788391225.309494:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 346 00000100:00100000:3.0:1788391225.309501:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094278912:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391225.316142:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2359:x1875263094278912:12345-192.168.202.1@tcp:3:dd.0 Request processed in 6631us (6834us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391225.316181:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 346 00002000:00100000:1.0:1788391225.316195:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff95d58ac65880 x1875263094278912/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:86/0 lens 488/440 e 0 to 0 dl 1788391236 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391225.316213:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58ac65880 with x1875263094278912 ext(4194304->5242879) 00002000:00010000:1.0:1788391225.316219:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58ac65880 00000100:00100000:3.0:1788391225.339818:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.339919:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094279168 00000100:00100000:1.0:1788391225.339928:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094279168 00000100:00100000:1.0:1788391225.340112:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1788391225.340123:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:39541:x1875263094279168:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391225.340395:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39541:x1875263094279168:12345-192.168.202.1@tcp:35:dd.500 Request processed in 273us (583us total) trans 30064771451 rc 0/0 00000100:00100000:1.0:1788391225.340403:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788391225.383511:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.384249:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094279296 00000100:00100000:1.0:1788391225.384260:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094279296 00000100:00100000:1.0:1788391225.384323:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 437 00000100:00100000:1.0:1788391225.384334:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39547:x1875263094279296:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391225.384409:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384426:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384438:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384452:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384474:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384481:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384815:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384827:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384834:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391225.384872:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384884:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384891:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384897:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384902:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.384906:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384913:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384930:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391225.384933:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391225.384938:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384944:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd38249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.384956:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385007:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385014:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385019:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.385022:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385027:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385034:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391225.385036:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391225.385039:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385044:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385067:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385073:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385078:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385082:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.385085:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385091:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385098:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.385100:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391225.385103:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.385109:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd38257 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391225.385519:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39547:x1875263094279296:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1183us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391225.385527:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 437 00000100:00100000:3.0:1788391225.407832:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.407946:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094279552 00000100:00100000:1.0:1788391225.407980:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094279552 00000100:00100000:1.0:1788391225.408042:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 438 00000100:00100000:1.0:1788391225.408066:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39548:x1875263094279552:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391225.408087:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391225.408106:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3825e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0043f expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408191:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408215:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408228:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408243:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408250:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.408255:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409061:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409070:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409075:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409085:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc0400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.409089:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409094:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.409105:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391225.409107:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391225.409110:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410300:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd38265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410323:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410329:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410335:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410341:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d68fcc1600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391225.410345:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410352:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410384:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6a0d29900) 00010000:00010000:1.0:1788391225.410387:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391225.410390:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410396:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd3826c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410449:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3825e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0043f expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410471:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391225.410473:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391225.410477:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3825e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0043f expref: 50 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.410486:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:1.0:1788391225.410565:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39548:x1875263094279552:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2500us (2743us total) trans 0 rc 301/301 00000100:00100000:1.0:1788391225.410573:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 438 00000100:00100000:3.0:1788391225.413950:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.414803:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094279680 00000100:00100000:2.0:1788391225.414814:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094279680 00000100:00100000:2.0:1788391225.414918:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 439 00000100:00100000:2.0:1788391225.414928:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39548:x1875263094279680:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1788391225.415012:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415027:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415038:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415052:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415058:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415063:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415349:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415358:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415365:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391225.415396:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1788391225.415402:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391225.415414:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415425:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415432:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415438:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415444:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a4200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.415449:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415456:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415468:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391225.415471:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.415475:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415482:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415493:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415499:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415505:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415510:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a4a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.415512:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415518:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415525:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391225.415527:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.415530:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415535:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3827a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415547:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415554:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415559:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415564:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a5800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.415567:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415572:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415579:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391225.415581:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.415584:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.415590:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38281 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391225.415676:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39548:x1875263094279680:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 749us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391225.415685:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 439 00000100:00100000:0.0:1788391225.458177:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.464611:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094279808 00000100:00100000:2.0:1788391225.464625:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094279808 00000100:00100000:2.0:1788391225.464769:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 440 00000100:00100000:2.0:1788391225.464780:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:39554:x1875263094279808:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391225.464801:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391225.464823:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00446 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464880:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464891:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464902:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464916:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464923:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.464930:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465197:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465225:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465233:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391225.465267:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1788391225.465271:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391225.465768:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465779:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465785:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465789:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465793:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465797:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a4a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.465800:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465804:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465814:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:2.0:1788391225.465816:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.465819:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465822:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4a00/0x9aafc5f04cd3828f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465831:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465834:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465838:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465841:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a4200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391225.465843:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465846:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465849:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391225.465851:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391225.465852:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465855:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4200/0x9aafc5f04cd38296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465877:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a5800/0x9aafc5f04cd38288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465885:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 50 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391225.465889:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:2.0:1788391225.465891:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391225.465893:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d1a4c00, rc 0) 00000100:00100000:2.0:1788391225.465950:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39554:x1875263094279808:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1173us (7783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391225.465957:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 440 00000100:00100000:3.0:1788391225.468496:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.468589:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280064 00000100:00100000:1.0:1788391225.468597:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280064 00000100:00100000:1.0:1788391225.468639:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 441 00000100:00100000:1.0:1788391225.468648:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:39554:x1875263094280064:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391225.468669:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391225.468687:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd382a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0044d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.468806:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd382ab lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.468821:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd382ab lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.468832:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd382ab lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391225.468842:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:1.0:1788391225.469062:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd382a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0044d expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.469083:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1600/0x9aafc5f04cd382ab lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0044d expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.469091:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.469094:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788391225.469098:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1600, rc 0) 00000100:00100000:1.0:1788391225.469155:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:39554:x1875263094280064:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 496us (657us total) trans 30064771452 rc 0/0 00000100:00100000:1.0:1788391225.469163:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 441 00000100:00100000:3.0:1788391225.569092:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391225.569273:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280320 00000100:00100000:1.0:1788391225.569284:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280320 00000100:00100000:1.0:1788391225.569356:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 442 00000100:00100000:1.0:1788391225.569368:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:39560:x1875263094280320:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391225.569392:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391225.569428:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd382b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00454 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.569525:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.569541:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 53 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.569550:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.569662:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 53 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.569677:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 53 pid: 42646 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391225.569690:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103486336:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391225.570101:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391225.575154:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103486336:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391225.575252:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391225.575322:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280448 00010000:00010000:1.0:1788391225.575323:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391225.575331:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280448 00010000:00010000:2.0:1788391225.575383:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 54 pid: 42646 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391225.575513:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:0.0:1788391225.575526:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2356:x1875263094280448:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391225.575547:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391225.575555:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 54 pid: 42646 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575569:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 54 pid: 42646 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575606:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd3829d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00446 expref: 54 pid: 42646 timeout: 1142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575622:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:0.0:1788391225.575627:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575636:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575644:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391225.575667:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391225.575715:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094280448:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391225.575722:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00010000:00010000:1.0:1788391225.575759:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.575769:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391225.575800:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:1.0:1788391225.575988:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd382b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00454 expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.576007:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0400/0x9aafc5f04cd382c0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00454 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391225.576015:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff95d6a0d29600) 00010000:00010000:1.0:1788391225.576018:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788391225.576021:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0400, rc 0) 00000100:00100000:1.0:1788391225.576069:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:39560:x1875263094280320:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6695us (6979us total) trans 30064771453 rc 0/0 00000100:00100000:1.0:1788391225.576077:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 442 00000100:00100000:1.0:1788391226.317093:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391226.317240:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103486464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391226.317308:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391226.317355:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486464 00000100:00100000:0.0:1788391226.317363:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486464 00000100:00100000:0.0:1788391226.317429:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788391226.317440:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103486464:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788391226.317458:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788391226.317476:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 228261888 pending 11927552 free 3772776448 avail 3770679296 00000100:00100000:0.0:1788391226.317573:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103486464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391226.317582:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788391226.317759:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103486464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788391226.318348:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391227.002527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391227.002631:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391227.002668:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391227.002705:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391227.002729:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391227.003028:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280576 00000100:00100000:2.0:1788391227.003039:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280576 00000100:00100000:2.0:1788391227.003235:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1788391227.003413:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094280576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391227.003551:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094280576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 305us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391227.003559:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1788391227.004281:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280832 00000100:00100000:1.0:1788391227.004290:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280832 00000100:00100000:1.0:1788391227.004341:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280960 00000100:00100000:1.0:1788391227.004344:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280960 00000100:00100000:1.0:1788391227.004375:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1788391227.004384:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2356:x1875263094280832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391227.004424:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+26:2356:x1875263094280832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391227.004449:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1788391227.004463:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788391227.004469:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094280960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391227.004495:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094280960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391227.004502:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1788391227.004522:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281088 00000100:00100000:1.0:1788391227.004526:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281088 00000100:00100000:1.0:1788391227.004553:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094280704 00000100:00100000:1.0:1788391227.004556:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094280704 00000100:00100000:1.0:1788391227.004575:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788391227.004581:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094281088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391227.004608:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094281088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391227.004615:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788391227.004626:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:1.0:1788391227.004632:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094280704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391227.004659:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2356:x1875263094280704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391227.004666:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00080000:1.0:1788391227.004685:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391227.004689:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391227.004691:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391227.341182:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391228.369104:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391228.815625:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391228.816689:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281216 00000100:00100000:1.0:1788391228.816699:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281216 00000100:00100000:1.0:1788391228.816803:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 443 00000100:00100000:1.0:1788391228.816810:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:39989:x1875263094281216:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1788391228.816829:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391228.816846:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd382ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0045b expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.816894:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.816904:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.816913:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391228.816941:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391228.816943:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391228.816989:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.817012:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd382ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 7 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.817029:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 6 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391228.817038:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391228.817041:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391228.817044:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:1.0:1788391228.817096:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:39989:x1875263094281216:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 286us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391228.817109:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 443 00010000:00010000:2.0:1788391229.389127:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391229.419567:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771209 is committed 00000001:00080000:0.0:1788391229.419603:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771204 is committed 00000001:00080000:0.0:1788391229.419614:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771210 is committed 00000100:00100000:1.0:1788391230.413253:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391230.413360:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391230.413479:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486592 00000100:00100000:1.0:1788391230.413489:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486592 00000100:00100000:1.0:1788391230.413643:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788391230.413657:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103486592:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788391230.413786:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788391230.414764:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788391230.414816:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3718250496 avail 3716153344 00000100:00100000:0.0:1788391230.414918:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103486592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1260us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391230.414929:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788391230.415019:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391230.418939:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103486720:0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.419090:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103486848:0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.419194:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391230.419254:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391230.419380:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103486976:0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.419418:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391230.419455:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486848 00000100:00100000:1.0:1788391230.419465:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486848 00000100:00100000:1.0:1788391230.419551:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788391230.419563:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103486848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.419625:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103486848:12345-0@lo:400:kworker.0 Request processed in 64us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391230.419633:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788391230.419666:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486976 00000100:00100000:1.0:1788391230.419670:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486976 00000100:00100000:1.0:1788391230.419843:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788391230.419855:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103486976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.419907:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103486976:12345-0@lo:400:kworker.0 Request processed in 57us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391230.419930:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788391230.420096:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103486976:0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.420118:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771204 gen 2 00000004:00080000:1.0:1788391230.420126:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58b179500, transno 30064771203 00000004:00080000:1.0:1788391230.420137:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58b178000, transno 30064771204 00000100:00100000:1.0:1788391230.420142:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691119f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103486848:0@lo:400:kworker.0 00000100:00080000:3.0:1788391230.420513:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391230.421054:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103487104:0@lo:400:kworker.0 00000100:00100000:2.0:1788391230.421130:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391230.421191:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391230.421199:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788391230.421225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391230.421256:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103487104 00000100:00100000:2.0:1788391230.421263:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103487104 00000100:00100000:2.0:1788391230.421307:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103487232 00000100:00100000:2.0:1788391230.421311:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103487232 00000100:00100000:2.0:1788391230.421336:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788391230.421591:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391230.421615:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103487104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.421651:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103486720 00000100:00100000:1.0:1788391230.421656:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103486720 00000100:00100000:2.0:1788391230.421684:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103487104:12345-0@lo:400:kworker.0 Request processed in 75us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391230.421696:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788391230.421697:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788391230.421708:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103486720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391230.421724:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788391230.421734:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103487232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391230.421761:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103486720:12345-0@lo:400:kworker.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391230.421770:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788391230.421788:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103487232:12345-0@lo:400:kworker.0 Request processed in 55us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391230.421796:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788391230.421846:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103486720:0@lo:400:kworker.0 00000100:00100000:2.0:1788391230.421868:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788391230.421887:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103487104:0@lo:400:kworker.0 00000100:00080000:3.0:1788391230.422712:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788391230.482811:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771449 is committed 00000001:00080000:3.0:1788391230.482833:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771453 is committed 00000001:02000400:1.0:1788391230.685852:0:46857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 19:20:30 (1788391230) 00000040:00080000:3.0:1788391231.245353:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391231.245363:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391231.245653:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:3.0:1788391231.245669:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391231.437143:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391231.437430:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103487360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391231.437500:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391231.440086:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103487360 00000100:00100000:2.0:1788391231.440101:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103487360 00000100:00100000:2.0:1788391231.440181:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788391231.440192:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103487360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391231.440228:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391231.440314:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103487360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391231.440321:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788391231.441229:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103487360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391231.722420:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391231.725543:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281472 00000100:00100000:0.0:1788391231.725558:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281472 00000100:00100000:0.0:1788391231.725658:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 444 00000100:00100000:0.0:1788391231.725671:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+47:40275:x1875263094281472:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391231.725692:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391231.725695:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391231.725719:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6a6a92400/0x9aafc5f04cd381f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0042a expref: 47 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.725735:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391231.725738:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391231.725749:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211800/0x9aafc5f04cd382dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00462 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.726044:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.726058:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.726073:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.726113:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.726126:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 5 pid: 42645 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391231.726139:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685dc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103487488:192.168.202.1@tcp:104: 00000100:00080000:3.0:1788391231.726214:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391231.726304:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391231.728238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.728580:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281600 00000100:00100000:1.0:1788391231.728594:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281600 00010000:00010000:1.0:1788391231.728670:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 6 pid: 42645 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391231.728746:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1788391231.728760:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094281600:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391231.728779:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391231.728789:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 6 pid: 42645 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.728804:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 6 pid: 42645 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.728833:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:1.0:1788391231.728839:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.728851:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.728860:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.728884:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391231.728953:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094281600:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 196us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391231.728985:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00080000:3.0:1788391231.729066:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788391231.729563:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0a00/0x9aafc5f04cd382d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0045b expref: 5 pid: 42645 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391231.729584:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685dc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103487488:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391231.729610:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.729619:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.729625:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.729653:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.729664:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.729683:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391231.731815:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcc:0x0], index 1: 0 00010000:00010000:0.0:1788391231.732125:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211400/0x9aafc5f04cd382f1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732144:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211400/0x9aafc5f04cd382f1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732168:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211400/0x9aafc5f04cd382f1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732216:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732223:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732231:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732236:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d210600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391231.732243:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732253:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732267:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2c00) 00010000:00010000:0.0:1788391231.732271:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391231.732285:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732291:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210600/0x9aafc5f04cd382e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391231.732306:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008169c76 reply state 000000009c23d804 transno 30064771454 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391231.732316:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788391231.732363:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211800/0x9aafc5f04cd382dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00462 expref: 49 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732385:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211400/0x9aafc5f04cd382f1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00462 expref: 48 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.732392:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.732395:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391231.732398:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d211400, rc 0) 00000100:00100000:0.0:1788391231.732498:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:40275:x1875263094281472:12345-192.168.202.1@tcp:101:dd.0 Request processed in 6829us (10090us total) trans 30064771454 rc 0/0 00000100:00100000:0.0:1788391231.732508:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 444 00010000:00010000:2.0:1788391231.734486:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734503:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734511:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734516:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d211c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391231.734521:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734529:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734546:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d59e00) 00010000:00010000:2.0:1788391231.734549:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391231.734554:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391231.734560:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211c00/0x9aafc5f04cd382ea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391231.738515:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.738682:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281728 00000100:00100000:1.0:1788391231.738697:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281728 00000100:00100000:1.0:1788391231.738799:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1788391231.738813:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:40275:x1875263094281728:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391231.738854:0:43698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391231.738882:0:43698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd382ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00469 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391231.738917:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788391231.738943:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=1048s v=(0 0) 00010000:00010000:1.0:1788391231.738948:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391231.738992:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd382ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00469 expref: 13 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.739013:0:43698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c12bd40/0x9aafc5f04cd382ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00469 expref: 13 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.739028:0:43698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0a00, rc 0) 00000100:00100000:1.0:1788391231.739101:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:40275:x1875263094281728:12345-192.168.202.1@tcp:101:dd.0 Request processed in 290us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391231.739108:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00080000:3.0:1788391231.739319:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391231.749649:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391231.751309:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281856 00000100:00100000:2.0:1788391231.751326:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281856 00002000:00100000:2.0:1788391231.751409:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d6c1d1a680 x1875263094281856/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/0 e 0 to 0 dl 1788391242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391231.751422:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d1a680 with x1875263094281856 ext(0->1048575) 00002000:00010000:2.0:1788391231.751429:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d1a680 00000100:00100000:2.0:1788391231.751479:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 347 00000100:00100000:2.0:1788391231.751491:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094281856:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391231.766006:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391231.766056:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391231.766104:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094282240 00000100:00100000:3.0:1788391231.766115:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094282240 00000100:00100000:3.0:1788391231.766203:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:3.0:1788391231.766216:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:40275:x1875263094282240:12345-192.168.202.1@tcp:35:dd.0 00000001:00080000:3.0:1788391231.766609:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771455 00000100:00100000:3.0:1788391231.766738:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40275:x1875263094282240:12345-192.168.202.1@tcp:35:dd.0 Request processed in 523us (792us total) trans 30064771456 rc 0/0 00000100:00100000:3.0:1788391231.766748:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000020:00080000:3.0:1788391231.766755:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788391231.766786:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094281984 00000100:00100000:3.0:1788391231.766789:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094281984 00002000:00100000:3.0:1788391231.766822:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d6c1d18380 x1875263094281984/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/0 e 0 to 0 dl 1788391242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391231.766835:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d18380 with x1875263094281984 ext(1048576->2097151) 00002000:00010000:3.0:1788391231.766842:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d18380 00000100:00100000:3.0:1788391231.766865:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 348 00000100:00100000:3.0:1788391231.766874:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094281984:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391231.771879:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2359:x1875263094281856:12345-192.168.202.1@tcp:4:dd.0 Request processed in 20374us (22231us total) trans 30064771269 rc 0/0 00000100:00100000:1.0:1788391231.771897:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 347 00002000:00100000:1.0:1788391231.771914:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d6c1d1a680 x1875263094281856/t30064771269(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/448 e 0 to 0 dl 1788391242 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391231.771925:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d1a680 with x1875263094281856 ext(0->1048575) 00002000:00010000:1.0:1788391231.771934:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d1a680 00000100:00100000:3.0:1788391231.785022:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2358:x1875263094281984:12345-192.168.202.1@tcp:4:dd.0 Request processed in 18132us (18949us total) trans 30064771270 rc 0/0 00000100:00100000:3.0:1788391231.785066:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 348 00002000:00100000:3.0:1788391231.785085:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d6c1d18380 x1875263094281984/t30064771270(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/448 e 0 to 0 dl 1788391242 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391231.785098:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d18380 with x1875263094281984 ext(1048576->2097151) 00002000:00010000:3.0:1788391231.785107:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d18380 00000100:00100000:2.0:1788391231.786758:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.786860:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094282368 00000100:00100000:1.0:1788391231.786887:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094282368 00000100:00100000:1.0:1788391231.786979:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 445 00000100:00100000:1.0:1788391231.787006:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40276:x1875263094282368:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391231.787036:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391231.787334:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00470 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787425:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787441:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787456:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391231.787499:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391231.787503:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391231.787526:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787555:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00470 expref: 52 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787576:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00470 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.787587:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391231.787590:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391231.787594:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc1800, rc 0) 00000100:00100000:1.0:1788391231.787676:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:40276:x1875263094282368:12345-192.168.202.1@tcp:101:chown.0 Request processed in 686us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391231.787684:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 445 00000100:00100000:2.0:1788391231.798516:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.798618:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094282496 00000100:00100000:1.0:1788391231.798632:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094282496 00000100:00100000:1.0:1788391231.798782:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 446 00000100:00100000:1.0:1788391231.798793:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:40276:x1875263094282496:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:1.0:1788391231.798818:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391231.798841:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38314 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00477 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.798881:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3831b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.798895:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3831b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.798905:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3831b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.799071:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1e00/0x9aafc5f04cd38314 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00477 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.799090:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc0e00/0x9aafc5f04cd3831b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00477 expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.799097:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391231.799099:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391231.799102:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d68fcc0e00, rc 0) 00000100:00100000:1.0:1788391231.799178:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40276:x1875263094282496:12345-192.168.202.1@tcp:101:chown.0 Request processed in 387us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391231.799183:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 446 00000100:00100000:2.0:1788391231.801076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.801118:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094282752 00000100:00100000:1.0:1788391231.801129:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094282752 00000100:00100000:1.0:1788391231.801200:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 447 00000100:00100000:1.0:1788391231.801212:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40276:x1875263094282752:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:1.0:1788391231.801277:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391231.801306:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211400/0x9aafc5f04cd382f1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00462 expref: 52 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.801327:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391231.801332:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391231.801372:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.801387:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.801397:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391231.802245:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].15, 88 off9416 00000004:00080000:1.0:1788391231.802259:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1048909297042ns, next at 1049909294308ns, rc = 0 00000004:00010000:1.0:1788391231.802361:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090452f19 reply state 00000000bae334b7 transno 30064771457 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391231.802372:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391231.802504:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40276:x1875263094282752:12345-192.168.202.1@tcp:36:chown.0 Request processed in 1293us (1433us total) trans 30064771457 rc 0/0 00000100:00100000:1.0:1788391231.802524:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 447 00000100:00100000:2.0:1788391231.804247:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:1.0:1788391231.804267:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804280:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804289:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804296:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391231.804301:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804310:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804331:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391231.804335:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391231.804341:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391231.804348:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38322 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391231.804416:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094282880 00000100:00100000:0.0:1788391231.804428:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094282880 00000100:00100000:0.0:1788391231.804485:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 448 00000100:00100000:0.0:1788391231.804498:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40276:x1875263094282880:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1788391231.804524:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391231.804542:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210400/0x9aafc5f04cd38329 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0047e expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.804612:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210400/0x9aafc5f04cd38329 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0047e expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.804632:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210400/0x9aafc5f04cd38329 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0047e expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.804648:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.804650:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391231.804653:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d210400, rc 0) 00000100:00100000:0.0:1788391231.804699:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40276:x1875263094282880:12345-192.168.202.1@tcp:101:chown.0 Request processed in 204us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391231.804707:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 448 00000100:00100000:2.0:1788391231.806277:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.806352:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094283008 00000100:00100000:1.0:1788391231.806361:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094283008 00000100:00100000:1.0:1788391231.806418:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:1.0:1788391231.806428:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094283008:12345-192.168.202.1@tcp:2:chown.0 00002000:00010000:1.0:1788391231.806665:0:43326:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788391231.806686:0:43326:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788391232 00002000:00010000:1.0:1788391231.806688:0:43326:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391231.806691:0:43326:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1788391232 00002000:00010000:1.0:1788391231.806693:0:43326:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391231.806822:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094283008:12345-192.168.202.1@tcp:2:chown.0 Request processed in 396us (555us total) trans 30064771271 rc 0/0 00000100:00100000:1.0:1788391231.806829:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:2.0:1788391231.856435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391231.857174:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094283264 00000100:00100000:3.0:1788391231.857189:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094283264 00000100:00100000:3.0:1788391231.857327:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 449 00000100:00100000:3.0:1788391231.857342:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40282:x1875263094283264:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:3.0:1788391231.857371:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391231.857398:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd38330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00485 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857507:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857525:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857539:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857557:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857565:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857596:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857778:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd38345 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857788:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd38345 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857796:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd38345 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391231.857808:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:3.0:1788391231.857925:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857934:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857942:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.857948:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df7200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391231.857953:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858010:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858025:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:3.0:1788391231.858029:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391231.858042:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858061:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df7200/0x9aafc5f04cd38337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858079:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858086:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858093:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858098:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b4df6600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391231.858102:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858107:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858116:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d686a70d00) 00010000:00010000:3.0:1788391231.858119:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391231.858122:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858127:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6600/0x9aafc5f04cd3833e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858187:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6c00/0x9aafc5f04cd38330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00485 expref: 56 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858216:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd38345 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00485 expref: 55 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391231.858224:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:3.0:1788391231.858227:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391231.858236:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b4df6400, rc 0) 00000100:00100000:3.0:1788391231.858321:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:40282:x1875263094283264:12345-192.168.202.1@tcp:101:dd.500 Request processed in 982us (1898us total) trans 30064771458 rc 0/0 00000100:00100000:3.0:1788391231.858330:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 449 00000100:00100000:2.0:1788391231.862319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391231.862440:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094283520 00000100:00100000:0.0:1788391231.862454:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094283520 00000100:00100000:0.0:1788391231.862593:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 450 00000100:00100000:0.0:1788391231.862606:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:40282:x1875263094283520:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391231.862650:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391231.862654:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1788391231.862687:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210400/0x9aafc5f04cd38329 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0047e expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862711:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b4df6400/0x9aafc5f04cd38345 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00485 expref: 54 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862724:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.862744:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391231.862760:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211a00/0x9aafc5f04cd38353 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0048c expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862823:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862837:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862849:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862866:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862873:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862881:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862888:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d211000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391231.862893:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862900:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862910:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.862913:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391231.862918:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.862932:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd3835a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863296:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863307:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863315:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863696:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0048c expref: 56 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863705:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.863707:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391231.863719:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211a00/0x9aafc5f04cd38353 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0048c expref: 56 pid: 42644 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863733:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0048c expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391231.863761:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391231.863824:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391231.863828:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d211200, rc 0) 00000100:00100000:0.0:1788391231.863987:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:40282:x1875263094283520:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1359us (1658us total) trans 30064771459 rc 0/0 00000100:00100000:0.0:1788391231.863995:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 450 00000100:00100000:2.0:1788391231.872179:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.872298:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094283648 00000100:00100000:1.0:1788391231.872313:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094283648 00002000:00100000:1.0:1788391231.872379:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d6bc68df80 x1875263094283648/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/0 e 0 to 0 dl 1788391242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391231.872392:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68df80 with x1875263094283648 ext(0->1048575) 00002000:00010000:1.0:1788391231.872398:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc68df80 00000100:00100000:1.0:1788391231.872439:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 349 00000100:00100000:1.0:1788391231.872451:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094283648:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391231.885827:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094283648:12345-192.168.202.1@tcp:3:dd.0 Request processed in 13365us (13647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391231.885840:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 349 00002000:00100000:1.0:1788391231.885853:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d6bc68df80 x1875263094283648/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/440 e 0 to 0 dl 1788391242 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391231.885862:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6bc68df80 with x1875263094283648 ext(0->1048575) 00002000:00010000:1.0:1788391231.885868:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6bc68df80 00000100:00100000:3.0:1788391231.912564:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.913247:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094283776 00000100:00100000:1.0:1788391231.913266:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094283776 00002000:00100000:1.0:1788391231.913340:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d6c1d1aa00 x1875263094283776/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/0 e 0 to 0 dl 1788391242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391231.913389:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d1aa00 with x1875263094283776 ext(1048576->2097151) 00002000:00010000:1.0:1788391231.913406:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d1aa00 00000100:00100000:1.0:1788391231.913448:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 350 00000100:00100000:1.0:1788391231.913460:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094283776:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391231.923164:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094283776:12345-192.168.202.1@tcp:3:dd.0 Request processed in 9679us (10588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391231.923184:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 350 00002000:00100000:1.0:1788391231.923199:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d6c1d1aa00 x1875263094283776/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:92/0 lens 488/440 e 0 to 0 dl 1788391242 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391231.923212:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d6c1d1aa00 with x1875263094283776 ext(1048576->2097151) 00002000:00010000:1.0:1788391231.923220:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d6c1d1aa00 00000100:00100000:0.0:1788391231.938694:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391231.938852:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094284032 00000100:00100000:1.0:1788391231.938866:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094284032 00000100:00100000:1.0:1788391231.938946:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1788391231.939079:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:40282:x1875263094284032:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391231.939413:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40282:x1875263094284032:12345-192.168.202.1@tcp:35:dd.500 Request processed in 456us (732us total) trans 30064771460 rc 0/0 00000100:00100000:1.0:1788391231.939422:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:2.0:1788391232.010412:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.010518:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094284160 00000100:00100000:1.0:1788391232.010533:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094284160 00000100:00100000:1.0:1788391232.010618:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 451 00000100:00100000:1.0:1788391232.010631:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40292:x1875263094284160:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391232.010740:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010796:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010814:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010834:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010841:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010848:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.010995:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011005:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011013:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391232.011064:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011078:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011085:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011102:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011109:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.011114:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011122:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011137:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391232.011140:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.011156:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011163:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011179:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011185:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011191:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011196:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.011198:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011213:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011222:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29700) 00010000:00010000:1.0:1788391232.011224:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.011227:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011233:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd3836f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011246:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011252:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011257:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011263:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.011265:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011271:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011278:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.011280:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.011283:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.011297:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38376 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391232.011378:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40292:x1875263094284160:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 749us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391232.011386:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 451 00000100:00100000:3.0:1788391232.035787:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.035919:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094284416 00000100:00100000:1.0:1788391232.035932:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094284416 00000100:00100000:1.0:1788391232.036039:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 452 00000100:00100000:1.0:1788391232.036052:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40293:x1875263094284416:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391232.036080:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.036105:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3837d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00493 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036210:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036227:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036241:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036258:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036266:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036300:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036501:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036508:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036515:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036521:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.036526:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036534:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036548:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391232.036551:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.036556:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036561:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036576:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036582:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036596:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036602:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.036605:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036612:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036620:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29700) 00010000:00010000:1.0:1788391232.036622:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.036625:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036631:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd3838b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036668:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3837d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00493 expref: 57 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036679:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391232.036682:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391232.036685:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3837d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00493 expref: 57 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.036697:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d200, rc 0) 00000100:00100000:1.0:1788391232.036777:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40293:x1875263094284416:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 727us (1014us total) trans 0 rc 301/301 00000100:00100000:1.0:1788391232.036795:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 452 00000100:00100000:0.0:1788391232.046786:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.047006:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094284544 00000100:00100000:1.0:1788391232.047021:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094284544 00000100:00100000:1.0:1788391232.047199:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 453 00000100:00100000:1.0:1788391232.047223:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40293:x1875263094284544:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391232.047326:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047349:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047364:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047496:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047506:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047514:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047630:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047641:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047648:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391232.047710:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00000004:00200000:1.0:1788391232.047715:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391232.047732:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047748:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047756:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047763:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047770:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.047776:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047785:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047799:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391232.047802:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.047807:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047820:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047837:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047854:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047860:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047866:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.047869:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047876:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047886:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29700) 00010000:00010000:1.0:1788391232.047889:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.047904:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047911:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047927:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047933:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047939:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.047944:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.047955:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.048010:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.048019:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.048023:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.048026:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.048032:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391232.048129:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40293:x1875263094284544:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 918us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391232.048138:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 453 00000100:00100000:2.0:1788391232.079668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.079788:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094284800 00000100:00100000:1.0:1788391232.079801:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094284800 00000100:00100000:1.0:1788391232.079872:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 454 00000100:00100000:1.0:1788391232.079883:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40299:x1875263094284800:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391232.079921:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.079928:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391232.080247:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d68fcc1800/0x9aafc5f04cd3830d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00470 expref: 56 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080274:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391232.080285:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391232.080304:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0049a expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080495:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080510:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080521:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080535:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080542:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080549:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080612:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd383bc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080620:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd383bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080627:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd383bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391232.080636:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:1.0:1788391232.080754:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080772:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080779:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080785:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.080790:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080799:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080807:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29700) 00010000:00010000:1.0:1788391232.080810:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.080814:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080820:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080829:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080836:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080842:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080847:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.080854:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080861:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080867:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391232.080869:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.080872:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.080877:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.081022:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0049a expref: 58 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.081038:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd383bc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0049a expref: 57 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.081053:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.081055:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391232.081058:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d000, rc 0) 00000100:00100000:1.0:1788391232.081230:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:40299:x1875263094284800:12345-192.168.202.1@tcp:101:dd.0 Request processed in 1347us (1573us total) trans 30064771461 rc 0/0 00000100:00100000:1.0:1788391232.081239:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 454 00000100:00100000:2.0:1788391232.085317:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391232.085402:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285056 00000100:00100000:3.0:1788391232.085415:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285056 00000100:00100000:3.0:1788391232.085482:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 455 00000100:00100000:3.0:1788391232.085494:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:40299:x1875263094285056:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1788391232.085565:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788391232.085594:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211200/0x9aafc5f04cd38361 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0048c expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391232.085614:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd383bc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0049a expref: 56 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391232.085624:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:3.0:1788391232.085628:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391232.085846:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391232.085874:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391232.085881:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391232.085945:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771462 00000004:00010000:3.0:1788391232.086041:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017cbb998 reply state 00000000b4b2c066 transno 30064771463 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391232.086049:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391232.086178:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:40299:x1875263094285056:12345-192.168.202.1@tcp:36:dd.0 Request processed in 686us (875us total) trans 30064771463 rc 0/0 00000100:00100000:3.0:1788391232.086184:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 455 00000020:00080000:3.0:1788391232.086188:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391232.088873:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.088889:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.088897:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.088904:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d1a4c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391232.088910:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.088918:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.088938:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391232.088942:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391232.088947:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.089119:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d1a4c00/0x9aafc5f04cd383ca lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391232.089462:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391232.089544:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285184 00000100:00100000:0.0:1788391232.089555:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285184 00000100:00100000:0.0:1788391232.089614:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 456 00000100:00100000:0.0:1788391232.089625:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:40299:x1875263094285184:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1788391232.089655:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391232.089672:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd383d1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004a1 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.089727:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd383d1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a1 expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.089737:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd383d1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a1 expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.089750:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391232.089752:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391232.089754:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d211000, rc 0) 00000100:00100000:0.0:1788391232.089822:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:40299:x1875263094285184:12345-192.168.202.1@tcp:101:dd.0 Request processed in 195us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391232.089831:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 456 00000100:00100000:3.0:1788391232.091226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.091269:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285440 00000100:00100000:1.0:1788391232.091279:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285440 00000100:00100000:1.0:1788391232.091345:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 457 00000100:00100000:1.0:1788391232.091356:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:40299:x1875263094285440:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391232.091426:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.091430:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391232.091455:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211000/0x9aafc5f04cd383d1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a1 expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091470:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.091474:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391232.091484:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383d8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004a8 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091526:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091535:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091542:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091745:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a8 expref: 60 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091751:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.091753:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391232.091760:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd383d8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a8 expref: 60 pid: 42646 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091773:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a8 expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.091811:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.091814:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391232.091817:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c000, rc 0) 00000100:00100000:1.0:1788391232.091867:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:40299:x1875263094285440:12345-192.168.202.1@tcp:101:dd.0 Request processed in 513us (648us total) trans 30064771464 rc 0/0 00000100:00100000:1.0:1788391232.091874:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 457 00000100:00100000:2.0:1788391232.096759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.098550:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285696 00000100:00100000:1.0:1788391232.098569:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285696 00000100:00100000:1.0:1788391232.098651:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 458 00000100:00100000:1.0:1788391232.098664:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:40299:x1875263094285696:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1788391232.098699:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.098703:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391232.098737:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd383df lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004a8 expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.098760:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.098765:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391232.098781:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383e6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004af expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.098845:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.098861:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.098870:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788391232.099410:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].16, 88 off9504 00000004:00080000:1.0:1788391232.099421:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049206459745ns, next at 1049909294308ns, rc = 0 00000100:00100000:3.0:1788391232.116914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391232.117070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.117194:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285952 00000100:00100000:1.0:1788391232.117260:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285952 00000100:00100000:3.0:1788391232.117329:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094285824 00000100:00100000:3.0:1788391232.117335:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094285824 00000100:00100000:1.0:1788391232.117340:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1788391232.117355:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094285952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391232.117375:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:3.0:1788391232.117383:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094285824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391232.117437:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094285824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391232.117442:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00080000:3.0:1788391232.117473:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391232.117501:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094285952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391232.117510:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00010000:00010000:0.0:1788391232.134601:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004af expref: 61 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.134624:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391232.134628:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391232.134654:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd383e6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004af expref: 61 pid: 42645 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.134699:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004af expref: 60 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.134744:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391232.134748:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788391232.134751:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16da00, rc 0) 00000100:00100000:0.0:1788391232.134837:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:40299:x1875263094285696:12345-192.168.202.1@tcp:101:dd.0 Request processed in 36174us (38101us total) trans 30064771465 rc 0/0 00000100:00100000:0.0:1788391232.134848:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 458 00000001:00080000:3.0:1788391232.135519:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771459 is committed 00000001:00080000:3.0:1788391232.135545:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771465 is committed 00000004:00080000:3.0:1788391232.135551:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:3.0:1788391232.135581:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000100:00100000:3.0:1788391232.135955:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103487616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788391232.136060:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391232.136403:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103487616 00000100:00100000:2.0:1788391232.136414:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103487616 00000100:00100000:2.0:1788391232.136483:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788391232.136496:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103487616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788391232.136721:0:43327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1788391232.136726:0:43327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788391232 -> 1788391232 00002000:00010000:2.0:1788391232.136728:0:43327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391232.136731:0:43327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788391232 -> 1788391232 00002000:00010000:2.0:1788391232.136733:0:43327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391232.136779:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103487616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 285us (718us total) trans 30064771272 rc 0/0 00000100:00100000:2.0:1788391232.136786:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000004:00080000:2.0:1788391232.136834:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69225c700/2, rc 0, transno 30064771272 00000100:00100000:2.0:1788391232.136846:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103487616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391232.136891:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103487744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788391232.136919:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391232.136987:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103487744 00000100:00100000:2.0:1788391232.136991:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103487744 00000100:00100000:2.0:1788391232.137019:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788391232.137026:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103487744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788391232.137140:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1788391232.137156:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788391232 -> 1788391232 00002000:00010000:2.0:1788391232.137158:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788391232.137160:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788391232 -> 1788391232 00002000:00010000:2.0:1788391232.137162:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788391232.137193:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1875263103487744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (273us total) trans 30064771273 rc 0/0 00000100:00100000:2.0:1788391232.137199:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000004:00080000:2.0:1788391232.137225:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d69225ca80/2, rc 0, transno 30064771273 00000100:00100000:2.0:1788391232.137230:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103487744:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788391232.137512:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391232.139590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.139744:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286080 00000100:00100000:1.0:1788391232.139757:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286080 00002000:00010000:1.0:1788391232.139816:0:43333:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:1.0:1788391232.139822:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f100 with x1875263094286080 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391232.139836:0:43333:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f100. 00000100:00100000:1.0:1788391232.139912:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 351 00000100:00100000:1.0:1788391232.139924:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2356:x1875263094286080:12345-192.168.202.1@tcp:10:dd.0 00002000:00010000:1.0:1788391232.140380:0:43333:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:1.0:1788391232.140385:0:43333:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788391232 -> 1788391232 00002000:00010000:1.0:1788391232.140388:0:43333:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788391232.140390:0:43333:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788391232 -> 1788391232 00002000:00010000:1.0:1788391232.140392:0:43333:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788391232.140469:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2356:x1875263094286080:12345-192.168.202.1@tcp:10:dd.0 Request processed in 548us (891us total) trans 30064771274 rc 0/0 00000100:00100000:1.0:1788391232.140478:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 351 00002000:00010000:1.0:1788391232.140502:0:43333:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:1.0:1788391232.140504:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0f100 with x1875263094286080 ext(0->18446744073709551615) 00002000:00010000:1.0:1788391232.140510:0:43333:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0f100. 00000100:00100000:2.0:1788391232.156939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391232.157120:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286208 00000100:00100000:3.0:1788391232.157132:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286208 00002000:00100000:2.0:1788391232.157298:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d69225f800 x1875263094286208/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391232.157307:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225f800 with x1875263094286208 ext(0->1048575) 00002000:00010000:2.0:1788391232.157313:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69225f800 00000100:00100000:2.0:1788391232.157344:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 352 00000100:00100000:2.0:1788391232.157353:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+19:2357:x1875263094286208:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391232.165603:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2357:x1875263094286208:12345-192.168.202.1@tcp:4:dd.0 Request processed in 8238us (8664us total) trans 30064771275 rc 0/0 00000100:00100000:2.0:1788391232.165616:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 352 00002000:00100000:2.0:1788391232.165629:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d69225f800 x1875263094286208/t30064771275(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/448 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391232.165638:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225f800 with x1875263094286208 ext(0->1048575) 00002000:00010000:2.0:1788391232.165644:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69225f800 00000100:00100000:2.0:1788391232.170110:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391232.170335:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286336 00000100:00100000:0.0:1788391232.170347:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286336 00002000:00100000:0.0:1788391232.170416:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d69225d500 x1875263094286336/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391232.170430:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225d500 with x1875263094286336 ext(1048576->2097151) 00002000:00010000:0.0:1788391232.170437:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69225d500 00000100:00100000:0.0:1788391232.170534:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 353 00000100:00100000:0.0:1788391232.170546:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+21:2356:x1875263094286336:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:3.0:1788391232.178314:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2356:x1875263094286336:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7751us (8198us total) trans 30064771276 rc 0/0 00000100:00100000:3.0:1788391232.178331:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 353 00002000:00100000:3.0:1788391232.178350:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d69225d500 x1875263094286336/t30064771276(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/448 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391232.178363:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d69225d500 with x1875263094286336 ext(1048576->2097151) 00002000:00010000:3.0:1788391232.178371:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d69225d500 00000100:00100000:0.0:1788391232.192397:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391232.192490:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286464 00000100:00100000:3.0:1788391232.192501:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286464 00002000:00100000:3.0:1788391232.192564:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff95d685dc4000 x1875263094286464/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391232.192578:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc4000 with x1875263094286464 ext(2097152->3145727) 00002000:00010000:3.0:1788391232.192585:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685dc4000 00000100:00100000:3.0:1788391232.192618:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 354 00000100:00100000:3.0:1788391232.192629:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+23:2359:x1875263094286464:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391232.200534:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2359:x1875263094286464:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7890us (8135us total) trans 30064771277 rc 0/0 00000100:00100000:1.0:1788391232.200552:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 354 00002000:00100000:1.0:1788391232.200567:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff95d685dc4000 x1875263094286464/t30064771277(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/448 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.200580:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc4000 with x1875263094286464 ext(2097152->3145727) 00002000:00010000:1.0:1788391232.200587:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685dc4000 00000100:00100000:0.0:1788391232.202880:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.203015:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286592 00000100:00100000:1.0:1788391232.203029:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286592 00002000:00100000:1.0:1788391232.203090:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff95d685dc7480 x1875263094286592/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.203103:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7480 with x1875263094286592 ext(3145728->4194303) 00002000:00010000:1.0:1788391232.203109:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685dc7480 00000100:00100000:1.0:1788391232.203159:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 355 00000100:00100000:1.0:1788391232.203170:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+25:2357:x1875263094286592:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:1.0:1788391232.215976:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2357:x1875263094286592:12345-192.168.202.1@tcp:4:dd.0 Request processed in 12775us (13076us total) trans 30064771278 rc 0/0 00000100:00100000:1.0:1788391232.216006:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 355 00002000:00100000:1.0:1788391232.216023:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff95d685dc7480 x1875263094286592/t30064771278(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/448 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.216032:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d685dc7480 with x1875263094286592 ext(3145728->4194303) 00002000:00010000:1.0:1788391232.216063:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d685dc7480 00000100:00100000:2.0:1788391232.220196:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391232.220258:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391232.220280:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286976 00000100:00100000:3.0:1788391232.220296:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286976 00000100:00100000:1.0:1788391232.220436:0:43332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094286720 00000100:00100000:1.0:1788391232.220440:0:43332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094286720 00002000:00100000:1.0:1788391232.220491:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff95d68f55f480 x1875263094286720/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.220505:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55f480 with x1875263094286720 ext(4194304->5242879) 00002000:00010000:1.0:1788391232.220516:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55f480 00000100:00100000:1.0:1788391232.220554:0:43332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 356 00000100:00100000:1.0:1788391232.220565:0:43332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+27:2358:x1875263094286720:12345-192.168.202.1@tcp:4:dd.0 00000100:00100000:2.0:1788391232.220913:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788391232.220923:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+48:40299:x1875263094286976:12345-192.168.202.1@tcp:35:dd.0 00000100:00100000:2.0:1788391232.221764:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:40299:x1875263094286976:12345-192.168.202.1@tcp:35:dd.0 Request processed in 838us (1579us total) trans 30064771466 rc 0/0 00000100:00100000:2.0:1788391232.221775:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1788391232.228136:0:43332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2358:x1875263094286720:12345-192.168.202.1@tcp:4:dd.0 Request processed in 7556us (7861us total) trans 30064771279 rc 0/0 00000100:00100000:1.0:1788391232.228162:0:43332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 356 00002000:00100000:1.0:1788391232.228178:0:43332:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff95d68f55f480 x1875263094286720/t30064771279(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/448 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.228189:0:43332:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d68f55f480 with x1875263094286720 ext(4194304->5242879) 00002000:00010000:1.0:1788391232.228197:0:43332:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d68f55f480 00000100:00100000:3.0:1788391232.278934:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391232.279027:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094287104 00000100:00100000:0.0:1788391232.279040:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094287104 00000100:00100000:2.0:1788391232.279539:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 459 00000100:00100000:2.0:1788391232.279556:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+49:40309:x1875263094287104:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391232.279590:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391232.280260:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd383f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004b6 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280347:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280360:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280371:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391232.280408:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391232.280410:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391232.280576:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280649:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1c00/0x9aafc5f04cd383f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004b6 expref: 51 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280678:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004b6 expref: 50 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.280688:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391232.280692:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391232.280696:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d684cd1800, rc 0) 00000100:00100000:2.0:1788391232.280861:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40309:x1875263094287104:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1309us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391232.280868:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 459 00000100:00100000:2.0:1788391232.284205:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391232.284278:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094287232 00000100:00100000:0.0:1788391232.284290:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094287232 00000100:00100000:0.0:1788391232.284396:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 460 00000100:00100000:0.0:1788391232.284405:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40309:x1875263094287232:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391232.284510:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284526:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284536:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284547:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284552:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284556:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284857:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284864:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284868:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391232.284910:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284921:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284932:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284937:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284941:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d211e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391232.284944:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284949:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.284992:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391232.284995:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391232.285001:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285007:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211e00/0x9aafc5f04cd38402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285021:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285027:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285034:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285040:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d211600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391232.285048:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285055:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285063:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a704c600) 00010000:00010000:0.0:1788391232.285065:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391232.285069:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285074:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d211600/0x9aafc5f04cd38409 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285089:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285095:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285102:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285106:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d210000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391232.285110:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285116:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285124:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:0.0:1788391232.285127:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391232.285135:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391232.285153:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d210000/0x9aafc5f04cd38410 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391232.285241:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40309:x1875263094287232:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 836us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391232.285250:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 460 00000100:00100000:0.0:1788391232.330522:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.330595:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094287488 00000100:00100000:1.0:1788391232.330608:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094287488 00000100:00100000:1.0:1788391232.330742:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 461 00000100:00100000:1.0:1788391232.330756:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+50:40315:x1875263094287488:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391232.330784:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.330823:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004bd expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.330919:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.330956:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331004:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331024:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331032:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331039:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331418:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3842c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331426:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3842c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331431:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3842c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391232.331440:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:1.0:1788391232.331540:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331546:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331551:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331560:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.331565:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331570:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331581:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391232.331583:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.331587:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331591:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3841e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331602:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331605:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331609:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331612:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.331613:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331616:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331627:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391232.331628:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.331630:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331633:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331671:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004bd expref: 53 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331680:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3842c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004bd expref: 52 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.331684:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.331686:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391232.331688:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c800, rc 0) 00000100:00100000:1.0:1788391232.331775:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40315:x1875263094287488:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1023us (1265us total) trans 30064771467 rc 0/0 00000100:00100000:1.0:1788391232.331784:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 461 00000100:00100000:2.0:1788391232.334215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.334261:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094287744 00000100:00100000:1.0:1788391232.334271:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094287744 00000100:00100000:1.0:1788391232.334353:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 462 00000100:00100000:1.0:1788391232.334361:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40315:x1875263094287744:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391232.334388:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.334390:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1788391232.334417:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd383ed lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004af expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334449:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3842c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004bd expref: 51 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334458:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.334462:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391232.334474:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3843a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004c4 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334509:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334518:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334525:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334537:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334542:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334547:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334550:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.334554:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334566:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334572:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.334574:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391232.334576:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334580:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38441 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334599:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16dc00/0x9aafc5f04cd38448 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334604:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16dc00/0x9aafc5f04cd38448 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334608:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16dc00/0x9aafc5f04cd38448 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334873:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16dc00/0x9aafc5f04cd38448 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004c4 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334881:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.334884:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391232.334894:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3843a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004c4 expref: 53 pid: 42645 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334906:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16dc00/0x9aafc5f04cd38448 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004c4 expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.334946:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.334948:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788391232.334951:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16dc00, rc 0) 00000100:00100000:1.0:1788391232.335082:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40315:x1875263094287744:12345-192.168.202.1@tcp:101:dd.500 Request processed in 720us (875us total) trans 30064771468 rc 0/0 00000100:00100000:1.0:1788391232.335090:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 462 00000100:00100000:3.0:1788391232.342603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.342844:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094287872 00000100:00100000:1.0:1788391232.342859:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094287872 00002000:00100000:1.0:1788391232.342930:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d584a0d500 x1875263094287872/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.342941:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0d500 with x1875263094287872 ext(0->1048575) 00002000:00010000:1.0:1788391232.342947:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0d500 00000100:00100000:3.0:1788391232.343011:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 357 00000100:00100000:3.0:1788391232.343210:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094287872:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391232.358891:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094287872:12345-192.168.202.1@tcp:3:dd.0 Request processed in 15670us (16284us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391232.358911:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 357 00002000:00100000:1.0:1788391232.358930:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff95d584a0d500 x1875263094287872/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/440 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.358941:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0d500 with x1875263094287872 ext(0->1048575) 00002000:00010000:1.0:1788391232.358949:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0d500 00000100:00100000:3.0:1788391232.365118:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391232.365252:0:43331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288000 00000100:00100000:2.0:1788391232.365265:0:43331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288000 00002000:00100000:2.0:1788391232.365334:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d584a0dc00 x1875263094288000/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391232.365348:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0dc00 with x1875263094288000 ext(1048576->2097151) 00002000:00010000:2.0:1788391232.365355:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0dc00 00000100:00100000:2.0:1788391232.365399:0:43331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 358 00000100:00100000:2.0:1788391232.365411:0:43331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094288000:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:2.0:1788391232.371617:0:43331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094288000:12345-192.168.202.1@tcp:3:dd.0 Request processed in 6193us (6497us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788391232.371634:0:43331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 358 00002000:00100000:2.0:1788391232.371651:0:43331:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff95d584a0dc00 x1875263094288000/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/440 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788391232.371669:0:43331:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0dc00 with x1875263094288000 ext(1048576->2097151) 00002000:00010000:2.0:1788391232.371677:0:43331:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0dc00 00000100:00100000:3.0:1788391232.381546:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391232.381644:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288128 00000100:00100000:0.0:1788391232.381658:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288128 00002000:00100000:0.0:1788391232.381723:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff95d584a0df80 x1875263094288128/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391232.381735:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0df80 with x1875263094288128 ext(2097152->3145727) 00002000:00010000:0.0:1788391232.381742:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0df80 00000100:00100000:0.0:1788391232.381785:0:45853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 359 00000100:00100000:0.0:1788391232.381797:0:45853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094288128:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:3.0:1788391232.382326:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.382397:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288256 00000100:00100000:1.0:1788391232.382403:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288256 00002000:00100000:1.0:1788391232.382430:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff95d584a0ca80 x1875263094288256/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.382439:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0ca80 with x1875263094288256 ext(3145728->4194303) 00002000:00010000:1.0:1788391232.382459:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0ca80 00000100:00100000:1.0:1788391232.382491:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:1.0:1788391232.382499:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094288256:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391232.390516:0:45853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+31:2357:x1875263094288128:12345-192.168.202.1@tcp:3:dd.0 Request processed in 8703us (8966us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391232.390535:0:45853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 359 00002000:00100000:1.0:1788391232.390552:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff95d584a0df80 x1875263094288128/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/440 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.390564:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0df80 with x1875263094288128 ext(2097152->3145727) 00002000:00010000:1.0:1788391232.390572:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0df80 00000100:00100000:1.0:1788391232.391442:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2357:x1875263094288256:12345-192.168.202.1@tcp:3:dd.0 Request processed in 8935us (9110us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391232.391486:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 360 00002000:00100000:1.0:1788391232.391495:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff95d584a0ca80 x1875263094288256/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/440 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.391505:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d584a0ca80 with x1875263094288256 ext(3145728->4194303) 00002000:00010000:1.0:1788391232.391510:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d584a0ca80 00000100:00100000:0.0:1788391232.421385:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.422230:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288384 00000100:00100000:1.0:1788391232.422246:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288384 00002000:00100000:1.0:1788391232.422315:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff95d5866a2d80 x1875263094288384/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/0 e 0 to 0 dl 1788391243 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.422329:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5866a2d80 with x1875263094288384 ext(4194304->5242879) 00002000:00010000:1.0:1788391232.422336:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5866a2d80 00000100:00100000:1.0:1788391232.422381:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:1.0:1788391232.422414:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094288384:12345-192.168.202.1@tcp:3:dd.0 00000100:00100000:1.0:1788391232.433869:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+29:2356:x1875263094288384:12345-192.168.202.1@tcp:3:dd.0 Request processed in 11440us (12482us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788391232.433890:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 361 00002000:00100000:1.0:1788391232.433909:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff95d5866a2d80 x1875263094288384/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:93/0 lens 488/440 e 0 to 0 dl 1788391243 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391232.433922:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5866a2d80 with x1875263094288384 ext(4194304->5242879) 00002000:00010000:1.0:1788391232.433930:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5866a2d80 00010000:00010000:2.0:1788391232.461291:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391232.464383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.464466:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288640 00000100:00100000:1.0:1788391232.464481:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288640 00000100:00100000:1.0:1788391232.464555:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:1.0:1788391232.464570:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:40315:x1875263094288640:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391232.464988:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40315:x1875263094288640:12345-192.168.202.1@tcp:35:dd.500 Request processed in 420us (615us total) trans 30064771469 rc 0/0 00000100:00100000:1.0:1788391232.465004:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788391232.517524:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.517634:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094288768 00000100:00100000:1.0:1788391232.517646:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094288768 00000100:00100000:1.0:1788391232.517710:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 463 00000100:00100000:1.0:1788391232.517723:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40321:x1875263094288768:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391232.517817:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.517833:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.517844:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.517874:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.517878:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.517882:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518263:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518271:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518275:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391232.518316:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518327:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518332:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518337:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518341:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.518344:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518355:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518366:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391232.518368:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.518373:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518379:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd3844f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518395:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518401:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518407:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518413:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.518415:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518421:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518429:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391232.518432:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.518435:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518451:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518468:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518476:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518482:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518485:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.518488:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518492:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518498:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.518499:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.518501:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.518505:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3845d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391232.518583:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40321:x1875263094288768:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 861us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391232.518591:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 463 00000100:00100000:0.0:1788391232.549506:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391232.550775:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289024 00000100:00100000:2.0:1788391232.550791:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289024 00000100:00100000:2.0:1788391232.550881:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 464 00000100:00100000:2.0:1788391232.550893:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40322:x1875263094289024:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391232.550926:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391232.550990:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004cb expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551101:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551120:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551133:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551158:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551166:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551174:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551536:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551545:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551551:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551557:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391232.551562:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551570:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551583:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391232.551586:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391232.551591:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551597:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3846b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551612:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551618:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551623:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551628:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391232.551631:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551637:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551643:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391232.551645:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391232.551648:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551654:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551688:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38464 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004cb expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551698:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391232.551700:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391232.551704:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004cb expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.551712:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391232.551801:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40322:x1875263094289024:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 910us (2307us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391232.551810:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 464 00000100:00100000:3.0:1788391232.556711:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.556932:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289152 00000100:00100000:1.0:1788391232.556946:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289152 00000100:00100000:1.0:1788391232.557073:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 465 00000100:00100000:1.0:1788391232.557085:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40322:x1875263094289152:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1788391232.557196:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557217:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557231:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557250:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557258:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557265:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557609:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557619:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557627:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391232.557667:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:1.0:1788391232.557681:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391232.557697:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557712:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557719:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557727:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557733:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.557738:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557744:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557755:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391232.557757:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.557761:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557765:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557774:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557778:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557789:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557793:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.557794:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557798:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557802:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391232.557803:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.557804:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557808:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd38480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557818:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557822:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557826:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557828:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391232.557830:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557839:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557844:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.557845:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391232.557847:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.557850:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38487 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391232.557916:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40322:x1875263094289152:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 834us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391232.557921:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 465 00000100:00100000:3.0:1788391232.591558:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.591620:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289280 00000100:00100000:1.0:1788391232.591631:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289280 00000100:00100000:2.0:1788391232.591875:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 466 00000100:00100000:2.0:1788391232.591892:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:40328:x1875263094289280:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391232.591920:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391232.591947:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3848e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004d2 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592087:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592108:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592133:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592163:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592170:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592182:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592489:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592498:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592504:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391232.592544:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:2.0:1788391232.592548:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391232.592567:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592579:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592586:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592591:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592595:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592600:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391232.592603:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592609:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592622:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391232.592624:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391232.592627:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592632:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592647:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592651:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592655:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592657:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391232.592659:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592662:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592665:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff95d6830d2f00) 00010000:00010000:2.0:1788391232.592667:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391232.592668:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592671:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3849c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592696:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3848e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592706:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.592718:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391232.592720:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391232.592723:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177200, rc 0) 00000100:00100000:2.0:1788391232.592799:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:40328:x1875263094289280:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 912us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391232.592805:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 466 00000100:00100000:0.0:1788391232.596592:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391232.596670:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289536 00000100:00100000:2.0:1788391232.596682:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289536 00000100:00100000:2.0:1788391232.596756:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 467 00000100:00100000:2.0:1788391232.596768:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:40328:x1875263094289536:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391232.596792:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391232.596815:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd384aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004d9 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.596932:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177800/0x9aafc5f04cd384b1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.596946:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177800/0x9aafc5f04cd384b1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.596958:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177800/0x9aafc5f04cd384b1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391232.597016:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:2.0:1788391232.597194:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd384aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d9 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.597219:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177800/0x9aafc5f04cd384b1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d9 expref: 56 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.597229:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391232.597232:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788391232.597236:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177800, rc 0) 00000100:00100000:2.0:1788391232.597317:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40328:x1875263094289536:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 549us (735us total) trans 30064771470 rc 0/0 00000100:00100000:2.0:1788391232.597325:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 467 00000100:00100000:3.0:1788391232.671273:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.671440:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289792 00000100:00100000:1.0:1788391232.671453:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289792 00000100:00100000:1.0:1788391232.671640:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 468 00000100:00100000:1.0:1788391232.671654:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:40334:x1875263094289792:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391232.671688:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391232.671716:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd384bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004e0 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.671850:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.671867:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.671986:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.672024:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.672035:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 57 pid: 42644 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391232.672048:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103487872:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391232.672162:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69191ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391232.676312:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391232.676574:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103487872:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391232.676584:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094289920 00000100:00100000:2.0:1788391232.676597:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094289920 00010000:00010000:2.0:1788391232.676650:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 58 pid: 42644 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.676662:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391232.676753:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:2.0:1788391232.676765:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2357:x1875263094289920:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391232.676785:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391232.676793:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 58 pid: 42644 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676809:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 58 pid: 42644 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676835:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd384a3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004d2 expref: 58 pid: 42644 timeout: 1149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676862:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:2.0:1788391232.676869:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676882:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676891:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391232.676927:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391232.677044:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391232.677056:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2357:x1875263094289920:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 290us (756us total) trans 0 rc 0/0 00010000:00010000:1.0:1788391232.677057:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391232.677072:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000004:00200000:1.0:1788391232.677087:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:1.0:1788391232.677296:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd384bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e0 expref: 58 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.677316:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c600/0x9aafc5f04cd384c6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e0 expref: 57 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391232.677349:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff95d6a0d59500) 00010000:00010000:1.0:1788391232.677353:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788391232.677355:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c600, rc 0) 00000100:00100000:1.0:1788391232.677388:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:40334:x1875263094289792:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 5737us (6127us total) trans 30064771471 rc 0/0 00000100:00100000:1.0:1788391232.677397:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 468 00010000:00010000:2.0:1788391233.485143:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391233.526084:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771279 is committed 00000001:00080000:1.0:1788391233.526145:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771273 is committed 00010000:00010000:2.0:1788391234.510144:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391235.533195:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391235.533218:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103488128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391235.533285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391235.533343:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488128 00000100:00100000:1.0:1788391235.533351:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488128 00000100:00100000:1.0:1788391235.533405:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788391235.533415:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103488128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391235.533449:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391235.533494:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103488128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391235.533501:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788391235.533539:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771273 gen 2 00000100:00080000:3.0:1788391235.533542:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788391235.533545:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69225c700, transno 30064771272 00000004:00080000:1.0:1788391235.533553:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d69225ca80, transno 30064771273 00000100:00100000:1.0:1788391235.533563:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103488128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391235.535077:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103488256:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.535129:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788391235.535139:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391235.535162:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391235.535172:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391235.535188:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103488640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.535214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391235.535245:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488000 00000100:00100000:0.0:1788391235.535251:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488000 00000100:00100000:0.0:1788391235.535420:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788391235.535429:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103488000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.535476:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103488000:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391235.535483:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788391235.535513:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488640 00000100:00100000:0.0:1788391235.535517:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488640 00000100:00100000:0.0:1788391235.535548:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788391235.535555:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103488640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.535584:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103488640:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391235.535589:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788391235.535616:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103488000:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.535627:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103488640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536013:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488256 00000100:00100000:0.0:1788391235.536028:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488256 00000100:00100000:0.0:1788391235.536061:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788391235.536068:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103488256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536107:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103488256:12345-0@lo:400:kworker.0 Request processed in 39us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391235.536125:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788391235.536154:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103488256:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536172:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103488384:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391235.536224:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488384 00000100:00100000:0.0:1788391235.536225:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391235.536228:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488384 00000100:00100000:0.0:1788391235.536237:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788391235.536251:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788391235.536258:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103488384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391235.536281:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488512 00000100:00100000:0.0:1788391235.536284:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488512 00000100:00100000:2.0:1788391235.536292:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103488384:12345-0@lo:400:kworker.0 Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391235.536298:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788391235.536302:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788391235.536307:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103488512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536335:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103488512:12345-0@lo:400:kworker.0 Request processed in 27us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391235.536341:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788391235.536366:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103488512:0@lo:400:kworker.0 00000100:00100000:0.0:1788391235.536375:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103488384:0@lo:400:kworker.0 00000100:00080000:3.0:1788391235.537229:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391235.537235:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391235.817372:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391235.817504:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290048 00000100:00100000:2.0:1788391235.817514:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290048 00000100:00080000:3.0:1788391235.817617:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391235.817702:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 469 00000100:00100000:2.0:1788391235.817714:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:40763:x1875263094290048:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788391235.817734:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391235.817805:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd384d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004e7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.817884:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.817898:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.817909:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391235.817943:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391235.817946:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391235.818010:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.818035:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd384d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 7 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.818052:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 6 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391235.818060:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:2.0:1788391235.818063:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391235.818066:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176200, rc 0) 00000100:00100000:2.0:1788391235.818146:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:40763:x1875263094290048:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 434us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391235.818153:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 469 00010000:00010000:0.0:1788391236.557313:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391236.557470:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103488768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391236.557562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391236.558120:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103488768 00000100:00100000:0.0:1788391236.558129:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103488768 00000100:00100000:0.0:1788391236.558188:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788391236.558199:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103488768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391236.558233:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391236.558299:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103488768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391236.558308:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788391236.558348:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103488768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391237.249653:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391237.249685:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391237.249707:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391237.249725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391237.249744:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391237.249768:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290176 00000100:00100000:3.0:1788391237.249778:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290176 00000100:00100000:3.0:1788391237.249877:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391237.249888:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094290176:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391237.249954:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094290176:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391237.249997:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391237.250034:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290304 00000100:00100000:3.0:1788391237.250038:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290304 00000100:00100000:3.0:1788391237.250070:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290688 00000100:00100000:3.0:1788391237.250073:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290688 00000100:00100000:3.0:1788391237.250091:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788391237.250110:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2358:x1875263094290304:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391237.250146:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2358:x1875263094290304:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391237.250153:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:3.0:1788391237.250166:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391237.250172:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094290688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391237.250195:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2359:x1875263094290688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391237.250202:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391237.250220:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290560 00000100:00100000:3.0:1788391237.250223:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290560 00000100:00100000:3.0:1788391237.250246:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290432 00000100:00100000:3.0:1788391237.250249:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290432 00000100:00100000:3.0:1788391237.250268:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391237.250274:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094290560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391237.250297:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094290560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391237.250303:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1788391237.250313:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1788391237.250327:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094290432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391237.250350:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094290432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391237.250356:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00080000:3.0:1788391237.250387:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391237.250390:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391237.250392:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788391237.581084:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788391237.625574:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771471 is committed 00000001:02000400:3.0:1788391237.676415:0:47054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 19:20:37 (1788391237) 00000100:00100000:3.0:1788391238.470138:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.470274:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094290944 00000100:00100000:1.0:1788391238.470284:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094290944 00000100:00100000:1.0:1788391238.470347:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 470 00000100:00100000:1.0:1788391238.470358:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:41021:x1875263094290944:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391238.470378:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391238.470399:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd384e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004ee expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470468:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470481:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470494:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470507:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470514:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470521:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470845:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd384f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470855:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd384f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.470869:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd384f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391238.470878:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788391238.471029:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471037:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471044:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471049:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391238.471053:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471060:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471072:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:1.0:1788391238.471075:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391238.471079:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471100:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd384e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471113:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471119:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471132:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471138:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391238.471140:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471146:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471154:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d6a0d29100) 00010000:00010000:1.0:1788391238.471156:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391238.471159:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471164:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd384f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471637:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd384e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004ee expref: 54 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471649:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd384f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004ee expref: 53 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.471654:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391238.471656:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391238.471657:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c400, rc 0) 00000100:00100000:1.0:1788391238.471715:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:41021:x1875263094290944:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1588us total) trans 30064771472 rc 0/0 00000100:00100000:1.0:1788391238.471728:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 470 00000100:00100000:3.0:1788391238.474211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.474701:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291072 00000100:00100000:0.0:1788391238.474710:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291072 00000100:00100000:0.0:1788391238.474792:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1788391238.474804:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2358:x1875263094291072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391238.474818:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391238.474843:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd384f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004ee expref: 53 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.474874:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391238.474879:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391238.474934:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2358:x1875263094291072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 133us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.474940:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1788391238.475319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.475382:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291200 00000100:00100000:0.0:1788391238.475386:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291200 00000100:00100000:0.0:1788391238.475422:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 471 00000100:00100000:0.0:1788391238.475429:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41021:x1875263094291200:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788391238.475499:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41021:x1875263094291200:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.475505:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 471 00000100:00100000:3.0:1788391238.550653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.550868:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291456 00000100:00100000:1.0:1788391238.550885:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291456 00000100:00100000:1.0:1788391238.550988:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 472 00000100:00100000:1.0:1788391238.550999:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41035:x1875263094291456:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391238.551021:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391238.551025:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391238.551051:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d684cd1800/0x9aafc5f04cd383fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004b6 expref: 52 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551071:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:1.0:1788391238.551075:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391238.551100:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38505 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004f5 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551755:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551770:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551777:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551811:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 5 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.551825:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 5 pid: 42644 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.551847:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103488896:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391238.552204:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391238.561483:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.561555:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291584 00000100:00100000:0.0:1788391238.561565:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291584 00000100:00100000:3.0:1788391238.561607:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103488896:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391238.561624:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 6 pid: 42644 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.561637:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.561677:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1788391238.561687:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094291584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391238.561702:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391238.561709:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 6 pid: 42644 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561732:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 6 pid: 42644 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561772:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd384db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004e7 expref: 6 pid: 42644 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561787:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:0.0:1788391238.561791:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561800:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561807:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.561831:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391238.561850:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.561857:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.561883:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094291584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 197us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.561891:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00010000:00010000:3.0:1788391238.561944:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.561955:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.562001:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391238.563356:0:42645:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcd:0x0], index 0: 0 00010000:00010000:3.0:1788391238.563651:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563663:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563672:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563705:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563712:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563720:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563726:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391238.563730:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563738:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563749:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6830d2500) 00010000:00010000:3.0:1788391238.563752:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391238.563763:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563770:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd3850c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391238.563781:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c797405 reply state 0000000050156ae4 transno 30064771473 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.563789:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391238.563821:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38505 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 54 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563837:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 53 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.563843:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:3.0:1788391238.563845:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391238.563848:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391238.563906:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41035:x1875263094291456:12345-192.168.202.1@tcp:101:bash.0 Request processed in 12909us (13269us total) trans 30064771473 rc 0/0 00000100:00100000:3.0:1788391238.563914:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 472 00010000:00010000:2.0:1788391238.566793:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566806:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566811:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566815:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391238.566819:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566823:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566836:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d68641ee00) 00010000:00010000:2.0:1788391238.566838:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391238.566841:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.566845:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38513 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.567038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.567293:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291712 00000100:00100000:0.0:1788391238.567303:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291712 00000100:00100000:0.0:1788391238.567356:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1788391238.567366:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094291712:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391238.567383:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391238.567402:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc004fc expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391238.567424:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391238.567440:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=1055s v=(0 0) 00010000:00010000:0.0:1788391238.567456:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391238.567463:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 11 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.567478:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 11 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.567486:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8000, rc 0) 00000100:00100000:0.0:1788391238.567535:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2359:x1875263094291712:12345-192.168.202.1@tcp:101:bash.0 Request processed in 172us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.567540:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:1.0:1788391238.569586:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.569627:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291840 00000100:00100000:3.0:1788391238.569635:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291840 00000100:00100000:3.0:1788391238.569672:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1788391238.569679:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:41035:x1875263094291840:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391238.569753:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391238.569769:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00503 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.569812:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 12 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.569821:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391238.569825:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391238.569830:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.569861:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 12 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.569871:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 12 pid: 43327 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.569881:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5872ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103489024:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391238.569939:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391238.574108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.574254:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094291968 00000100:00100000:2.0:1788391238.574264:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094291968 00010000:00010000:2.0:1788391238.574306:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 13 pid: 43327 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.574397:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1788391238.574409:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094291968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788391238.574421:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5872ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103489024:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391238.574425:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391238.574455:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 13 pid: 43327 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.574463:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 13 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.574473:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 13 pid: 43327 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.575289:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dfa4272/0x9aafc5f04cd38528 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004fc expref: 13 pid: 43327 timeout: 1155 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.575485:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391238.575492:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391238.575502:0:43326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.575514:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.575555:0:43326:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.575590:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103489152:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391238.575763:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683065900 going to sleep for 11 seconds 00010000:00010000:2.0:1788391238.576772:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391238.576865:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094291968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2456us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391238.576876:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1788391238.578351:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:43326:1875263103489152:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391238.578371:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:0.0:1788391238.578439:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:41035:x1875263094291840:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8760us (8860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.578447:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1788391238.580074:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.580616:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094292224 00000100:00100000:2.0:1788391238.580625:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094292224 00000100:00100000:2.0:1788391238.580670:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:2.0:1788391238.580679:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:41035:x1875263094292224:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788391238.581059:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41035:x1875263094292224:12345-192.168.202.1@tcp:35:bash.0 Request processed in 380us (987us total) trans 30064771474 rc 0/0 00000100:00100000:2.0:1788391238.581068:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:3.0:1788391238.603883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.604015:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094292352 00000100:00100000:0.0:1788391238.604025:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094292352 00000100:00100000:0.0:1788391238.604096:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 473 00000100:00100000:0.0:1788391238.604106:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41038:x1875263094292352:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391238.604132:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391238.604156:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0050a expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604216:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604229:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604240:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391238.604270:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391238.604273:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391238.604305:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604327:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0050a expref: 56 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604343:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0050a expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.604352:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391238.604355:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391238.604358:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8e00, rc 0) 00000100:00100000:0.0:1788391238.604554:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41038:x1875263094292352:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 448us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.604561:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 473 00010000:00010000:0.0:1788391238.605772:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391238.752921:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.753125:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094292608 00000100:00100000:1.0:1788391238.753135:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094292608 00000100:00100000:1.0:1788391238.753196:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 474 00000100:00100000:1.0:1788391238.753209:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41061:x1875263094292608:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391238.753230:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391238.753249:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00511 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.753329:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd3854b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.753338:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd3854b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.753347:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd3854b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391238.753355:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:1.0:1788391238.753613:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00511 expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.753643:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd3854b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00511 expref: 57 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.753649:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:1.0:1788391238.753651:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391238.753653:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d000, rc 0) 00000100:00100000:1.0:1788391238.753700:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:41061:x1875263094292608:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 495us (788us total) trans 30064771475 rc 0/0 00000100:00100000:1.0:1788391238.754383:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 474 00000100:00100000:1.0:1788391238.755783:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391238.755849:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094292736 00000100:00100000:0.0:1788391238.755855:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094292736 00000100:00100000:0.0:1788391238.755901:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1788391238.755907:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2357:x1875263094292736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391238.755917:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391238.755934:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd3854b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00511 expref: 57 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.755945:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:0.0:1788391238.755948:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391238.756023:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094292736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.756047:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1788391238.757312:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.757372:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094292992 00000100:00100000:2.0:1788391238.757380:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094292992 00000100:00100000:2.0:1788391238.757417:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 475 00000100:00100000:2.0:1788391238.757423:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:41061:x1875263094292992:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391238.757441:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391238.757454:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38559 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00518 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.757536:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.757557:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.757569:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391238.758249:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1788391238.758390:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38559 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00518 expref: 59 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.758415:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00518 expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.758491:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:2.0:1788391238.758495:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788391238.758499:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176000, rc 0) 00000100:00100000:2.0:1788391238.758557:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:41061:x1875263094292992:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1133us (1246us total) trans 30064771476 rc 0/0 00000100:00100000:2.0:1788391238.758569:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 475 00000100:00100000:3.0:1788391238.762902:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.762951:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293120 00000100:00100000:2.0:1788391238.763002:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293120 00000100:00100000:2.0:1788391238.763075:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:2.0:1788391238.763100:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094293120:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1788391238.763146:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.763166:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 11 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.763174:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391238.763178:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391238.763182:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.763212:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 11 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.763225:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 11 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.763239:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103489280:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391238.763325:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788391238.765046:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103489280:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391238.765069:0:44885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.765267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.765331:0:46264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293248 00000100:00100000:1.0:1788391238.765337:0:46264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293248 00002000:00100000:1.0:1788391238.765387:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff95d586481c00 x1875263094293248/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:99/0 lens 496/0 e 0 to 0 dl 1788391249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391238.765397:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586481c00 with x1875263094293248 ext(0->4) 00010000:00010000:1.0:1788391238.765404:0:46264:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.765417:0:46264:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 12 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391238.765425:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d586481c00 00000100:00100000:1.0:1788391238.765452:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1788391238.765461:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094293248:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1788391238.765949:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094293248:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 487us (681us total) trans 30064771211 rc 0/0 00000100:00100000:1.0:1788391238.765957:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00100000:1.0:1788391238.765988:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff95d586481c00 x1875263094293248/t30064771211(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:99/0 lens 496/448 e 0 to 0 dl 1788391249 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391238.765997:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d586481c00 with x1875263094293248 ext(0->4) 00010000:00010000:1.0:1788391238.766003:0:46264:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.766016:0:46264:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391238.766024:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff95d586481c00 00000100:00100000:1.0:1788391238.768035:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.768168:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293376 00000100:00100000:2.0:1788391238.768176:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293376 00010000:00010000:2.0:1788391238.768210:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.768246:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1788391238.768257:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094293376:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391238.768270:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788391238.768286:0:42631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1788391238.768289:0:42631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb mtime from disk: 0 -> 1788391238 00002000:00010000:2.0:1788391238.768291:0:42631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb atime from disk: 0 -> 1788391239 00002000:00010000:2.0:1788391238.768293:0:42631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb ctime from disk: 0 -> 1788391238 00010000:00010000:2.0:1788391238.768299:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.768312:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.768334:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075188555/0x9aafc5f04cd3852f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00503 expref: 14 pid: 43326 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.768349:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391238.768353:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391238.768819:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.768830:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.768863:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391238.768890:0:44885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.768899:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.768914:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094293376:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 657us (883us total) trans 0 rc 0/0 00010000:00010000:0.0:1788391238.768921:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.768925:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00010000:00010000:0.0:1788391238.768935:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.768945:0:44885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.768951:0:44885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391238.768956:0:44885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.768994:0:44885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.769008:0:44885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.769048:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd3856e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.769112:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2358:x1875263094293120:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 6027us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.769119:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1788391238.770869:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.771009:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293632 00000100:00100000:3.0:1788391238.771017:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293632 00000100:00100000:3.0:1788391238.771066:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:3.0:1788391238.771103:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:41061:x1875263094293632:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:3.0:1788391238.771165:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00518 expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391238.771374:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771477 00000001:00080000:3.0:1788391238.771401:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771478 00000001:00080000:3.0:1788391238.771927:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771479 00010000:00010000:3.0:1788391238.772014:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.772026:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.772035:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.772067:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.772081:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 62 pid: 42645 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.772106:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103489408:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391238.772176:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788391238.773764:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103489408:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391238.773783:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.774277:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.774317:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293760 00000100:00100000:2.0:1788391238.774324:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293760 00010000:00010000:2.0:1788391238.774356:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 63 pid: 42645 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.774445:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788391238.774509:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:2356:x1875263094293760:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391238.774522:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391238.774529:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 63 pid: 42645 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774541:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 63 pid: 42645 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774561:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd3851a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc004f5 expref: 63 pid: 42645 timeout: 1155 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774572:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:0.0:1788391238.774575:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774581:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774585:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.774613:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391238.774638:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.774646:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.774661:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:2356:x1875263094293760:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.774669:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000001:00080000:1.0:1788391238.774789:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771480 00000001:00080000:1.0:1788391238.775298:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771481 00000100:00100000:1.0:1788391238.775395:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103489536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391238.775487:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391238.775525:0:45860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103489536 00000100:00100000:1.0:1788391238.775526:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788391238.775530:0:45860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103489536 00000100:00100000:0.0:1788391238.775612:0:45860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788391238.775618:0:45860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103489536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391238.775673:0:45860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103489536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.775680:0:45860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788391238.775753:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103489536:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788391238.775817:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788391238.776335:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771482 00000100:00100000:1.0:1788391238.776374:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103489664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391238.776396:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391238.776415:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391238.776439:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103489664 00000100:00100000:3.0:1788391238.776444:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103489664 00000100:00100000:3.0:1788391238.776488:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788391238.776496:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103489664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391238.776628:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103489664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (230us total) trans 30064771212 rc 0/0 00000100:00100000:3.0:1788391238.776636:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788391238.776656:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103489664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788391238.776692:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771483 00010000:00010000:1.0:1788391238.776805:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776816:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776821:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776825:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391238.776828:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776832:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776843:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:1.0:1788391238.776846:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788391238.776855:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.776859:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38575 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788391238.777220:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788391238.777303:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].17, 64 off9496 00000004:00080000:1.0:1788391238.777311:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1055884349733ns, next at 1056884348347ns, rc = 0 00000001:00080000:1.0:1788391238.777315:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771484 00010000:00010000:1.0:1788391238.777337:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e700) 00010000:00010000:1.0:1788391238.777339:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391238.777343:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38560 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00518 expref: 66 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.777414:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41061:x1875263094293632:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 6315us (6549us total) trans 30064771485 rc 0/0 00000100:00100000:1.0:1788391238.777422:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000020:00080000:1.0:1788391238.777485:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788391238.780403:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.780464:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094293888 00000100:00100000:3.0:1788391238.780474:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094293888 00000100:00100000:3.0:1788391238.780523:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 476 00000100:00100000:3.0:1788391238.780533:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41061:x1875263094293888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391238.780556:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391238.780578:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3857c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0051f expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.780631:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3857c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0051f expref: 66 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.780642:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3857c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0051f expref: 66 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.780655:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788391238.780657:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391238.780661:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:3.0:1788391238.780713:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:41061:x1875263094293888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 183us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391238.780719:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 476 00000100:00100000:3.0:1788391238.782853:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.782903:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094294144 00000100:00100000:2.0:1788391238.782909:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094294144 00000100:00100000:2.0:1788391238.782954:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1788391238.782985:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:41061:x1875263094294144:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391238.783218:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41061:x1875263094294144:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 256us (370us total) trans 30064771486 rc 0/0 00000100:00100000:2.0:1788391238.783226:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788391238.833634:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.833842:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094294272 00000100:00100000:1.0:1788391238.833851:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094294272 00000100:00100000:1.0:1788391238.833904:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 477 00000100:00100000:1.0:1788391238.833911:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41071:x1875263094294272:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1788391238.834223:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834237:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834245:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834258:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834263:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834267:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834349:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834355:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834359:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391238.834390:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834398:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834403:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834407:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834410:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391238.834414:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834418:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834487:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391238.834491:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391238.834495:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834508:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834564:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834569:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834573:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834576:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391238.834578:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834581:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834586:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d6a704c200) 00010000:00010000:0.0:1788391238.834588:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391238.834590:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834594:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd3858a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834602:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834605:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834614:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834617:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391238.834618:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834622:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834625:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:0.0:1788391238.834627:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391238.834628:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391238.834631:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38591 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.834730:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41071:x1875263094294272:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 817us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391238.834738:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 477 00000100:00100000:3.0:1788391238.880148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.880341:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094294528 00000100:00100000:1.0:1788391238.880351:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094294528 00000100:00100000:1.0:1788391238.880432:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 478 00000100:00100000:1.0:1788391238.880440:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41078:x1875263094294528:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1788391238.880457:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391238.880491:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00526 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880567:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880578:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880586:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880595:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880600:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880603:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880690:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880695:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880699:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391238.880715:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:1.0:1788391238.880806:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880824:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880831:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880837:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391238.880841:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880848:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880860:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:1.0:1788391238.880862:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391238.880867:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880872:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd3859f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880884:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880889:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880894:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880898:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391238.880906:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880912:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880918:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d6a0d29700) 00010000:00010000:1.0:1788391238.880920:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391238.880923:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.880928:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd385a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.881007:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 70 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.881021:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 69 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.881028:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788391238.881031:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391238.881033:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16ca00, rc 0) 00000100:00100000:1.0:1788391238.881112:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:41078:x1875263094294528:12345-192.168.202.1@tcp:101:cat.0 Request processed in 671us (970us total) trans 30064771487 rc 0/0 00000100:00100000:1.0:1788391238.881118:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 478 00000100:00100000:3.0:1788391238.884251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.884367:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094294784 00000100:00100000:1.0:1788391238.884376:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094294784 00000100:00100000:1.0:1788391238.884463:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:1.0:1788391238.884473:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:41078:x1875263094294784:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1788391238.884750:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:41078:x1875263094294784:12345-192.168.202.1@tcp:35:cat.0 Request processed in 278us (506us total) trans 30064771488 rc 0/0 00000100:00100000:1.0:1788391238.884758:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:2.0:1788391238.934789:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.935011:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295040 00000100:00100000:3.0:1788391238.935046:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295040 00000100:00100000:3.0:1788391238.935161:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 479 00000100:00100000:3.0:1788391238.935170:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:41084:x1875263094295040:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391238.935191:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391238.935207:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd385bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0052d expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.935287:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.935299:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.935304:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.935328:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.935337:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 71 pid: 43348 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.935347:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103489792:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391238.935429:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391238.937992:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.938019:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103489792:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391238.938138:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295168 00000100:00100000:1.0:1788391238.938145:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295168 00010000:00010000:1.0:1788391238.938183:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 72 pid: 43348 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.938219:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:1.0:1788391238.938229:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:2356:x1875263094295168:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391238.938245:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391238.938251:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 72 pid: 43348 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938263:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 72 pid: 43348 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938283:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385ad lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00526 expref: 72 pid: 43348 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938295:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:1.0:1788391238.938299:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938305:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938326:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.938339:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391238.938377:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:2356:x1875263094295168:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 151us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391238.938382:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00010000:00010000:2.0:1788391238.938625:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.938635:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.938641:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391238.938661:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1788391238.939240:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd385bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 72 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.939253:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 71 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.939258:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391238.939261:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391238.939263:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:2.0:1788391238.939321:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41084:x1875263094295040:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4153us (4544us total) trans 30064771489 rc 0/0 00000100:00100000:2.0:1788391238.939326:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 479 00000100:00100000:3.0:1788391238.952996:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391238.953296:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295296 00000100:00100000:1.0:1788391238.953306:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295296 00000100:00100000:1.0:1788391238.953391:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 480 00000100:00100000:1.0:1788391238.953399:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41085:x1875263094295296:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1788391238.953419:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391238.953438:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00534 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953507:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953526:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953534:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953543:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953548:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953567:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953631:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953638:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 72 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953644:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953669:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 72 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391238.953678:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 72 pid: 42644 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391238.953688:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103489920:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391238.953766:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a686df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391238.956491:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103489920:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391238.956525:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788391238.956530:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.956629:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295552 00000100:00100000:2.0:1788391238.956637:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295552 00000100:00100000:2.0:1788391238.956689:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:2.0:1788391238.956697:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:36381:x1875263094295552:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788391238.957307:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:36381:x1875263094295552:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 607us (779us total) trans 30064771490 rc 0/0 00000100:00100000:2.0:1788391238.957316:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788391238.959104:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.959152:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295680 00000100:00100000:2.0:1788391238.959160:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295680 00010000:00010000:2.0:1788391238.959194:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 74 pid: 42644 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.959235:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:2.0:1788391238.959242:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:2356:x1875263094295680:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391238.959253:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391238.959258:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 74 pid: 42644 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959267:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 74 pid: 42644 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959283:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd385c2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0052d expref: 74 pid: 42644 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959293:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391238.959297:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959304:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959309:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.959329:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391238.959357:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959365:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.959376:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:2356:x1875263094295680:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 135us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391238.959383:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000004:00200000:3.0:1788391238.959404:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00000004:00200000:3.0:1788391238.959409:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391238.959428:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959441:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959460:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959467:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959474:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959480:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391238.959484:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959492:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959502:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:3.0:1788391238.959528:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391238.959533:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959538:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd385d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959550:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959555:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959561:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959565:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391238.959568:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959573:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959581:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d6a0d29700) 00010000:00010000:3.0:1788391238.959583:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391238.959587:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959592:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd385de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959623:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd385d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00534 expref: 73 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959650:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00534 expref: 72 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.959658:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:3.0:1788391238.959660:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391238.959663:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d800, rc 0) 00000100:00100000:3.0:1788391238.959701:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:41085:x1875263094295296:12345-192.168.202.1@tcp:101:rm.0 Request processed in 6302us (6752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391238.959709:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 480 00000100:00100000:0.0:1788391238.962792:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391238.962893:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094295936 00000100:00100000:2.0:1788391238.962901:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094295936 00000100:00100000:2.0:1788391238.963006:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 481 00000100:00100000:2.0:1788391238.963017:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:41085:x1875263094295936:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788391238.963093:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788391238.963124:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d800/0x9aafc5f04cd385e5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00534 expref: 72 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963148:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3857c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0051f expref: 71 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963159:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d68641e500) 00010000:00010000:2.0:1788391238.963172:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3853d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0050a expref: 70 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963178:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:2.0:1788391238.963183:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391238.963202:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963212:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963218:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963225:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963229:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963236:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963308:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963313:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963317:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963668:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963674:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963679:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963684:0:42646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963688:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963692:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963714:0:42646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391238.963733:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963738:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963743:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963749:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391238.963754:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963760:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963768:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d691bfec00) 00010000:00010000:2.0:1788391238.963770:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391238.963773:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963778:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd385fa lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963793:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963798:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963803:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963807:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391238.963809:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963815:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963821:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfee00) 00010000:00010000:2.0:1788391238.963823:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391238.963826:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.963832:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd385ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391238.963844:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb877a4d reply state 00000000e6b28bc0 transno 30064771491 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.963853:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391238.963899:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391238.963906:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.963912:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391238.963915:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.963918:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41085:x1875263094295936:12345-192.168.202.1@tcp:36:rm.0 Request processed in 901us (1130us total) trans 30064771491 rc 0/0 00010000:00010000:3.0:1788391238.963922:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391238.963926:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 481 00010000:00010000:3.0:1788391238.963943:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff95d691bfec00) 00010000:00010000:3.0:1788391238.963946:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391238.963949:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.963955:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38601 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.964150:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391238.964161:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391238.964163:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391238.966346:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966362:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966369:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966374:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391238.966378:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966385:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966400:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d691bfed00) 00010000:00010000:2.0:1788391238.966402:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391238.966406:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391238.966412:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd385f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391238.994689:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.995268:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296064 00000100:00100000:3.0:1788391238.995277:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296064 00000100:00100000:3.0:1788391238.995328:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 482 00000100:00100000:3.0:1788391238.995338:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:41091:x1875263094296064:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391238.995364:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391238.995383:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0053b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995436:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995501:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995551:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391238.995580:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391238.995583:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391238.995598:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995616:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0053b expref: 72 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995629:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0053b expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.995651:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788391238.995653:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391238.995655:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:3.0:1788391238.995715:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41091:x1875263094296064:12345-192.168.202.1@tcp:101:bash.0 Request processed in 366us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391238.995723:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 482 00000100:00100000:1.0:1788391238.997769:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391238.997897:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296320 00000100:00100000:3.0:1788391238.997905:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296320 00000100:00100000:3.0:1788391238.998045:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 483 00000100:00100000:3.0:1788391238.998054:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41091:x1875263094296320:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391238.998070:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391238.998072:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391238.998107:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3860f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0053b expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998126:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788391238.998135:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391238.998148:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38616 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00542 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998271:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998281:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998288:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998310:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998314:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998318:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391238.998723:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcd:0x0], index 1: 0 00010000:00010000:3.0:1788391238.998881:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3862b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998890:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3862b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998897:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3862b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998926:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998932:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998939:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.998945:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391238.998949:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.999139:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.999149:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788391238.999152:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391238.999155:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.999160:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3861d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391238.999170:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f03883b6 reply state 0000000001c1f703 transno 30064771492 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391238.999178:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391238.999202:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38616 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00542 expref: 73 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.999216:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3862b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00542 expref: 72 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391238.999222:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:3.0:1788391238.999224:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391238.999226:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:3.0:1788391238.999292:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:41091:x1875263094296320:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1234us (1527us total) trans 30064771492 rc 0/0 00000100:00100000:3.0:1788391238.999300:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 483 00010000:00010000:2.0:1788391239.000651:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000661:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000666:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000670:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.000673:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000677:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000686:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d68641e000) 00010000:00010000:2.0:1788391239.000688:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.000690:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.000695:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38624 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391239.002340:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391239.002612:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296448 00000100:00100000:0.0:1788391239.002621:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296448 00000100:00080000:3.0:1788391239.002653:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391239.002720:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1788391239.002732:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094296448:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391239.002751:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391239.002780:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00549 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788391239.002802:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788391239.002816:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=1056s v=(0 0) 00010000:00010000:0.0:1788391239.002820:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391239.002826:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 14 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.002839:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 14 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.002848:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8800, rc 0) 00000100:00100000:0.0:1788391239.002893:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094296448:12345-192.168.202.1@tcp:101:bash.0 Request processed in 165us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391239.002900:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1788391239.004813:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391239.004879:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296576 00000100:00100000:3.0:1788391239.004896:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296576 00000100:00100000:3.0:1788391239.004934:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:3.0:1788391239.004944:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:41091:x1875263094296576:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391239.005013:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391239.005030:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00550 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.005061:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.005070:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391239.005073:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391239.005078:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 15 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.005123:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.005133:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391239.005143:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103490048:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391239.005242:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391239.006699:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103490048:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391239.006728:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 15 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.006763:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:3.0:1788391239.006871:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:41091:x1875263094296576:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1927us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391239.006881:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1788391239.007036:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.007272:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296704 00000100:00100000:2.0:1788391239.007282:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296704 00010000:00010000:2.0:1788391239.007311:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.007341:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:2.0:1788391239.007348:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094296704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391239.007359:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391239.007382:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.007395:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.007414:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475711e9/0x9aafc5f04cd38639 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00549 expref: 15 pid: 43327 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.007433:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391239.007437:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391239.007445:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.007461:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.007491:0:45855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.007503:0:45855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:45855:1875263103490176:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391239.007684:0:45855:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6851d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391239.009724:0:45855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:45855:1875263103490176:192.168.202.1@tcp:105: 00010000:00010000:2.0:1788391239.009745:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391239.009795:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094296704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2445us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391239.009803:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788391239.010694:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391239.010776:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094296960 00000100:00100000:1.0:1788391239.010782:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094296960 00000100:00100000:1.0:1788391239.010829:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1788391239.010836:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:41091:x1875263094296960:12345-192.168.202.1@tcp:35:bash.0 00000100:00080000:3.0:1788391239.011137:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391239.011214:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:41091:x1875263094296960:12345-192.168.202.1@tcp:35:bash.0 Request processed in 376us (519us total) trans 30064771493 rc 0/0 00000100:00100000:1.0:1788391239.011221:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1788391239.039137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391239.039213:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094297088 00000100:00100000:3.0:1788391239.039222:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094297088 00000100:00100000:3.0:1788391239.039267:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 484 00000100:00100000:3.0:1788391239.039273:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:41094:x1875263094297088:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391239.039292:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391239.039310:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00557 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039375:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039389:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039399:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391239.039435:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788391239.039438:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391239.039456:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039474:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00557 expref: 75 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039494:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00557 expref: 74 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.039500:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e600) 00010000:00010000:3.0:1788391239.039502:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788391239.039505:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:3.0:1788391239.039562:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41094:x1875263094297088:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 288us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391239.039568:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 484 00000100:00100000:0.0:1788391239.244760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.244945:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094297344 00000100:00100000:2.0:1788391239.244955:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094297344 00000100:00100000:2.0:1788391239.245044:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 485 00000100:00100000:2.0:1788391239.245055:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41123:x1875263094297344:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391239.245075:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391239.245107:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0055e expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.245197:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3865c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.245211:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3865c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.245222:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3865c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391239.245233:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:2.0:1788391239.245346:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0055e expref: 77 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.245365:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3865c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0055e expref: 76 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.245374:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788391239.245376:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391239.245378:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177200, rc 0) 00000100:00100000:2.0:1788391239.245425:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41123:x1875263094297344:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 372us (676us total) trans 30064771494 rc 0/0 00000100:00100000:2.0:1788391239.245432:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 485 00000100:00100000:0.0:1788391239.250085:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391239.250153:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094297600 00000100:00100000:3.0:1788391239.250163:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094297600 00000100:00100000:3.0:1788391239.250214:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 486 00000100:00100000:3.0:1788391239.250223:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41123:x1875263094297600:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391239.250330:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391239.250353:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3866a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00565 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391239.250392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:3.0:1788391239.250446:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38671 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.250504:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38671 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391239.250517:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094297728 00000100:00100000:1.0:1788391239.250523:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094297728 00010000:00010000:3.0:1788391239.250527:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38671 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391239.250543:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00000100:00100000:1.0:1788391239.250576:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1788391239.250583:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:2357:x1875263094297728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391239.250593:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391239.250610:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3865c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0055e expref: 78 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.250629:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788391239.250633:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391239.250691:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd3866a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00565 expref: 79 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391239.250692:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:2357:x1875263094297728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391239.250718:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00010000:00010000:3.0:1788391239.250720:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38671 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00565 expref: 78 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.250730:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:3.0:1788391239.250733:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391239.250736:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:3.0:1788391239.250762:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41123:x1875263094297600:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 540us (695us total) trans 30064771495 rc 0/0 00000100:00100000:3.0:1788391239.250769:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 486 00000100:00100000:3.0:1788391239.253012:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391239.254236:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094297856 00000100:00100000:1.0:1788391239.254248:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094297856 00000100:00100000:1.0:1788391239.254330:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1788391239.254342:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41123:x1875263094297856:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1788391239.254359:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391239.254384:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38671 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00565 expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.254402:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:1.0:1788391239.254423:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391239.254478:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41123:x1875263094297856:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 138us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391239.254487:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1788391239.256486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.256545:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094298112 00000100:00100000:2.0:1788391239.256554:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094298112 00000100:00100000:2.0:1788391239.256607:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:2.0:1788391239.256616:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41123:x1875263094298112:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391239.256940:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41123:x1875263094298112:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 324us (458us total) trans 30064771496 rc 0/0 00000100:00100000:2.0:1788391239.256949:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:0.0:1788391239.259347:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.259405:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094298368 00000100:00100000:2.0:1788391239.259414:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094298368 00000100:00100000:2.0:1788391239.259462:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1788391239.259474:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41123:x1875263094298368:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391239.259667:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41123:x1875263094298368:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 195us (326us total) trans 30064771497 rc 0/0 00000100:00100000:2.0:1788391239.259675:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1788391239.332197:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.332258:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094298624 00000100:00100000:2.0:1788391239.332266:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094298624 00000100:00100000:2.0:1788391239.332347:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 487 00000100:00100000:2.0:1788391239.332355:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41130:x1875263094298624:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788391239.332407:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788391239.332429:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3862b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00542 expref: 78 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332443:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d68641ea00) 00010000:00010000:2.0:1788391239.332464:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd3864e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00557 expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332469:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e600) 00010000:00010000:2.0:1788391239.332475:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391239.332499:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332508:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332514:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332521:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332526:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332530:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332615:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332622:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.332629:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391239.333175:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].17, 64 off9568 00000004:00080000:2.0:1788391239.333186:0:42646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1056440224453ns, next at 1057440222176ns, rc = 0 00010000:00010000:2.0:1788391239.333238:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333248:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333255:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333261:0:42646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333267:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333277:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333298:0:42646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391239.333314:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333321:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333328:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333333:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391239.333337:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391239.333338:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333349:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333350:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333365:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d691bfeb00) 00010000:00010000:2.0:1788391239.333369:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391239.333373:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333388:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3868d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333393:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391239.333399:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333403:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333407:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333425:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333428:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff95d691bfeb00) 00010000:00010000:0.0:1788391239.333435:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391239.333437:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333440:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333449:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.333455:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333458:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38694 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333461:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.333475:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfed00) 00010000:00010000:2.0:1788391239.333477:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.333479:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333481:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391239.333485:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3867f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.333486:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391239.333491:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788391239.333499:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7cf5cc5 reply state 000000006d1576d4 transno 30064771498 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.333506:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391239.333577:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41130:x1875263094298624:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1220us (1387us total) trans 30064771498 rc 0/0 00000100:00100000:2.0:1788391239.333585:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 487 00010000:00010000:2.0:1788391239.335928:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.335943:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.335948:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.335952:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.335955:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.336003:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.336015:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d691bfee00) 00010000:00010000:2.0:1788391239.336023:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.336026:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.336030:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38686 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391239.367221:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391239.367322:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094298752 00000100:00100000:1.0:1788391239.367334:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094298752 00000100:00100000:1.0:1788391239.367398:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 488 00000100:00100000:1.0:1788391239.367409:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41136:x1875263094298752:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1788391239.367435:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391239.367458:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd3869b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0056c expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367603:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367618:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367631:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391239.367667:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391239.367671:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391239.367690:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367714:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd3869b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0056c expref: 79 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367731:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0056c expref: 78 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.367768:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391239.367771:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391239.367775:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d600, rc 0) 00000100:00100000:1.0:1788391239.367841:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41136:x1875263094298752:12345-192.168.202.1@tcp:101:bash.0 Request processed in 433us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391239.367848:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 488 00000100:00100000:0.0:1788391239.374541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391239.375153:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299008 00000100:00100000:3.0:1788391239.375164:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299008 00000100:00100000:3.0:1788391239.375225:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 489 00000100:00100000:3.0:1788391239.375236:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41136:x1875263094299008:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391239.375256:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391239.375259:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788391239.375283:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0056c expref: 78 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.375301:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:3.0:1788391239.375310:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391239.375326:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd386a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00573 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.375456:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.375470:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.375481:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376179:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376190:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376198:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391239.376641:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xce:0x0], index 0: 0 00010000:00010000:3.0:1788391239.376798:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd386be lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376807:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd386be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376814:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd386be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376843:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376861:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376868:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376874:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391239.376877:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376885:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376905:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641ed00) 00010000:00010000:3.0:1788391239.376909:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391239.376912:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.376918:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391239.377107:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fda83166 reply state 00000000704052b5 transno 30064771499 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391239.377116:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391239.377149:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd386a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00573 expref: 80 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.377170:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd386be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00573 expref: 79 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.377188:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788391239.377190:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391239.377193:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:3.0:1788391239.377270:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41136:x1875263094299008:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2035us (2737us total) trans 30064771499 rc 0/0 00000100:00100000:3.0:1788391239.377278:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 489 00010000:00010000:2.0:1788391239.378877:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.378895:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.378904:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.378910:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.378915:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.378922:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.379106:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d68641ef00) 00010000:00010000:2.0:1788391239.379110:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.379114:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.379121:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd386b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391239.380320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.380503:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299136 00000100:00100000:2.0:1788391239.380512:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299136 00000100:00080000:3.0:1788391239.380557:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391239.380623:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1788391239.380635:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094299136:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391239.380654:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391239.380674:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0057a expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391239.380701:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788391239.380720:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=1056s v=(0 0) 00010000:00010000:2.0:1788391239.380725:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391239.380734:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 13 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.380752:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 13 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.380767:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391239.380829:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094299136:12345-192.168.202.1@tcp:101:bash.0 Request processed in 196us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391239.380836:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1788391239.384241:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.384284:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299264 00000100:00100000:2.0:1788391239.384294:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299264 00000100:00100000:2.0:1788391239.384346:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1788391239.384357:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:41136:x1875263094299264:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1788391239.384374:0:43327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391239.384393:0:43327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00581 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.384425:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 14 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.384434:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391239.384438:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391239.384443:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 14 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.384476:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 14 pid: 44885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.384488:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 14 pid: 44885 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.384501:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103490304:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391239.384587:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6851d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391239.387218:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:43327:1875263103490304:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391239.387224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00010000:00010000:2.0:1788391239.387251:0:43327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 14 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391239.387298:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299392 00000100:00100000:0.0:1788391239.387306:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299392 00010000:00010000:0.0:1788391239.387343:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 15 pid: 44885 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391239.387382:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1788391239.387392:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094299392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391239.387425:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391239.387436:0:43327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176a00, rc 0) 00010000:00010000:0.0:1788391239.387446:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 15 pid: 44885 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.387458:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 15 pid: 44885 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.387478:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f618a9/0x9aafc5f04cd386cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0057a expref: 15 pid: 44885 timeout: 1156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.387485:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:41136:x1875263094299264:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3131us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391239.387492:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00010000:00010000:0.0:1788391239.387493:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391239.387497:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391239.387504:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 13 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.387729:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 13 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.387755:0:45855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 13 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391239.387764:0:45855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:45855:1875263103490432:192.168.202.1@tcp:105: 00000100:00100000:0.0:1788391239.387852:0:45855:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6830653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391239.391312:0:45855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:45855:1875263103490432:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391239.391340:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391239.391404:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094299392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4012us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391239.391415:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:3.0:1788391239.391504:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.391592:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299648 00000100:00100000:2.0:1788391239.391600:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299648 00000100:00100000:2.0:1788391239.391647:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:2.0:1788391239.391656:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:41136:x1875263094299648:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788391239.392023:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41136:x1875263094299648:12345-192.168.202.1@tcp:35:bash.0 Request processed in 367us (517us total) trans 30064771500 rc 0/0 00000100:00100000:2.0:1788391239.392030:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1788391239.418463:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391239.418818:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094299776 00000100:00100000:1.0:1788391239.418828:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094299776 00000100:00100000:1.0:1788391239.418875:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 490 00000100:00100000:1.0:1788391239.418883:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41139:x1875263094299776:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391239.418906:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391239.419032:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd386da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00588 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419110:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419121:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419130:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391239.419166:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788391239.419170:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391239.419189:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419230:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd386da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00588 expref: 82 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419244:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00588 expref: 81 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.419249:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:1.0:1788391239.419252:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391239.419254:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d600, rc 0) 00000100:00100000:1.0:1788391239.419300:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41139:x1875263094299776:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 418us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391239.419305:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 490 00000040:00080000:2.0:1788391239.437237:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391239.437246:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391239.437283:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:2.0:1788391239.437290:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391239.560780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.560943:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094300032 00000100:00100000:2.0:1788391239.560953:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094300032 00000100:00100000:2.0:1788391239.561168:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 491 00000100:00100000:2.0:1788391239.561176:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41161:x1875263094300032:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391239.561193:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391239.561209:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd386e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0058f expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.561289:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd386ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.561300:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd386ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.561308:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd386ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391239.561316:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:2.0:1788391239.561415:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd386e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0058f expref: 84 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.561428:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd386ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0058f expref: 83 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.561434:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:2.0:1788391239.561436:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391239.561439:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391239.561485:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:41161:x1875263094300032:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 311us (714us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1788391239.561490:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 491 00000100:00100000:0.0:1788391239.575318:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391239.575372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.575466:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094300416 00000100:00100000:2.0:1788391239.575477:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094300416 00000100:00100000:3.0:1788391239.575499:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094300288 00000100:00100000:3.0:1788391239.575506:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094300288 00000100:00100000:3.0:1788391239.575547:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 492 00000100:00100000:3.0:1788391239.575558:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41161:x1875263094300288:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391239.575581:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391239.575601:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386fd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00596 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391239.575671:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1788391239.575681:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:2356:x1875263094300416:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391239.575690:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391239.575701:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38704 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.575709:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd386ef lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0058f expref: 85 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.575718:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38704 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.575730:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788391239.575731:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38704 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391239.575739:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1788391239.575765:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00000100:00100000:1.0:1788391239.575791:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:2356:x1875263094300416:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391239.575797:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00010000:00010000:3.0:1788391239.575885:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd386fd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00596 expref: 85 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.575900:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38704 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00596 expref: 84 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.575908:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788391239.575910:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391239.575913:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391239.575937:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41161:x1875263094300288:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 381us (629us total) trans 30064771502 rc 0/0 00000100:00100000:3.0:1788391239.575944:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 492 00000100:00100000:0.0:1788391239.583259:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391239.583318:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094300544 00000100:00100000:3.0:1788391239.583330:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094300544 00000100:00100000:3.0:1788391239.583398:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1788391239.583409:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41161:x1875263094300544:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1788391239.583424:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391239.583450:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38704 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00596 expref: 84 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.583467:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:3.0:1788391239.583472:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391239.583527:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:41161:x1875263094300544:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391239.583535:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1788391239.585048:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391239.585105:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094300800 00000100:00100000:1.0:1788391239.585112:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094300800 00000100:00100000:1.0:1788391239.585166:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1788391239.585176:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:41161:x1875263094300800:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391239.585470:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41161:x1875263094300800:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 296us (433us total) trans 30064771503 rc 0/0 00000100:00100000:1.0:1788391239.585479:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:0.0:1788391239.586938:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.586985:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301056 00000100:00100000:2.0:1788391239.586993:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301056 00000100:00100000:2.0:1788391239.587038:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1788391239.587116:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41161:x1875263094301056:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391239.587540:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41161:x1875263094301056:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 427us (606us total) trans 30064771504 rc 0/0 00000100:00100000:2.0:1788391239.587548:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1788391239.602907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391239.603092:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301312 00000100:00100000:2.0:1788391239.603101:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301312 00000100:00100000:2.0:1788391239.603163:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 493 00000100:00100000:2.0:1788391239.603173:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41162:x1875263094301312:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788391239.603232:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788391239.603258:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd386be lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00573 expref: 85 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603278:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d68641e400) 00010000:00010000:2.0:1788391239.603293:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd386e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00588 expref: 84 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603302:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a0d29000) 00010000:00010000:2.0:1788391239.603308:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391239.603331:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603343:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603358:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603371:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603378:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603385:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603475:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603482:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.603488:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391239.603907:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].18, 64 off9560 00010000:00010000:2.0:1788391239.604012:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604022:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604031:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604037:0:42646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604045:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604051:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604071:0:42646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391239.604099:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604105:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604110:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788391239.604111:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604120:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604120:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.604127:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604133:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391239.604140:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604141:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604154:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604162:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d691bfe000) 00010000:00010000:2.0:1788391239.604168:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391239.604172:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604175:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff95d691bfe000) 00010000:00010000:3.0:1788391239.604180:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788391239.604182:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38720 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604183:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604196:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38727 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391239.604209:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391239.604211:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391239.604213:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391239.604230:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604238:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604245:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604250:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.604253:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604260:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604268:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe800) 00010000:00010000:2.0:1788391239.604271:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.604274:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.604281:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38712 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391239.604294:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f036b19 reply state 000000004d32bee3 transno 30064771505 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391239.604302:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391239.604385:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41162:x1875263094301312:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1210us (1483us total) trans 30064771505 rc 0/0 00000100:00100000:2.0:1788391239.604394:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 493 00010000:00010000:2.0:1788391239.605930:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.605940:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.605946:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.605951:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391239.605956:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.606185:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.606198:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff95d691bfe600) 00010000:00010000:2.0:1788391239.606202:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391239.606206:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391239.606213:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38719 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391239.629296:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391239.649761:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771211 is committed 00000001:00080000:2.0:1788391239.649836:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771212 is committed 00010000:00010000:0.0:1788391240.653319:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391240.654288:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103490816:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654457:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391240.654464:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103490944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654527:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103490688:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654554:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654570:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103491200:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654593:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654629:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788391240.654635:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103490560:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654664:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654689:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103491072:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654713:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391240.654747:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103490816 00000100:00100000:2.0:1788391240.654755:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103490816 00000100:00100000:2.0:1788391240.654820:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103490688 00000100:00100000:2.0:1788391240.654823:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103490688 00000100:00100000:2.0:1788391240.654852:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788391240.654863:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103490816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.654920:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103490816:12345-0@lo:400:kworker.0 Request processed in 58us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.654928:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788391240.654947:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788391240.654953:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103490688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655000:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103490688:12345-0@lo:400:kworker.0 Request processed in 47us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.655005:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788391240.655024:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103490944 00000100:00100000:2.0:1788391240.655027:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103490944 00000100:00100000:2.0:1788391240.655050:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491200 00000100:00100000:2.0:1788391240.655052:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491200 00000100:00100000:2.0:1788391240.655076:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491072 00000100:00100000:2.0:1788391240.655079:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491072 00000100:00100000:2.0:1788391240.655096:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788391240.655102:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103490944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655133:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103490944:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.655140:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788391240.655150:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788391240.655156:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103491200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655180:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103491200:12345-0@lo:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.655186:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788391240.655195:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788391240.655200:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655222:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103491072:12345-0@lo:400:kworker.0 Request processed in 21us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.655227:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788391240.655248:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103490560 00000100:00100000:2.0:1788391240.655252:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103490560 00000100:00100000:2.0:1788391240.655277:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788391240.655283:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655313:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103490560:12345-0@lo:400:kworker.0 Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391240.655320:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788391240.655350:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391240.655355:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391240.655358:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391240.655402:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103490560:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655416:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103491072:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655425:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771212 gen 2 00000004:00080000:2.0:1788391240.655431:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771212 committed transno 30064771212 00000100:00100000:2.0:1788391240.655455:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103490688:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655465:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103491200:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655494:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103490944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391240.655504:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103490816:0@lo:400:kworker.0 00000004:00080000:2.0:1788391240.656805:0:42669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1057763842706ns, next at 1058763839681ns, rc = 0 00000100:00100000:2.0:1788391240.656825:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391240.656839:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103491328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391240.656883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391240.656990:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491328 00000100:00100000:1.0:1788391240.656996:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491328 00000100:00100000:1.0:1788391240.657039:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391240.657048:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103491328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391240.657094:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391240.657140:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103491328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391240.657146:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788391240.657185:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103491328:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788391241.485749:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391241.485758:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391241.486054:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 4 00000040:00080000:2.0:1788391241.486075:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391241.677120:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1788391241.677126:0:42667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1058784163719ns, next at 1059784161081ns, rc = 0 00000100:00100000:2.0:1788391241.677144:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391241.677210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391241.677292:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391241.677340:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491456 00000100:00100000:0.0:1788391241.677348:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491456 00000100:00100000:0.0:1788391241.677398:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788391241.677408:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103491456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391241.677439:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391241.677501:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391241.677507:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788391241.677670:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391242.109755:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391242.109808:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301440 00000100:00100000:0.0:1788391242.109822:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301440 00000100:00100000:0.0:1788391242.109908:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 494 00000100:00100000:0.0:1788391242.109922:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:41584:x1875263094301440:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:0.0:1788391242.109957:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391242.110012:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3872e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0059d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110128:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110146:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110163:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391242.110213:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391242.110218:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391242.110247:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110275:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd3872e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0059d expref: 86 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110292:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0059d expref: 85 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.110301:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391242.110305:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391242.110309:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8c00, rc 0) 00000100:00100000:0.0:1788391242.110381:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41584:x1875263094301440:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 462us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391242.110389:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 494 00000100:00080000:0.0:1788391242.110414:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391242.163577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391242.163695:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301568 00000100:00100000:2.0:1788391242.163710:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301568 00000100:00100000:2.0:1788391242.163919:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 495 00000100:00100000:2.0:1788391242.163932:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41021:x1875263094301568:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788391242.164203:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41021:x1875263094301568:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 272us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391242.164212:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 495 00000100:00100000:0.0:1788391242.168390:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391242.168575:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301824 00000100:00100000:1.0:1788391242.168598:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301824 00000100:00100000:1.0:1788391242.168672:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1788391242.168685:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:41021:x1875263094301824:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788391242.169356:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+86:41021:x1875263094301824:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 672us (974us total) trans 30064771506 rc 0/0 00000100:00100000:1.0:1788391242.169365:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788391242.255379:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391242.255539:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094301952 00000100:00100000:2.0:1788391242.255550:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094301952 00000100:00100000:2.0:1788391242.256066:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 496 00000100:00100000:2.0:1788391242.256081:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:41602:x1875263094301952:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:2.0:1788391242.256108:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391242.256132:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd3873c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005a4 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256202:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256215:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256225:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391242.256272:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391242.256276:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391242.256296:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256318:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd3873c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 7 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256333:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 6 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.256340:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:2.0:1788391242.256342:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391242.256345:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177200, rc 0) 00000100:00100000:2.0:1788391242.256421:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:41602:x1875263094301952:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 344us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391242.256430:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 496 00000100:00080000:0.0:1788391242.257152:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391242.357837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391242.357881:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391242.357917:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302080 00000100:00100000:0.0:1788391242.357929:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302080 00000100:00100000:2.0:1788391242.357935:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302336 00000100:00100000:2.0:1788391242.357939:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302336 00000100:00100000:0.0:1788391242.358003:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391242.358012:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788391242.358014:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094302080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391242.358019:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094302336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:1.0:1788391242.358114:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391242.358304:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391242.358311:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094302336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 290us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391242.358311:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094302080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 297us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391242.358321:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1788391242.358321:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391242.358340:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302208 00000100:00100000:2.0:1788391242.358343:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302208 00000100:00100000:2.0:1788391242.358375:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1788391242.358382:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094302208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:0.0:1788391242.358383:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391242.358458:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094302208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391242.358468:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:0.0:1788391242.701836:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788391242.736020:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:3.0:1788391242.736223:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103491712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788391242.736300:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391242.736355:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391242.736361:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103491584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788391242.736381:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391242.736409:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491712 00000100:00100000:3.0:1788391242.736428:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491712 00000100:00100000:3.0:1788391242.736475:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491584 00000100:00100000:3.0:1788391242.736479:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491584 00000100:00100000:3.0:1788391242.736497:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788391242.736506:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103491712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788391242.736532:0:43698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:206 count 1 00010000:00010000:3.0:1788391242.736558:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736589:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 10 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736599:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xce:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1788391242.736603:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391242.736608:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 4/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736632:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 10 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736778:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 10 pid: 43327 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391242.736804:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103491840:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391242.736862:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299e40 going to sleep for 11 seconds 00000100:00080000:3.0:1788391242.736874:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391242.736886:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788391242.736894:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103491584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788391242.736907:0:44885:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:205 count 1 00002000:00010000:3.0:1788391242.736927:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 5, mtime: 0x6a98af46, atime: 0x6a98af47, ctime: 0x6a98af46, blocks: 0xb 00010000:00010000:3.0:1788391242.736933:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736941:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=1059s v=(0 0) 00010000:00010000:3.0:1788391242.736944:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391242.736950:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736983:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.736993:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.737000:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.737028:0:44885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391242.737941:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103491584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1047us (1558us total) trans 30064771213 rc 0/0 00000100:00100000:3.0:1788391242.737978:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:3.0:1788391242.738103:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391242.738110:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.738119:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391242.738124:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.738133:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.738152:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.738159:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.738175:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391242.738176:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391242.738178:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788391242.739032:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771506 is committed 00000004:00080000:3.0:1788391242.739075:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000020:00080000:3.0:1788391242.739169:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6b6b3cd80 refcount 2 committed 0 result 0 batchid 25769803911 00000020:00080000:3.0:1788391242.739174:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d682eb5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6b6b3c840 00000020:00080000:3.0:1788391242.739178:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f071200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58750c800 00000004:00080000:3.0:1788391242.739205:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:3.0:1788391242.739227:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:3.0:1788391242.739381:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103491968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788391242.739510:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391242.739557:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103491968 00000100:00100000:3.0:1788391242.739565:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103491968 00000100:00100000:3.0:1788391242.739619:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788391242.739627:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103491968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788391242.739828:0:43327:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:205 count 1 00010000:00010000:3.0:1788391242.739852:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.739870:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 13 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.739878:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcd:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1788391242.739882:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391242.739886:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.739915:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 13 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.739939:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 13 pid: 43326 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391242.739952:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103492096:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391242.740020:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d587299840 going to sleep for 11 seconds 00000100:00080000:3.0:1788391242.740147:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391242.740173:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103491840:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391242.740190:0:43698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788391242.740249:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803911 committed batchid 25769803910 00000020:00080000:1.0:1788391242.740407:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803910 00000004:00080000:0.0:1788391242.740640:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586481180/2, rc 0, transno 30064771213 00000100:00100000:0.0:1788391242.740702:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103491584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788391242.740850:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391242.740956:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302464 00000100:00100000:0.0:1788391242.741126:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302464 00010000:00010000:0.0:1788391242.741152:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 11 pid: 43327 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391242.741212:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:0.0:1788391242.741221:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094302464:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391242.741232:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391242.741238:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 11 pid: 43327 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.741250:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 11 pid: 43327 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.741285:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebfecc28/0x9aafc5f04cd386d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00581 expref: 11 pid: 43327 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.741298:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391242.741302:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788391242.741307:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.741315:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.741344:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391242.741379:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094302464:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 159us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391242.741387:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00010000:00010000:1.0:1788391242.741588:0:43698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391242.741597:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391242.741606:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391242.741614:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391242.741639:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391242.742124:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103491712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5618us (5822us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1788391242.742132:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00010000:3.0:1788391242.742372:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391242.742379:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.742388:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391242.742392:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.742403:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.742428:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.742448:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000003bb756/0x9aafc5f04cd3874a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.742465:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391242.742467:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391242.742469:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391242.742796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391242.742888:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103492096:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391242.742908:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391242.743226:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302592 00000100:00100000:2.0:1788391242.743233:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302592 00010000:00010000:2.0:1788391242.743261:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391242.743293:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:2.0:1788391242.743302:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094302592:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391242.743314:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391242.743319:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.743336:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.743352:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071afbbad/0x9aafc5f04cd38640 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00550 expref: 14 pid: 43326 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.743374:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391242.743377:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391242.743381:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.743390:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391242.743409:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391242.743452:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094302592:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 151us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391242.743459:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000004:00080000:0.0:1788391242.743931:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586480e00/2, rc 0, transno 30064771214 00000100:00100000:0.0:1788391242.743938:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103491712:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788391242.744150:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.744160:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.744169:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.744178:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391242.744236:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788391242.745434:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103491968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5803us (5921us total) trans 30064771280 rc 0/0 00000100:00100000:3.0:1788391242.745454:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00010000:0.0:1788391242.745818:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391242.745827:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.745839:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391242.745844:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.745865:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.745882:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.745890:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075188555/0x9aafc5f04cd38758 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391242.745908:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391242.745910:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391242.745911:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391242.746146:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d586482300/2, rc 0, transno 30064771280 00000100:00100000:1.0:1788391242.746154:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103491968:0@lo:6:osp-syn-1-0.0 00000001:02000400:0.0:1788391243.655004:0:47253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 19:20:43 (1788391243) 00010000:00010000:3.0:1788391243.725610:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391243.784422:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771280 is committed 00000100:00100000:0.0:1788391243.877108:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391243.877175:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302848 00000100:00100000:2.0:1788391243.877186:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302848 00000100:00100000:2.0:1788391243.877246:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 497 00000100:00100000:2.0:1788391243.877255:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+51:41797:x1875263094302848:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391243.877276:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391243.877291:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3875f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005ab expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877349:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877360:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877367:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877377:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877382:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.877386:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.878045:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38774 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.878054:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38774 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.878061:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38774 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391243.878069:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788391243.878238:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878249:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878256:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878261:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391243.878265:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878272:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878285:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:3.0:1788391243.878288:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391243.878292:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878298:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38766 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878318:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878325:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878343:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878347:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391243.878351:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878357:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878365:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d691bfe000) 00010000:00010000:3.0:1788391243.878367:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391243.878370:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878375:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3876d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878835:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3875f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ab expref: 54 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878849:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38774 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ab expref: 53 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.878856:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391243.878858:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391243.878861:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176e00, rc 0) 00000100:00100000:3.0:1788391243.878942:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:41797:x1875263094302848:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1686us (1843us total) trans 30064771507 rc 0/0 00000100:00100000:3.0:1788391243.878997:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 497 00000100:00100000:3.0:1788391243.884896:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391243.884945:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391243.885089:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094302976 00000100:00100000:1.0:1788391243.885100:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094302976 00000100:00100000:1.0:1788391243.885161:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1788391243.885173:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:2359:x1875263094302976:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391243.885191:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391243.885229:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38774 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ab expref: 53 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391243.885247:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391243.885251:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391243.885302:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2359:x1875263094302976:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 133us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391243.885307:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1788391243.886753:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094303104 00000100:00100000:0.0:1788391243.886761:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094303104 00000100:00100000:0.0:1788391243.886802:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 498 00000100:00100000:0.0:1788391243.886809:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41797:x1875263094303104:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788391243.886883:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41797:x1875263094303104:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 76us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391243.886890:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 498 00000100:00100000:3.0:1788391243.926632:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391243.926694:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094303360 00000100:00100000:0.0:1788391243.926706:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094303360 00000100:00100000:0.0:1788391243.926767:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 499 00000100:00100000:0.0:1788391243.926778:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41631:x1875263094303360:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1788391243.926815:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391243.926818:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391243.926846:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0059d expref: 52 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.926866:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391243.926870:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391243.926884:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38782 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005b2 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.927192:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.927207:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.927215:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.927247:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 5 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.927260:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 5 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391243.927273:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103492224:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391243.927374:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b31a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788391243.929172:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687862300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103492224:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391243.929209:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391243.929566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391243.929771:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094303488 00000100:00100000:0.0:1788391243.929782:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094303488 00010000:00010000:0.0:1788391243.929829:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 6 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391243.929879:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:0.0:1788391243.929896:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+6:2356:x1875263094303488:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391243.929917:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391243.929925:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 6 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930495:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 6 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930525:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38743 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005a4 expref: 6 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930546:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391243.930553:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930564:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930572:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391243.930665:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391243.930740:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094303488:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 849us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391243.930750:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00010000:00010000:3.0:1788391243.930847:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.930940:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.931203:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.931217:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.931225:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391243.933163:0:42644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xce:0x0], index 1: 0 00010000:00010000:3.0:1788391243.933462:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933478:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933489:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933530:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933547:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933556:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933562:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391243.933568:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933577:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933591:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:3.0:1788391243.933594:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391243.933600:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933606:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38789 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391243.933620:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090628a00 reply state 000000006c77f034 transno 30064771508 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391243.933631:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391243.933673:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38782 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933693:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 53 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.933712:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:3.0:1788391243.933715:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391243.933717:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391243.933873:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41631:x1875263094303360:12345-192.168.202.1@tcp:101:bash.0 Request processed in 7095us (7248us total) trans 30064771508 rc 0/0 00000100:00100000:3.0:1788391243.933882:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 499 00010000:00010000:2.0:1788391243.937641:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937663:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937671:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937676:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391243.937682:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937690:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937708:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff95d68641e300) 00010000:00010000:2.0:1788391243.937711:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391243.937716:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.937722:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38790 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391243.938428:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391243.938489:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094303616 00000100:00100000:3.0:1788391243.938503:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094303616 00000100:00100000:3.0:1788391243.938565:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391243.938573:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:41631:x1875263094303616:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1788391243.938592:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391243.938612:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005b9 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391243.938638:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788391243.938659:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=1061s v=(0 0) 00010000:00010000:3.0:1788391243.938663:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391243.938671:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 14 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.938684:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 14 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391243.938695:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:3.0:1788391243.938778:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:41631:x1875263094303616:12345-192.168.202.1@tcp:101:bash.0 Request processed in 206us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391243.938806:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391243.942528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391243.942628:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094303872 00000100:00100000:2.0:1788391243.942639:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094303872 00000100:00100000:2.0:1788391243.942739:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1788391243.942752:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:41631:x1875263094303872:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1788391243.943266:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41631:x1875263094303872:12345-192.168.202.1@tcp:35:bash.0 Request processed in 516us (750us total) trans 30064771509 rc 0/0 00000100:00100000:2.0:1788391243.943274:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1788391243.956199:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391243.956479:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304000 00000100:00100000:2.0:1788391243.956493:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304000 00000100:00100000:2.0:1788391243.956603:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 500 00000100:00100000:2.0:1788391243.956617:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41809:x1875263094304000:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391243.956651:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391243.956680:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd387ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005c0 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.956765:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.956781:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.956795:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391243.956840:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391243.956845:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391243.956870:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.957074:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd387ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c0 expref: 56 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.957098:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c0 expref: 55 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391243.957107:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe600) 00010000:00010000:2.0:1788391243.957110:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391243.957114:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391243.957314:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41809:x1875263094304000:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 699us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391243.957323:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 500 00000100:00100000:0.0:1788391244.056693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.056881:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304256 00000100:00100000:3.0:1788391244.056894:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304256 00000100:00100000:3.0:1788391244.057026:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 501 00000100:00100000:3.0:1788391244.057049:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41825:x1875263094304256:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391244.057076:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391244.057103:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd387ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005c7 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.057241:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd387c1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.057258:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd387c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.057271:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd387c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391244.057284:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788391244.057453:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd387ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c7 expref: 58 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.057476:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd387c1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c7 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.057487:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:3.0:1788391244.057490:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391244.057515:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00080000:0.0:1788391244.058353:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391244.058629:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:41825:x1875263094304256:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1586us (1944us total) trans 30064771510 rc 0/0 00000100:00100000:3.0:1788391244.058640:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 501 00000100:00100000:3.0:1788391244.061502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.061596:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304384 00000100:00100000:1.0:1788391244.061609:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304384 00000100:00100000:1.0:1788391244.061935:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1788391244.061947:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2357:x1875263094304384:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391244.061987:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391244.062015:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd387c1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c7 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.062059:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:1.0:1788391244.062065:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391244.062130:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094304384:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 186us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.062137:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1788391244.062679:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.063263:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304640 00000100:00100000:0.0:1788391244.063272:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304640 00000100:00100000:0.0:1788391244.063375:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 502 00000100:00100000:0.0:1788391244.063387:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:41825:x1875263094304640:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391244.063416:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391244.063438:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd387cf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005ce expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.063551:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.063568:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.064041:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391244.064061:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1788391244.064284:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd387cf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ce expref: 59 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.064525:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ce expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.064535:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:0.0:1788391244.064538:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391244.064541:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8000, rc 0) 00000100:00100000:0.0:1788391244.064666:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:41825:x1875263094304640:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1280us (1985us total) trans 30064771511 rc 0/0 00000100:00100000:0.0:1788391244.064674:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 502 00000100:00100000:0.0:1788391244.075228:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.075470:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304768 00000100:00100000:3.0:1788391244.075484:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304768 00000100:00100000:3.0:1788391244.076014:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:3.0:1788391244.076030:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094304768:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1788391244.076102:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.076130:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 14 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.076140:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391244.076145:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788391244.076150:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.076200:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 14 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.076217:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 14 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.076232:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103492352:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391244.077668:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc25480 going to sleep for 11 seconds 00000100:00080000:0.0:1788391244.078272:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391244.080517:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103492352:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391244.080557:0:44885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.081175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.081517:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094304896 00000100:00100000:1.0:1788391244.081527:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094304896 00002000:00100000:1.0:1788391244.081593:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff95d687863100 x1875263094304896/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 512/0 e 0 to 0 dl 1788391255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391244.081748:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687863100 with x1875263094304896 ext(0->23) 00010000:00010000:1.0:1788391244.081761:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 15 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.081864:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 15 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391244.081876:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687863100 00000100:00100000:1.0:1788391244.082005:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1788391244.082017:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094304896:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1788391244.082889:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2357:x1875263094304896:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 871us (1714us total) trans 30064771281 rc 0/0 00000100:00100000:1.0:1788391244.082897:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:1.0:1788391244.082904:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff95d687863100 x1875263094304896/t30064771281(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 512/448 e 0 to 0 dl 1788391255 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391244.082910:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d687863100 with x1875263094304896 ext(0->23) 00010000:00010000:1.0:1788391244.082917:0:43333:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.082930:0:43333:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391244.082943:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff95d687863100 00000100:00100000:3.0:1788391244.090733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.090926:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305024 00000100:00100000:1.0:1788391244.090939:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305024 00010000:00010000:1.0:1788391244.091032:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.091123:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:1.0:1788391244.091135:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094305024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391244.091156:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788391244.091183:0:42629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:1.0:1788391244.091186:0:42629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb mtime from disk: 0 -> 1788391244 00002000:00010000:1.0:1788391244.091189:0:42629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb atime from disk: 0 -> 1788391244 00002000:00010000:1.0:1788391244.091192:0:42629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb ctime from disk: 0 -> 1788391244 00010000:00010000:1.0:1788391244.091198:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.091215:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.091243:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b76844/0x9aafc5f04cd387a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b9 expref: 17 pid: 43328 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.091265:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391244.091271:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391244.091277:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.091289:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.091342:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391244.091519:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094305024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 385us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.091527:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00010000:00010000:0.0:1788391244.091732:0:44885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091744:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091773:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091795:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091815:0:44885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091823:0:44885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391244.091827:0:44885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091836:0:44885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091851:0:44885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.091857:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8361d76/0x9aafc5f04cd387e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.091916:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094304768:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 15890us (16700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.091926:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:0.0:1788391244.095872:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.096280:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305280 00000100:00100000:1.0:1788391244.096298:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305280 00000100:00100000:1.0:1788391244.096389:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788391244.096402:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:41825:x1875263094305280:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1788391244.096494:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ce expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391244.096827:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771512 00000001:00080000:1.0:1788391244.096877:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771513 00000001:00080000:1.0:1788391244.097530:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771514 00010000:00010000:1.0:1788391244.097598:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.097616:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 62 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.097625:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.097671:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 62 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.097688:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 62 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.097717:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103492480:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391244.097826:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690600 going to sleep for 11 seconds 00000100:00100000:1.0:1788391244.105975:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103492480:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391244.106014:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.106161:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.106277:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305408 00000100:00100000:0.0:1788391244.106288:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305408 00010000:00010000:0.0:1788391244.106360:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 63 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.106439:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1788391244.106452:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:2357:x1875263094305408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391244.106470:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391244.106479:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 63 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106493:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 63 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106521:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38797 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005b2 expref: 63 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106541:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:0.0:1788391244.106546:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106567:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106576:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.106615:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391244.106686:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:2357:x1875263094305408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 236us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.106695:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00010000:00010000:1.0:1788391244.106765:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.106775:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391244.106945:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771515 00000001:00080000:1.0:1788391244.107236:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771516 00000100:00100000:1.0:1788391244.107357:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103492608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391244.107417:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391244.107452:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690780 going to sleep for 11 seconds 00000100:00100000:3.0:1788391244.107492:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103492608 00000100:00100000:3.0:1788391244.107506:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103492608 00000100:00100000:3.0:1788391244.107585:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788391244.107596:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103492608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391244.107705:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103492608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.107713:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788391244.107758:0:42648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771280 gen 2 00000004:00080000:3.0:1788391244.107763:0:42648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586482300, transno 30064771280 00000100:00100000:3.0:1788391244.107775:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc7c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103492608:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1788391244.107999:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788391244.109643:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771517 00000100:00100000:3.0:1788391244.109742:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103492736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788391244.109811:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391244.109854:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391244.110680:0:45860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103492736 00000100:00100000:1.0:1788391244.110696:0:45860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103492736 00000100:00100000:1.0:1788391244.110761:0:45860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788391244.110773:0:45860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103492736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788391244.111293:0:45860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103492736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 520us (1480us total) trans 30064771282 rc 0/0 00000100:00100000:1.0:1788391244.111305:0:45860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788391244.111360:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103492736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788391244.111444:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771518 00010000:00010000:3.0:1788391244.111496:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111507:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111515:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111520:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391244.111535:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111543:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111560:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:3.0:1788391244.111563:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788391244.111568:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.111574:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd387eb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788391244.111872:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788391244.112018:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].18, 64 off9632 00000004:00080000:3.0:1788391244.112046:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1061219084643ns, next at 1062219067495ns, rc = 0 00000001:00080000:3.0:1788391244.112054:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771519 00010000:00010000:3.0:1788391244.112126:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d68641ec00) 00010000:00010000:3.0:1788391244.112129:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391244.112137:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd387d6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ce expref: 66 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.112257:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41825:x1875263094305280:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 15858us (16407us total) trans 30064771520 rc 0/0 00000100:00100000:3.0:1788391244.112268:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000020:00080000:3.0:1788391244.112275:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788391244.115028:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.115181:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305536 00000100:00100000:1.0:1788391244.115208:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305536 00000100:00100000:1.0:1788391244.115278:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 503 00000100:00100000:1.0:1788391244.115289:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41825:x1875263094305536:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391244.115322:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.115353:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd387f2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005d5 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.115429:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd387f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005d5 expref: 66 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.115448:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd387f2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005d5 expref: 66 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.115472:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.115476:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391244.115480:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d200, rc 0) 00000100:00100000:1.0:1788391244.115541:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:41825:x1875263094305536:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 253us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.115548:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 503 00000100:00100000:0.0:1788391244.119463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.122081:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305792 00000100:00100000:2.0:1788391244.122156:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305792 00000100:00100000:2.0:1788391244.122251:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1788391244.122266:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:41825:x1875263094305792:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391244.122653:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41825:x1875263094305792:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 385us (3195us total) trans 30064771521 rc 0/0 00000100:00100000:2.0:1788391244.122662:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788391244.172564:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.172724:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094305920 00000100:00100000:2.0:1788391244.172737:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094305920 00000100:00100000:2.0:1788391244.174654:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 504 00000100:00100000:2.0:1788391244.174676:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:41831:x1875263094305920:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391244.174707:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391244.174731:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd387f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005dc expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174805:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174818:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174833:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174846:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174851:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174855:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174988:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.174996:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175002:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391244.175060:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:2.0:1788391244.175066:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391244.175092:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175106:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175116:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175126:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175133:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175140:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391244.175145:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175154:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175169:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe600) 00010000:00010000:2.0:1788391244.175172:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391244.175178:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175183:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175197:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175202:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175207:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175212:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391244.175215:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175220:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175226:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff95d691bfe500) 00010000:00010000:2.0:1788391244.175229:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391244.175231:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175236:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38807 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175269:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd387f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 69 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175283:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 68 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.175290:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:2.0:1788391244.175292:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391244.175295:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176000, rc 0) 00000100:00100000:2.0:1788391244.175397:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:41831:x1875263094305920:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 729us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391244.175405:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 504 00000100:00100000:0.0:1788391244.181890:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.183255:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094306176 00000100:00100000:3.0:1788391244.183276:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094306176 00000100:00100000:3.0:1788391244.183359:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 505 00000100:00100000:3.0:1788391244.183372:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:41831:x1875263094306176:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391244.183429:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391244.183458:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005e3 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.183593:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.183612:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 69 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.183621:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.183667:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 69 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.183683:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 69 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.183698:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103492864:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391244.183861:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68fc256c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391244.188889:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.189191:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103492864:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391244.189230:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.189445:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094306304 00000100:00100000:1.0:1788391244.189454:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094306304 00010000:00010000:1.0:1788391244.189501:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 70 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.189585:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:1.0:1788391244.189608:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:2357:x1875263094306304:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391244.189630:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391244.189659:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 70 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189674:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 70 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189701:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd3880e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005dc expref: 70 pid: 42645 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189720:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.189725:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189736:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189744:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.189775:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391244.189845:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:2357:x1875263094306304:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 249us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.189854:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00010000:00010000:0.0:1788391244.189911:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.189918:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391244.189941:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1788391244.190169:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 70 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.190187:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 69 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.190196:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391244.190199:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391244.190201:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:0.0:1788391244.190232:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:41831:x1875263094306176:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6864us (8354us total) trans 30064771522 rc 0/0 00000100:00100000:0.0:1788391244.190239:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 505 00000100:00100000:0.0:1788391244.219954:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.220870:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094306560 00000100:00100000:3.0:1788391244.220884:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094306560 00000100:00100000:3.0:1788391244.220999:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 506 00000100:00100000:3.0:1788391244.221024:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:41834:x1875263094306560:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391244.221067:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391244.221096:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3882a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005ea expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221221:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221240:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221256:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221275:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221283:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221290:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221452:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3883f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221464:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3883f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221471:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3883f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391244.221482:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788391244.221607:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221778:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221786:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221792:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391244.221797:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221807:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221822:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe600) 00010000:00010000:3.0:1788391244.221826:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391244.221832:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221839:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221856:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221862:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221868:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221873:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391244.221883:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221890:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221898:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff95d68641ec00) 00010000:00010000:3.0:1788391244.221901:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391244.221903:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.221910:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.222017:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3882a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ea expref: 72 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.222045:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3883f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ea expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.222052:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:3.0:1788391244.222054:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788391244.222057:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:3.0:1788391244.222138:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41834:x1875263094306560:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1117us (2199us total) trans 30064771523 rc 0/0 00000100:00100000:3.0:1788391244.222147:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 506 00000100:00100000:2.0:1788391244.224913:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.225241:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094306688 00000100:00100000:3.0:1788391244.225255:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094306688 00000100:00100000:2.0:1788391244.225474:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 507 00000100:00100000:2.0:1788391244.225488:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41834:x1875263094306688:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1788391244.225580:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.225601:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 71 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.225611:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.225657:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 71 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.225673:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 71 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.225691:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103492992:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391244.225798:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391244.230522:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.230569:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094306944 00000100:00100000:3.0:1788391244.230643:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094306944 00000100:00100000:3.0:1788391244.230715:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1788391244.230729:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:36381:x1875263094306944:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788391244.231061:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:36381:x1875263094306944:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 334us (551us total) trans 30064771524 rc 0/0 00000100:00100000:3.0:1788391244.231070:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:1.0:1788391244.231703:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103492992:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391244.231735:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.236290:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.236510:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094307072 00000100:00100000:0.0:1788391244.236523:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094307072 00010000:00010000:0.0:1788391244.236600:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 73 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.236660:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788391244.236671:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:2357:x1875263094307072:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391244.236690:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391244.236698:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 73 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236713:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 73 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236742:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd3881c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005e3 expref: 73 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236762:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391244.236768:0:42629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236779:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236788:0:42629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.236869:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391244.236942:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:2357:x1875263094307072:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 271us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.236951:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00010000:00010000:1.0:1788391244.238149:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238178:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238222:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238229:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238237:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238243:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.238248:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238257:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238274:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.238278:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391244.238282:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.238289:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd3884d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.240171:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41834:x1875263094306688:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 14671us (15254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.240188:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 507 00000100:00100000:1.0:1788391244.242774:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.242985:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094307328 00000100:00100000:2.0:1788391244.242998:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094307328 00000100:00100000:2.0:1788391244.243186:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1788391244.243199:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:41834:x1875263094307328:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391244.243523:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:41834:x1875263094307328:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 325us (759us total) trans 30064771525 rc 0/0 00000100:00100000:2.0:1788391244.243532:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1788391244.346169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.346264:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094307584 00000100:00100000:3.0:1788391244.346280:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094307584 00000100:00100000:3.0:1788391244.346335:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 508 00000100:00100000:3.0:1788391244.346390:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:41846:x1875263094307584:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391244.346413:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391244.346434:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005f1 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346497:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346507:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346516:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346524:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346528:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346532:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346636:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346649:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346654:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391244.346661:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788391244.346736:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346741:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346745:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346749:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391244.346752:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346757:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346766:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe600) 00010000:00010000:3.0:1788391244.346768:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391244.346770:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346781:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd3885b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346792:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346795:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346799:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346802:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391244.346803:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346806:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346810:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff95d68641ec00) 00010000:00010000:3.0:1788391244.346812:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391244.346813:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346816:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38862 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346844:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 75 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346865:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 74 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.346870:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:3.0:1788391244.346872:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788391244.346874:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:3.0:1788391244.346942:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41846:x1875263094307584:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 600us (786us total) trans 30064771526 rc 0/0 00000100:00100000:3.0:1788391244.346949:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 508 00000100:00100000:3.0:1788391244.364732:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.364832:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094307712 00000100:00100000:0.0:1788391244.364849:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094307712 00000100:00100000:0.0:1788391244.365187:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 509 00000100:00100000:0.0:1788391244.365201:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41846:x1875263094307712:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1788391244.365293:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365317:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365344:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365376:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365383:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365391:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365397:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.365402:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365410:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365422:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391244.365425:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391244.365449:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.365456:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd38877 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.365552:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41846:x1875263094307712:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 353us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.365561:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 509 00000100:00100000:1.0:1788391244.372320:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.372552:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094307968 00000100:00100000:3.0:1788391244.372562:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094307968 00000100:00100000:3.0:1788391244.372618:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1788391244.372632:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:41846:x1875263094307968:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391244.372935:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41846:x1875263094307968:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 306us (624us total) trans 30064771527 rc 0/0 00000100:00100000:3.0:1788391244.372943:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1788391244.374254:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.374549:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094308224 00000100:00100000:2.0:1788391244.374556:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094308224 00000100:00100000:2.0:1788391244.374605:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 510 00000100:00100000:2.0:1788391244.374615:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41852:x1875263094308224:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391244.374630:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391244.374650:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3887e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005f8 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.374733:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.374748:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.374757:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.374787:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.374801:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 76 pid: 43348 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.374815:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103493120:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391244.374907:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574600 going to sleep for 11 seconds 00000100:00100000:0.0:1788391244.377076:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103493120:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391244.377104:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.380984:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.381059:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094308352 00000100:00100000:0.0:1788391244.381069:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094308352 00010000:00010000:0.0:1788391244.381123:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 77 pid: 43348 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.381161:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1788391244.381173:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:2356:x1875263094308352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391244.381188:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391244.381195:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 77 pid: 43348 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381208:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 77 pid: 43348 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381242:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38869 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f1 expref: 77 pid: 43348 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381279:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391244.381284:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381294:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381301:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.381336:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391244.381390:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:2356:x1875263094308352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 219us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.381397:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00010000:00010000:2.0:1788391244.381435:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.381443:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391244.381461:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1788391244.381615:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3887e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f8 expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.381634:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f8 expref: 76 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.381641:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:2.0:1788391244.381643:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788391244.381646:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176200, rc 0) 00000100:00100000:2.0:1788391244.381679:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41852:x1875263094308224:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 7066us (7430us total) trans 30064771528 rc 0/0 00000100:00100000:2.0:1788391244.381686:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 510 00000100:00100000:3.0:1788391244.384454:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.384950:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094308608 00000100:00100000:1.0:1788391244.384973:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094308608 00000100:00100000:1.0:1788391244.385045:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 511 00000100:00100000:1.0:1788391244.385055:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41852:x1875263094308608:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391244.385076:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.385078:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788391244.385105:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38885 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005f8 expref: 76 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385118:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.385121:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391244.385131:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38893 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc005ff expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385200:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385209:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385218:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391244.385228:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1788391244.385337:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38893 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ff expref: 78 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385351:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ff expref: 77 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.385373:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.385376:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788391244.385378:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16cc00, rc 0) 00000100:00100000:1.0:1788391244.385437:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41852:x1875263094308608:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 383us (991us total) trans 30064771529 rc 0/0 00000100:00100000:1.0:1788391244.385444:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 511 00000100:00100000:3.0:1788391244.389263:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.389310:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094308864 00000100:00100000:1.0:1788391244.389321:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094308864 00000100:00100000:1.0:1788391244.389380:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1788391244.389388:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41852:x1875263094308864:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1788391244.389403:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788391244.389426:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd3883f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ea expref: 77 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.389447:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd387f2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005d5 expref: 76 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.389458:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.389462:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391244.389513:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41852:x1875263094308864:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.389521:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1788391244.391218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.391363:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094308992 00000100:00100000:0.0:1788391244.391371:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094308992 00000100:00100000:0.0:1788391244.391404:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 512 00000100:00100000:0.0:1788391244.391410:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41852:x1875263094308992:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1788391244.391500:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.391515:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.391526:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788391244.391792:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].10, 136 off9552 00000100:00100000:0.0:1788391244.391867:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41852:x1875263094308992:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 457us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.391881:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 512 00000100:00100000:3.0:1788391244.394105:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.394220:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094309120 00000100:00100000:1.0:1788391244.394228:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094309120 00000100:00100000:1.0:1788391244.394290:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 513 00000100:00100000:1.0:1788391244.394314:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:41852:x1875263094309120:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391244.394333:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.394353:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00606 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394405:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394416:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 76 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394434:0:42644:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394454:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 76 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394464:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.394467:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391244.394469:0:42644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 76 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.394474:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16de00, rc 0) 00000100:00100000:1.0:1788391244.394758:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41852:x1875263094309120:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 446us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.394764:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 513 00000040:00080000:2.0:1788391244.558311:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391244.558320:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391244.558359:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 5 00000040:00080000:2.0:1788391244.558368:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391244.558473:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103493248:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788391244.558569:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574780 going to sleep for 11 seconds 00000100:00100000:2.0:1788391244.562508:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103493248:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391244.562710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.562815:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094309248 00000100:00100000:2.0:1788391244.562823:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094309248 00000100:00100000:2.0:1788391244.562884:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 514 00000100:00100000:2.0:1788391244.562894:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41854:x1875263094309248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391244.562926:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391244.563067:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41854:x1875263094309248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 173us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391244.563077:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 514 00000100:00100000:3.0:1788391244.566501:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.566581:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094309376 00000100:00100000:0.0:1788391244.566591:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094309376 00000100:00100000:0.0:1788391244.566653:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 515 00000100:00100000:0.0:1788391244.566665:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41854:x1875263094309376:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.566737:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566755:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566766:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566782:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566789:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566796:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566819:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566828:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566835:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391244.566879:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:0.0:1788391244.566883:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391244.566895:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566905:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566911:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566918:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566924:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.566928:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566935:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566947:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391244.566949:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391244.566954:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.566992:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567005:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567022:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567043:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567048:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.567051:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567058:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567065:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x26c361d7 (ffff95d6a704c600) 00010000:00010000:0.0:1788391244.567068:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391244.567071:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567076:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567090:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567096:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567101:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567106:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.567114:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567120:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567129:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391244.567132:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391244.567134:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.567141:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388c4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.567221:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41854:x1875263094309376:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 557us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.567229:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 515 00000100:00100000:3.0:1788391244.570457:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.570576:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094309632 00000100:00100000:2.0:1788391244.570586:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094309632 00000100:00100000:2.0:1788391244.570645:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 516 00000100:00100000:2.0:1788391244.570656:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:41854:x1875263094309632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391244.570676:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391244.570696:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd388cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0060d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570797:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570813:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570825:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391244.570836:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1788391244.570937:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570945:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570952:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.570958:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391244.571147:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571156:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571170:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:2.0:1788391244.571173:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788391244.571177:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571184:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd388d2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571226:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd388cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0060d expref: 78 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571237:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391244.571239:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391244.571244:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd388cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0060d expref: 78 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.571253:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176a00, rc 0) 00000100:00100000:2.0:1788391244.571358:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094309632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 703us (910us total) trans 30064771530 rc 301/301 00000100:00100000:2.0:1788391244.571366:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 516 00000100:00100000:3.0:1788391244.573357:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.573428:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094309760 00000100:00100000:1.0:1788391244.573437:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094309760 00000100:00100000:1.0:1788391244.573512:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 517 00000100:00100000:1.0:1788391244.573523:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094309760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788391244.573558:0:42644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788391244.573654:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094309760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 133us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.573662:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 517 00000100:00100000:3.0:1788391244.575827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.575879:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310016 00000100:00100000:0.0:1788391244.575887:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310016 00000100:00100000:0.0:1788391244.575940:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 518 00000100:00100000:0.0:1788391244.575949:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094310016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.575990:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391244.575994:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788391244.576043:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd387b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005c0 expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576062:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe600) 00010000:00010000:0.0:1788391244.576072:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391244.576088:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00614 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391244.576541:0:43348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcf:0x0], index 0: 0 00010000:00010000:0.0:1788391244.576731:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388e7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576745:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576755:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576802:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd388e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00614 expref: 79 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576820:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00614 expref: 78 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.576827:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c200) 00010000:00010000:0.0:1788391244.576830:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391244.576832:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8200, rc 0) 00000100:00100000:0.0:1788391244.576893:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41854:x1875263094310016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 944us (1073us total) trans 30064771531 rc 0/0 00000100:00100000:0.0:1788391244.576900:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 518 00000100:00100000:3.0:1788391244.580485:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.580527:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310144 00000100:00100000:0.0:1788391244.580537:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310144 00000100:00100000:0.0:1788391244.580597:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 519 00000100:00100000:0.0:1788391244.580608:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41854:x1875263094310144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.580633:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391244.580673:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0061b expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580738:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580752:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580762:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391244.580796:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788391244.580799:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391244.580817:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580838:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd388f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0061b expref: 80 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580854:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0061b expref: 79 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.580863:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704cd00) 00010000:00010000:0.0:1788391244.580865:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391244.580868:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8400, rc 0) 00000100:00100000:0.0:1788391244.581289:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5872eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:41854:x1875263094310144:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 682us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.581297:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 519 00000100:00100000:3.0:1788391244.583376:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.583450:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310400 00000100:00100000:0.0:1788391244.583471:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310400 00000100:00100000:0.0:1788391244.583547:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 520 00000100:00100000:0.0:1788391244.583556:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:41854:x1875263094310400:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.583604:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788391244.583630:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd388e7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00614 expref: 79 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583648:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c200) 00010000:00010000:0.0:1788391244.583664:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd388fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0061b expref: 78 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583672:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704cd00) 00010000:00010000:0.0:1788391244.583677:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391244.583699:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583709:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583717:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583730:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583737:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583744:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583816:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583824:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583829:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583834:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.583838:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583845:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583854:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:0.0:1788391244.583857:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391244.583859:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583864:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38903 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583875:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583881:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583886:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583897:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391244.583900:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583906:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583914:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8112eea9 (ffff95d6a0d59e00) 00010000:00010000:0.0:1788391244.583916:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391244.583919:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.583924:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd3890a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8112eea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.584051:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094310400:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 495us (678us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788391244.584058:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 520 00000100:00100000:3.0:1788391244.586699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.586778:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310528 00000100:00100000:0.0:1788391244.586788:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310528 00000100:00100000:0.0:1788391244.586849:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 521 00000100:00100000:0.0:1788391244.586860:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:41854:x1875263094310528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.586879:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391244.586903:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38911 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00622 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.586941:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.587002:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.587024:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.587207:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38911 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 79 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.587226:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 78 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.587235:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391244.587238:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788391244.587242:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9800, rc 0) 00000100:00100000:0.0:1788391244.587339:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41854:x1875263094310528:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 481us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.587348:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 521 00000100:00100000:3.0:1788391244.595474:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.595718:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310784 00000100:00100000:2.0:1788391244.595728:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310784 00000100:00100000:2.0:1788391244.595800:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 522 00000100:00100000:2.0:1788391244.595811:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:41854:x1875263094310784:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391244.595911:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.595928:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.595950:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391244.596501:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].19, 88 off9648 00000004:00080000:2.0:1788391244.596511:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1061703549659ns, next at 1062703547388ns, rc = 0 00000004:00010000:2.0:1788391244.596600:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007467c179 reply state 000000006efcc180 transno 30064771532 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.596611:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391244.596715:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41854:x1875263094310784:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 903us (1248us total) trans 30064771532 rc 0/0 00000100:00100000:2.0:1788391244.596722:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 522 00000100:00100000:3.0:1788391244.598810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.598874:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094310912 00000100:00100000:1.0:1788391244.598883:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094310912 00000100:00100000:1.0:1788391244.598937:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 523 00000100:00100000:1.0:1788391244.598949:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41854:x1875263094310912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391244.599007:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.599024:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00629 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.599091:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 81 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.599107:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 81 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599109:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599123:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599129:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.599131:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391244.599139:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391244.599143:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d200, rc 0) 00010000:00010000:2.0:1788391244.599322:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391244.599329:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599337:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599350:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391244.599353:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391244.599358:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.599364:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3891f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.599594:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d584a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41854:x1875263094310912:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 645us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.599602:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 523 00000100:00100000:0.0:1788391244.602609:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.602668:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094311040 00000100:00100000:3.0:1788391244.602678:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094311040 00000100:00100000:3.0:1788391244.602804:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1788391244.602816:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094311040:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788391244.603104:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391244.603418:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094311040:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 603us (818us total) trans 30064771215 rc 0/0 00000100:00100000:3.0:1788391244.603426:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1788391244.606126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.606217:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094311296 00000100:00100000:2.0:1788391244.606230:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094311296 00000100:00100000:2.0:1788391244.606290:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:2.0:1788391244.606302:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:41854:x1875263094311296:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391244.606553:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41854:x1875263094311296:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 253us (438us total) trans 30064771533 rc 0/0 00000100:00100000:2.0:1788391244.606561:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391244.609268:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.609365:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094311552 00000100:00100000:0.0:1788391244.609375:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094311552 00000100:00100000:0.0:1788391244.609471:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 524 00000100:00100000:0.0:1788391244.609482:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41854:x1875263094311552:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788391244.609596:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41854:x1875263094311552:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.609605:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 524 00000100:00100000:3.0:1788391244.612212:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391244.612654:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094311680 00000100:00100000:2.0:1788391244.612663:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094311680 00000100:00100000:2.0:1788391244.612821:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 525 00000100:00100000:2.0:1788391244.612832:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:41854:x1875263094311680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391244.612851:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391244.612872:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3892d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00630 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.612983:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.612999:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.613020:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391244.613071:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391244.613091:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.613122:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd3892d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00630 expref: 83 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.613140:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00630 expref: 82 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.613148:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391244.613150:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788391244.613154:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176000, rc 0) 00000100:00100000:2.0:1788391244.613208:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:41854:x1875263094311680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 378us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391244.613215:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 525 00000100:00100000:3.0:1788391244.615338:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.615745:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094311808 00000100:00100000:1.0:1788391244.615754:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094311808 00000100:00100000:1.0:1788391244.615810:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:1.0:1788391244.615820:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094311808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391244.615836:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.615854:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00637 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391244.615880:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af4c, blocks: 0x1 00010000:00010000:1.0:1788391244.615898:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=1061s v=(0 0) 00010000:00010000:1.0:1788391244.615903:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.615914:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 12 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.616071:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 12 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.616088:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d600, rc 0) 00000100:00100000:1.0:1788391244.616138:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094311808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 319us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.616146:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:1.0:1788391244.618877:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.619253:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312064 00000100:00100000:3.0:1788391244.619264:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312064 00000100:00100000:3.0:1788391244.619362:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 526 00000100:00100000:3.0:1788391244.619373:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:41854:x1875263094312064:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391244.619482:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:41854:x1875263094312064:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.619490:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 526 00000100:00100000:3.0:1788391244.622240:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.622326:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312192 00000100:00100000:1.0:1788391244.622336:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312192 00000100:00100000:1.0:1788391244.622389:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:1.0:1788391244.622400:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:41854:x1875263094312192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391244.622434:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.622452:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0063e expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.622487:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 13 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.622496:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.622500:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.622505:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.622541:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 13 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.622555:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 13 pid: 43326 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.622570:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103493376:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391244.622844:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc6906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788391244.636496:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.637694:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312320 00000100:00100000:3.0:1788391244.637722:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312320 00010000:00010000:3.0:1788391244.637766:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 14 pid: 43326 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.637816:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:3.0:1788391244.637827:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094312320:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788391244.637843:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391244.637874:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 14 pid: 43326 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.637889:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 14 pid: 43326 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.637914:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391244.637919:0:42631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391244.637927:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 14 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.637938:0:42631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 14 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.638016:0:42631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 14 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.638044:0:42631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103493504:192.168.202.1@tcp:105: 00000100:00100000:3.0:1788391244.638128:0:42631:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788391244.638324:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000914955c2/0x9aafc5f04cd3893b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00637 expref: 14 pid: 43326 timeout: 1161 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.638340:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103493376:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391244.638364:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.638384:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c200, rc 0) 00000100:00100000:1.0:1788391244.638429:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:41854:x1875263094312192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 16030us (16196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.638437:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:3.0:1788391244.640381:0:42631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b179880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:42631:1875263103493504:192.168.202.1@tcp:105: 00010000:00010000:3.0:1788391244.640397:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391244.640439:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094312320:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2615us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.640446:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:2.0:1788391244.641253:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.641384:0:45648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312448 00000100:00100000:1.0:1788391244.641390:0:45648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312448 00002000:00100000:1.0:1788391244.641428:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff95d682e95f80 x1875263094312448/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 512/0 e 0 to 0 dl 1788391255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391244.641436:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e95f80 with x1875263094312448 ext(0->23) 00002000:00010000:1.0:1788391244.641439:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e95f80 00000100:00100000:1.0:1788391244.641460:0:45648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:1.0:1788391244.641466:0:45648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094312448:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391244.641816:0:45648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094312448:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 349us (564us total) trans 30064771216 rc 0/0 00000100:00100000:1.0:1788391244.641821:0:45648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 362 00002000:00100000:1.0:1788391244.641827:0:45648:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff95d682e95f80 x1875263094312448/t30064771216(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 512/448 e 0 to 0 dl 1788391255 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391244.641832:0:45648:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d682e95f80 with x1875263094312448 ext(0->23) 00002000:00010000:1.0:1788391244.641835:0:45648:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d682e95f80 00000100:00100000:2.0:1788391244.644953:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.645087:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312576 00000100:00100000:0.0:1788391244.645096:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312576 00000100:00100000:0.0:1788391244.645162:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 527 00000100:00100000:0.0:1788391244.645174:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:41854:x1875263094312576:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788391244.681109:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:41854:x1875263094312576:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 35930us (36154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.681119:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 527 00000001:00080000:3.0:1788391244.681223:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771531 is committed 00000020:00080000:3.0:1788391244.681249:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803911 batchid updated 00000001:00080000:3.0:1788391244.681264:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771533 is committed 00000004:00080000:3.0:1788391244.681271:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:3.0:1788391244.681297:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000020:00080000:3.0:1788391244.681308:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d68fc25900 refcount 2 committed 0 result 0 batchid 25769803912 00000020:00080000:3.0:1788391244.681311:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f071000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68fc253c0 00000020:00080000:3.0:1788391244.681313:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d68f071500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58c7d8400 00000020:00080000:0.0:1788391244.681354:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803912 committed batchid 25769803911 00000020:00080000:0.0:1788391244.681539:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803911 00000100:00100000:0.0:1788391244.681933:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391244.681948:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103493632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788391244.682025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391244.682161:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103493632 00000100:00100000:1.0:1788391244.682169:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103493632 00000100:00100000:2.0:1788391244.682219:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391244.682230:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103493760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788391244.682255:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788391244.682259:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391244.682264:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103493632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788391244.682309:0:43327:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:206 count 1 00002000:00010000:1.0:1788391244.682342:0:43327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 24, mtime: 0x6a98af4c, atime: 0x6a98af4c, ctime: 0x6a98af4c, blocks: 0x1 00010000:00010000:1.0:1788391244.682350:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.682367:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=1061s v=(0 0) 00010000:00010000:1.0:1788391244.682372:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.682378:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.682393:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.682403:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.682437:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.682457:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788391244.682907:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103493632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 642us (880us total) trans 30064771283 rc 0/0 00000100:00100000:1.0:1788391244.682914:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788391244.683329:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103493760 00000100:00100000:3.0:1788391244.683336:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103493760 00000100:00080000:2.0:1788391244.683370:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391244.683381:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788391244.683389:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3289:x1875263103493760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788391244.683503:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:3.0:1788391244.683506:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1788391244 00002000:00010000:3.0:1788391244.683509:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788391244.683511:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1788391244 -> 1788391244 00002000:00010000:3.0:1788391244.683514:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788391244.683557:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1875263103493760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (1295us total) trans 30064771217 rc 0/0 00000100:00100000:3.0:1788391244.683564:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:1.0:1788391244.683702:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391244.683710:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.683737:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391244.683742:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.683752:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.683772:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.683780:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5eae0f9/0x9aafc5f04cd38949 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.683799:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391244.683801:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391244.683803:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788391244.683833:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58afd4000/2, rc 0, transno 30064771283 00000100:00100000:1.0:1788391244.683840:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103493632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788391244.684052:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.684173:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312704 00000100:00100000:1.0:1788391244.684177:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312704 00000100:00100000:1.0:1788391244.684206:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:1.0:1788391244.684212:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094312704:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788391244.684761:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58d2fb480/2, rc 0, transno 30064771217 00000100:00100000:2.0:1788391244.684768:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103493760:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788391244.712786:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771216 is committed 00000001:00080000:3.0:1788391244.712826:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771214 is committed 00000001:00080000:3.0:1788391244.712832:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771217 is committed 00000100:00100000:1.0:1788391244.716161:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094312704:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 31937us (32099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.716196:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:1.0:1788391244.718671:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.718756:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094312960 00000100:00100000:0.0:1788391244.718764:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094312960 00000100:00100000:0.0:1788391244.718809:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 528 00000100:00100000:0.0:1788391244.718819:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41854:x1875263094312960:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788391244.718871:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391244.718898:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38934 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00630 expref: 55 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.718918:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391244.718922:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391244.719127:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.719142:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.719164:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391244.719348:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000da01bbf reply state 00000000c51c696b transno 30064771534 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.719356:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391244.719446:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:41854:x1875263094312960:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 626us (781us total) trans 30064771534 rc 0/0 00000100:00100000:2.0:1788391244.719453:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 528 00010000:00010000:1.0:1788391244.721397:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721414:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721421:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721427:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.721432:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721439:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721459:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391244.721462:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391244.721466:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.721472:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38950 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.721777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.722158:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313088 00000100:00100000:3.0:1788391244.722169:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313088 00000100:00100000:3.0:1788391244.722253:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1788391244.722262:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094313088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788391244.722452:0:43328:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 24 -> 24 00002000:00010000:3.0:1788391244.722455:0:43328:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 1788391244 -> 1788391244 00002000:00010000:3.0:1788391244.722456:0:43328:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1788391244 00002000:00010000:3.0:1788391244.722458:0:43328:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1788391244 -> 1788391244 00002000:00010000:3.0:1788391244.722459:0:43328:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788391244.722550:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094313088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 288us (776us total) trans 30064771218 rc 0/0 00000100:00100000:3.0:1788391244.722557:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:2.0:1788391244.724578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.724671:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313344 00000100:00100000:3.0:1788391244.724680:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313344 00000100:00100000:3.0:1788391244.724765:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 529 00000100:00100000:3.0:1788391244.724774:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:41854:x1875263094313344:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788391244.724829:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.724842:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.724849:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.724874:0:43348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.724907:0:43348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 55 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.724918:0:43348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103493888:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391244.725009:0:43348:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b3165c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788391244.730025:0:43348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:43348:1875263103493888:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391244.730065:0:43348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.730596:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.730874:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313472 00000100:00100000:0.0:1788391244.731241:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313472 00010000:00010000:0.0:1788391244.731281:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 56 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.731325:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1788391244.731335:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094313472:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391244.731350:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391244.731357:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 56 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731370:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 56 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731393:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38918 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00622 expref: 56 pid: 42646 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731408:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:0.0:1788391244.731413:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731423:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731431:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.731478:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391244.731528:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2357:x1875263094313472:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 194us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391244.731535:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00010000:00010000:2.0:1788391244.731597:0:43348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731605:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731632:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731639:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731646:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731651:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391244.731655:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731662:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731672:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391244.731675:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788391244.731679:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.731685:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38957 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.731725:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41854:x1875263094313344:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 6952us (7154us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788391244.731734:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 529 00000100:00100000:0.0:1788391244.733621:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.733714:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313600 00000100:00100000:1.0:1788391244.733723:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313600 00000100:00100000:1.0:1788391244.733798:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1788391244.733808:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094313600:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788391244.733863:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.733894:0:43698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 12 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.733902:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.733906:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391244.733911:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.733955:0:43698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 12 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.734007:0:43698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 12 pid: 44885 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.734022:0:43698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103494016:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391244.734098:0:43698:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc690b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788391244.736861:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.737004:0:43698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:43698:1875263103494016:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391244.737043:0:43698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391244.737344:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313728 00000100:00100000:0.0:1788391244.737352:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313728 00010000:00010000:1.0:1788391244.737424:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.737465:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:1.0:1788391244.737473:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094313728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391244.737506:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391244.737529:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.737538:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.737555:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008473e963/0x9aafc5f04cd38942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0063e expref: 13 pid: 44885 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.737568:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391244.737571:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391244.737575:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.737581:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.737660:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391244.737703:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094313728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 230us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.737708:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00010000:00010000:3.0:1788391244.738091:0:43698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738098:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738118:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738123:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738137:0:43698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738142:0:43698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ca00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391244.738144:0:43698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738150:0:43698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738159:0:43698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.738163:0:43698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067c3ac4/0x9aafc5f04cd3895e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391244.738208:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094313600:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 4402us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.738216:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1788391244.741155:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.741193:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094313984 00000100:00100000:3.0:1788391244.741203:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094313984 00000100:00100000:2.0:1788391244.741328:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 530 00000100:00100000:2.0:1788391244.741339:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41854:x1875263094313984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391244.741416:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741433:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741445:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741634:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741642:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741649:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741674:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.741687:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 55 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.741697:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103494144:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391244.741777:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788391244.748486:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391244.748606:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103494144:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391244.748636:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.749492:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391244.751186:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314112 00000100:00100000:3.0:1788391244.751198:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314112 00010000:00010000:2.0:1788391244.751533:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 56 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391244.751622:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:2.0:1788391244.751633:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094314112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391244.751648:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391244.751656:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 56 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751670:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 56 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751692:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38926 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00629 expref: 56 pid: 42644 timeout: 1161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751709:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:2.0:1788391244.751714:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751728:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751736:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391244.751765:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391244.751863:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2357:x1875263094314112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 231us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391244.751872:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00010000:00010000:1.0:1788391244.751928:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.751948:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391244.752162:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771535 00000001:00080000:1.0:1788391244.752299:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771536 00000001:00080000:1.0:1788391244.752343:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771537 00000100:00100000:1.0:1788391244.752423:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58aef3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103494272:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788391244.752477:0:42644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391244.752506:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc6906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788391244.753568:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103494272 00000100:00100000:3.0:1788391244.753577:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103494272 00000100:00100000:3.0:1788391244.753667:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788391244.753691:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103494272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788391244.753787:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103494272:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.753795:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788391244.753858:0:42644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771217 gen 2 00000004:00080000:1.0:1788391244.753865:0:42644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586481180, transno 30064771213 00000004:00080000:1.0:1788391244.753881:0:42644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d586480e00, transno 30064771214 00000004:00080000:1.0:1788391244.753884:0:42644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58d2fb480, transno 30064771217 00000100:00100000:1.0:1788391244.753890:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58aef3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103494272:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788391244.754465:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771538 00000100:00100000:1.0:1788391244.754537:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103494400:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788391244.754576:0:42644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788391244.754823:0:42666:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1788391244.755235:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391244.755310:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103494400 00000100:00100000:0.0:1788391244.755316:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103494400 00000100:00100000:0.0:1788391244.755353:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788391244.755361:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42644:x1875263103494400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788391244.755547:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42644:x1875263103494400:12345-0@lo:1000:mdt00_000.0 Request processed in 186us (969us total) trans 30064771219 rc 0/0 00000100:00100000:0.0:1788391244.755555:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788391244.755633:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d18700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:42644:1875263103494400:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788391244.755712:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771539 00010000:00010000:1.0:1788391244.755741:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755751:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755771:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755777:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.755782:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755790:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755805:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704c600) 00010000:00010000:1.0:1788391244.755808:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391244.755812:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755819:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd3896c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755851:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755858:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755863:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755868:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.755872:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755888:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755896:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.755899:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391244.755905:0:42644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755915:0:42644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755924:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.755998:0:42644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.756010:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103494528:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391244.756076:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f574cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391244.758740:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103494528:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391244.758768:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758777:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8000/0x9aafc5f04cd388a8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758809:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758836:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758848:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758860:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758868:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758876:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758881:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.758885:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758893:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758905:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.758908:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391244.758912:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758919:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38973 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758930:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758945:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.758952:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.759176:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391244.759181:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.759188:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.759198:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391244.759200:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391244.759203:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.759208:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38965 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391244.759526:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41854:x1875263094313984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 18187us (18376us total) trans 30064771540 rc 0/0 00000100:00100000:1.0:1788391244.759536:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 530 00000020:00080000:1.0:1788391244.759542:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:0.0:1788391244.760178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.760253:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314240 00000100:00100000:3.0:1788391244.760261:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314240 00000100:00100000:3.0:1788391244.760339:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1788391244.760349:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41852:x1875263094314240:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:3.0:1788391244.760460:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41852:x1875263094314240:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391244.760468:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000040:00080000:2.0:1788391244.760806:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391244.760811:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391244.761372:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:2.0:1788391244.761384:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391244.765775:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391244.765859:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.765928:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314496 00000100:00100000:0.0:1788391244.765938:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314496 00000100:00100000:0.0:1788391244.766134:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1788391244.766146:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41854:x1875263094314496:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788391244.766798:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788391244.766911:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771541 00010000:00010000:0.0:1788391244.766958:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767216:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767240:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767250:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767256:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767263:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391244.767284:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788391244.767381:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:41854:x1875263094314496:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1233us (1611us total) trans 30064771542 rc 0/0 00000100:00100000:0.0:1788391244.767390:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000020:00080000:0.0:1788391244.767396:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788391244.767840:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314624 00000100:00100000:1.0:1788391244.767848:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314624 00000100:00100000:1.0:1788391244.767890:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:1.0:1788391244.767899:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:41852:x1875263094314624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391244.767924:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391244.767952:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00645 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788391244.768152:0:44885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6a98af4c, atime: 0x6a98af4c, ctime: 0x6a98af4c, blocks: 0xb 00010000:00010000:1.0:1788391244.768174:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=1061s v=(0 0) 00010000:00010000:1.0:1788391244.768179:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391244.768189:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.768209:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391244.768222:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c800, rc 0) 00000100:00100000:1.0:1788391244.768303:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:41852:x1875263094314624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 405us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391244.768310:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00010000:00010000:3.0:1788391244.768407:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788391244.768415:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.768422:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:3.0:1788391244.768427:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.768435:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.768449:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff95d6a704cd00) 00010000:00010000:3.0:1788391244.768452:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788391244.768456:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.768473:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8800/0x9aafc5f04cd3897a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391244.768493:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391244.768494:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391244.768496:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391244.772639:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391244.772837:0:45853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314752 00000100:00100000:0.0:1788391244.772851:0:45853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314752 00002000:00100000:0.0:1788391244.775371:0:45853:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff95d58b179500 x1875263094314752/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 488/0 e 0 to 0 dl 1788391255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788391244.775386:0:45853:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179500 with x1875263094314752 ext(0->4095) 00002000:00010000:0.0:1788391244.775392:0:45853:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b179500 00000100:00100000:3.0:1788391244.775502:0:46264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:3.0:1788391244.775520:0:46264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094314752:12345-192.168.202.1@tcp:3:lfs.0 00000100:00100000:3.0:1788391244.775725:0:46264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094314752:12345-192.168.202.1@tcp:3:lfs.0 Request processed in 212us (3094us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788391244.775734:0:46264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 363 00002000:00100000:3.0:1788391244.775741:0:46264:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff95d58b179500 x1875263094314752/t0(0) o3->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:105/0 lens 488/4536 e 0 to 0 dl 1788391255 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788391244.775750:0:46264:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d58b179500 with x1875263094314752 ext(0->4095) 00002000:00010000:3.0:1788391244.775754:0:46264:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95d58b179500 00010000:00010000:0.0:1788391245.773336:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391245.773376:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391245.773399:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103494656:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.773440:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103494784:0@lo:400:kworker.0 00000100:00100000:3.0:1788391245.773463:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103494912:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.773688:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391245.774098:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103494784 00000100:00100000:2.0:1788391245.774107:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103494784 00000100:00100000:2.0:1788391245.774160:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788391245.774170:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103494784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391245.774223:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103494784:12345-0@lo:400:kworker.0 Request processed in 54us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391245.774230:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788391245.774322:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103494784:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774346:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103495296:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774375:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391245.774413:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391245.774419:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103495424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391245.774447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391245.774503:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103495168:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774529:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391245.774547:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391245.774553:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103495040:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774585:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391245.774613:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495424 00000100:00100000:1.0:1788391245.774617:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495424 00000100:00100000:1.0:1788391245.774644:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788391245.774651:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103495424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391245.774666:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 1703936 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391245.774703:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875263103495424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391245.774709:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788391245.774742:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103495424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391245.774762:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495296 00000100:00100000:1.0:1788391245.774766:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495296 00000100:00100000:1.0:1788391245.774797:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495168 00000100:00100000:1.0:1788391245.774801:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495168 00000100:00100000:1.0:1788391245.774815:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495040 00000100:00100000:1.0:1788391245.774818:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495040 00000100:00100000:1.0:1788391245.774831:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788391245.774837:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103495296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774872:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58aef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103495296:12345-0@lo:400:kworker.0 Request processed in 34us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391245.774878:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788391245.774891:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788391245.774896:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103495168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.774936:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103495168:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391245.774942:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788391245.774956:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788391245.774983:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103495040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788391245.775207:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391245.775245:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103495168:0@lo:400:kworker.0 00000100:00100000:1.0:1788391245.775529:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103495040:12345-0@lo:400:kworker.0 Request processed in 549us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391245.775536:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788391245.775562:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103495296:0@lo:400:kworker.0 00000100:00100000:2.0:1788391245.775694:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103495040:0@lo:400:kworker.0 00000100:00100000:0.0:1788391245.776229:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391245.776261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391245.776350:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103494656 00000100:00100000:2.0:1788391245.776356:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103494656 00000100:00100000:3.0:1788391245.776368:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103494912 00000100:00100000:3.0:1788391245.776374:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103494912 00000100:00100000:2.0:1788391245.776388:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788391245.776461:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788391245.776471:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103494912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391245.776512:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103494912:12345-0@lo:400:kworker.0 Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391245.776519:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788391245.776607:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103494656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391245.776687:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103494912:0@lo:400:kworker.0 00000100:00100000:2.0:1788391245.776710:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103494656:12345-0@lo:400:kworker.0 Request processed in 167us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391245.776716:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788391245.776764:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103494656:0@lo:400:kworker.0 00010000:00010000:3.0:1788391246.798506:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391246.799159:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391246.799233:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391246.804091:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495552 00000100:00100000:1.0:1788391246.804107:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495552 00000100:00100000:1.0:1788391246.804181:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788391246.804193:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103495552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391246.804230:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00080000:3.0:1788391246.804338:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391246.808452:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103495552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4252us (9208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391246.808520:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788391246.808662:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103495552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391247.397601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391247.397935:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094314880 00000100:00100000:0.0:1788391247.397946:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094314880 00000100:00080000:3.0:1788391247.398046:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391247.398241:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 531 00000100:00100000:2.0:1788391247.398255:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:41856:x1875263094314880:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391247.398281:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391247.398305:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0064c expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398380:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398395:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398409:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391247.398446:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391247.398450:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391247.398481:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398507:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0064c expref: 63 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398525:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0064c expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.398533:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe300) 00010000:00010000:2.0:1788391247.398536:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391247.398539:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391247.398596:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:41856:x1875263094314880:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 345us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391247.398604:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 531 00000100:00100000:0.0:1788391247.406221:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391247.406309:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315008 00000100:00100000:2.0:1788391247.406318:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315008 00000100:00100000:2.0:1788391247.406379:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 532 00000100:00100000:2.0:1788391247.406390:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:41856:x1875263094315008:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391247.406410:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391247.406430:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00653 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406566:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406580:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406591:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406606:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406613:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.406619:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.407997:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408030:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408040:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391247.408089:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:2.0:1788391247.408095:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391247.408118:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408130:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408138:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408144:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408156:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408162:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391247.408167:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408174:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408185:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe300) 00010000:00010000:2.0:1788391247.408188:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391247.408193:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408200:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd3899d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408214:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408220:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408225:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408231:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391247.408234:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408246:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408253:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff95d691bfe500) 00010000:00010000:2.0:1788391247.408255:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391247.408258:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408264:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd389a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408302:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 64 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408317:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 63 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391247.408324:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:2.0:1788391247.408326:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391247.408328:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176c00, rc 0) 00000100:00100000:2.0:1788391247.408409:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41856:x1875263094315008:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2020us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391247.408418:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 532 00000100:00100000:3.0:1788391247.477828:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391247.477880:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391247.478045:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315392 00000100:00100000:1.0:1788391247.478055:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315392 00000100:00100000:1.0:1788391247.478125:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1788391247.478135:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094315392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391247.478195:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094315392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391247.478200:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1788391247.478754:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315136 00000100:00100000:0.0:1788391247.478760:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315136 00000100:00100000:0.0:1788391247.478797:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:0.0:1788391247.478802:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094315136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391247.478847:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094315136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391247.478854:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00080000:3.0:1788391247.479244:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391247.480641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391247.480757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391247.481149:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315520 00000100:00100000:0.0:1788391247.481158:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315520 00000100:00100000:0.0:1788391247.481234:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1788391247.481246:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094315520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391247.481313:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094315520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391247.481320:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00080000:3.0:1788391247.481785:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391247.483190:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315264 00000100:00100000:2.0:1788391247.483201:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315264 00000100:00100000:2.0:1788391247.483322:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1788391247.483333:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094315264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391247.483429:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2356:x1875263094315264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 98us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391247.483437:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00080000:3.0:1788391247.484654:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788391247.821946:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391247.916685:0:47306:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391247.916705:0:47306:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391247.916753:0:47306:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 5 00000040:00080000:1.0:1788391247.916758:0:47306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391247.949660:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391247.949824:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315776 00000100:00100000:2.0:1788391247.949838:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315776 00000100:00100000:2.0:1788391247.949921:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 533 00000100:00100000:2.0:1788391247.949934:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41867:x1875263094315776:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:2.0:1788391247.950473:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].11, 136 off9688 00000100:00100000:2.0:1788391247.950630:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41867:x1875263094315776:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 695us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391247.950639:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 533 00010000:00010000:3.0:1788391248.845275:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391248.846088:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391248.846109:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391248.846154:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 6 00000040:00080000:0.0:1788391248.846161:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391248.846321:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103495680:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391248.846446:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788391248.849391:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103495680:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391248.852473:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391248.852530:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094315904 00000100:00100000:3.0:1788391248.852542:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094315904 00000100:00100000:3.0:1788391248.852615:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 534 00000100:00100000:3.0:1788391248.852628:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41868:x1875263094315904:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391248.852668:0:42645:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391248.852796:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41868:x1875263094315904:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 170us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391248.852805:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 534 00000100:00100000:0.0:1788391248.863308:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391248.863418:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094316160 00000100:00100000:3.0:1788391248.863430:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094316160 00000100:00100000:3.0:1788391248.863500:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 535 00000100:00100000:3.0:1788391248.863511:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:41868:x1875263094316160:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391248.863539:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391248.863579:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd389b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0065a expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863709:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863727:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863743:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391248.863758:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788391248.863875:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863884:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863898:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863904:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391248.863909:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863917:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863933:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:3.0:1788391248.863936:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788391248.863941:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.863978:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd389b9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.864034:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd389b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0065a expref: 65 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.864046:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:3.0:1788391248.864049:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391248.864054:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd389b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0065a expref: 65 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.864073:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391248.864137:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:41868:x1875263094316160:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 627us (843us total) trans 30064771543 rc 301/301 00000100:00100000:3.0:1788391248.864145:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 535 00000100:00100000:1.0:1788391248.870148:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391248.870625:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094316416 00000100:00100000:2.0:1788391248.870638:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094316416 00000100:00100000:2.0:1788391248.870728:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 536 00000100:00100000:2.0:1788391248.870741:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:41868:x1875263094316416:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788391248.871331:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871357:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871372:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871602:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871613:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871633:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871640:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391248.871646:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871654:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871669:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:3.0:1788391248.871672:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788391248.871677:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391248.871683:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389c7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391248.872416:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41868:x1875263094316416:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 1666us (2270us total) trans 30064771544 rc 0/0 00000100:00100000:3.0:1788391248.872428:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 536 00000040:00080000:3.0:1788391248.872510:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391248.872515:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391248.877314:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 6 00000040:00080000:3.0:1788391248.877340:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391248.878119:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391248.878157:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094316672 00000100:00100000:3.0:1788391248.878171:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094316672 00000100:00100000:3.0:1788391248.878238:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1788391248.878273:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:41868:x1875263094316672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391248.878590:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a55ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:41868:x1875263094316672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 333us (478us total) trans 30064771545 rc 0/0 00000100:00100000:3.0:1788391248.878599:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000001:00080000:3.0:1788391248.891336:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771283 is committed 00000001:00080000:3.0:1788391248.891363:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771281 is committed 00010000:00010000:1.0:1788391249.870502:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391249.903167:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771219 is committed 00000001:00080000:0.0:1788391249.903207:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771218 is committed 00000001:00080000:3.0:1788391249.924347:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771542 is committed 00000020:00080000:3.0:1788391249.924369:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803912 batchid updated 00000020:00080000:0.0:1788391249.924405:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803912 00000020:00080000:0.0:1788391249.924416:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803912 00000020:00080000:3.0:1788391249.924519:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d68f5749c0 refcount 2 committed 0 result 0 batchid 25769803913 00000020:00080000:3.0:1788391249.924525:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6930800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d68f5740c0 00000020:00080000:3.0:1788391249.924529:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6930000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58ac2cc00 00000020:00080000:0.0:1788391249.924555:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803913 committed batchid 25769803912 00000020:00080000:0.0:1788391249.924769:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803912 00000001:00080000:3.0:1788391249.925121:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771545 is committed 00010000:00010000:1.0:1788391250.893327:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391250.895040:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391250.895068:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103495808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391250.895163:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895506:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103496064:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.895535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895552:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788391250.895556:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103495936:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.895579:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895593:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103496448:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.895609:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895627:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103496320:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.895642:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895653:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391250.895656:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103496192:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.895669:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391250.895686:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496064 00000100:00100000:0.0:1788391250.895692:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496064 00000100:00100000:0.0:1788391250.895750:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788391250.895758:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103496064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391250.895879:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496448 00000100:00100000:3.0:1788391250.895882:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496448 00000100:00100000:3.0:1788391250.895907:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496320 00000100:00100000:3.0:1788391250.895909:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496320 00000100:00100000:3.0:1788391250.895918:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496192 00000100:00100000:3.0:1788391250.895919:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496192 00000100:00100000:3.0:1788391250.895927:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788391250.895932:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103496448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391250.895999:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103496448:12345-0@lo:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391250.896005:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788391250.896023:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788391250.896027:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103496320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391250.896045:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495808 00000100:00100000:2.0:1788391250.896052:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495808 00000100:00100000:3.0:1788391250.896053:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103496320:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391250.896078:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788391250.896094:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788391250.896094:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788391250.896102:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103496192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391250.896110:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103495808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391250.896135:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103496192:12345-0@lo:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391250.896142:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00002000:00000024:2.0:1788391250.896162:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391250.896187:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103495936 00000100:00100000:3.0:1788391250.896192:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103495936 00000100:00100000:2.0:1788391250.896218:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103495808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391250.896225:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788391250.896229:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788391250.896237:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103495936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391250.896275:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771283 gen 2 00000100:00100000:3.0:1788391250.896276:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103495936:12345-0@lo:400:kworker.0 Request processed in 42us (694us total) trans 0 rc 0/0 00000004:00080000:2.0:1788391250.896285:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771282 committed transno 30064771283 00000100:00100000:3.0:1788391250.896286:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000004:00080000:2.0:1788391250.896316:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58afd4000, transno 30064771283 00000100:00080000:3.0:1788391250.896330:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391250.896337:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391250.896340:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103495808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788391250.896341:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391250.896376:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103495936:0@lo:400:kworker.0 00000100:00100000:2.0:1788391250.896394:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103496192:0@lo:400:kworker.0 00000100:00100000:3.0:1788391250.896397:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103496448:0@lo:400:kworker.0 00000100:00100000:2.0:1788391250.896416:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103496320:0@lo:400:kworker.0 00000100:00100000:0.0:1788391250.896515:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103496064:12345-0@lo:400:kworker.0 Request processed in 756us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391250.896532:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788391250.897529:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771219 gen 2 00000004:00080000:3.0:1788391250.897537:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771219 committed transno 30064771219 00000100:00100000:3.0:1788391250.897550:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103496064:0@lo:400:kworker.0 00010000:00010000:1.0:1788391251.918167:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391251.918239:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391251.918271:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103496576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391251.918383:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391251.918668:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496576 00000100:00100000:0.0:1788391251.918679:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496576 00000100:00100000:0.0:1788391251.918759:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788391251.918774:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103496576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391251.918824:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391251.918881:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103496576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391251.918886:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788391251.919083:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103496576:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788391251.981263:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391251.981273:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391251.981606:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 5 00000040:00080000:3.0:1788391251.981615:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391252.598537:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391252.598588:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391252.598622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391252.598651:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391252.598674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391252.598873:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094316928 00000100:00100000:0.0:1788391252.598891:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094316928 00000100:00100000:0.0:1788391252.599047:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317312 00000100:00100000:0.0:1788391252.599051:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317312 00000100:00100000:0.0:1788391252.599089:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1788391252.599101:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2359:x1875263094316928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391252.599217:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2359:x1875263094316928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 118us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391252.599225:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1788391252.599245:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:0.0:1788391252.599252:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094317312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391252.599276:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094317312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391252.599516:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317056 00000100:00100000:3.0:1788391252.599529:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317056 00000100:00100000:3.0:1788391252.599586:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317184 00000100:00100000:3.0:1788391252.599589:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317184 00000100:00100000:3.0:1788391252.599614:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788391252.599625:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094317056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391252.599644:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1788391252.599705:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2358:x1875263094317056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391252.599717:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1788391252.599746:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:3.0:1788391252.599759:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094317184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391252.599789:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094317184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 37us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391252.599796:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00080000:1.0:1788391252.599883:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391252.599887:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391252.599890:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391252.599950:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094316800 00000100:00100000:2.0:1788391252.599954:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094316800 00000100:00100000:3.0:1788391252.600069:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:3.0:1788391252.600079:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094316800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391252.600136:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094316800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391252.600143:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00010000:00010000:1.0:1788391252.942199:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391253.965207:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391254.989283:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788391255.011922:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803913 batchid updated 00000020:00080000:0.0:1788391255.012024:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00000020:00080000:0.0:1788391255.012037:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00000100:00100000:2.0:1788391256.013105:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391256.013128:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391256.013201:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391256.013343:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391256.013542:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391256.014156:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496704 00000100:00100000:0.0:1788391256.014163:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496704 00000100:00080000:2.0:1788391256.014220:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391256.014223:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788391256.014232:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103496704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391256.014266:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391256.014314:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103496704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391256.014321:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788391256.014355:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391256.014553:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103496960:0@lo:400:kworker.0 00000100:00100000:2.0:1788391256.014588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391256.014612:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391256.014617:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103497088:0@lo:400:kworker.0 00000100:00100000:2.0:1788391256.014642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391256.014665:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496960 00000100:00100000:2.0:1788391256.014668:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496960 00000100:00100000:0.0:1788391256.014697:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497088 00000100:00100000:0.0:1788391256.014701:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497088 00000100:00100000:2.0:1788391256.014707:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788391256.014716:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391256.014729:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788391256.014754:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103496960:12345-0@lo:400:kworker.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391256.014763:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788391256.014780:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391256.014794:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788391256.014823:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103497088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391256.014905:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103497088:0@lo:400:kworker.0 00000100:00100000:0.0:1788391256.014920:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103497088:12345-0@lo:400:kworker.0 Request processed in 130us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391256.014936:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788391256.016004:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788391256.016041:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391256.016080:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103496832:0@lo:400:kworker.0 00000100:00100000:2.0:1788391256.016102:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497216 00000100:00100000:2.0:1788391256.016108:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497216 00000100:00100000:1.0:1788391256.016112:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391256.016154:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788391256.016164:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103497216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391256.016167:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103496832 00000100:00080000:1.0:1788391256.016172:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391256.016174:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103496832 00000100:00100000:2.0:1788391256.016210:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103497216:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391256.016215:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788391256.016221:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788391256.016228:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103496832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391256.016245:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788391256.016274:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103496832:0@lo:400:kworker.0 00000100:00100000:0.0:1788391256.016277:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103496832:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391256.016285:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788391256.020102:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103497344:0@lo:400:kworker.0 00000100:00100000:2.0:1788391256.020173:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391256.020231:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497344 00000100:00100000:3.0:1788391256.020239:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497344 00000100:00080000:2.0:1788391256.020283:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391256.020302:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788391256.020312:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103497344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391256.020367:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103497344:12345-0@lo:400:kworker.0 Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391256.020389:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788391256.020404:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103497344:0@lo:400:kworker.0 00010000:00010000:3.0:1788391257.037107:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391257.037313:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103497472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391257.037377:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391257.037419:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497472 00000100:00100000:1.0:1788391257.037427:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497472 00000100:00100000:1.0:1788391257.037493:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788391257.037504:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103497472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391257.037535:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391257.037591:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103497472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391257.037598:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788391257.037667:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103497472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391257.717520:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391257.717619:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391257.717651:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391257.717682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391257.717708:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391257.717732:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317952 00000100:00100000:1.0:1788391257.717739:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317952 00000100:00100000:1.0:1788391257.717788:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317568 00000100:00100000:1.0:1788391257.717791:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317568 00000100:00100000:1.0:1788391257.717812:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1788391257.717822:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094317952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391257.717892:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094317952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391257.717900:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1788391257.717932:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:1.0:1788391257.717952:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2359:x1875263094317568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391257.718006:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2359:x1875263094317568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00080000:0.0:1788391257.718010:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391257.718033:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788391257.718117:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317696 00000100:00100000:0.0:1788391257.718120:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317696 00000100:00100000:0.0:1788391257.718203:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317824 00000100:00100000:0.0:1788391257.718206:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317824 00000100:00080000:1.0:1788391257.718227:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391257.718230:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391257.718241:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1788391257.718253:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2359:x1875263094317696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391257.718304:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2359:x1875263094317696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391257.718311:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1788391257.721361:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1788391257.721390:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094317824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391257.721462:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094317824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391257.721469:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:2.0:1788391257.721573:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094317440 00000100:00100000:2.0:1788391257.721583:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094317440 00000100:00100000:2.0:1788391257.721624:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:2.0:1788391257.721633:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094317440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391257.721664:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094317440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (4155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391257.721671:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00010000:00010000:1.0:1788391258.061158:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391259.085835:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391260.109493:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391261.133269:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391261.133293:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103497600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391261.133373:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133523:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103498112:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133589:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391261.133595:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103497984:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133618:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133654:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133676:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133702:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103498368:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133722:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133737:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788391261.133741:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133759:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133771:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133783:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391261.133807:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497984 00000100:00100000:3.0:1788391261.133812:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497984 00000100:00100000:3.0:1788391261.133854:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497856 00000100:00100000:3.0:1788391261.133856:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497856 00000100:00100000:3.0:1788391261.133870:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788391261.133876:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103497984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133926:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103497984:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.133931:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788391261.133943:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788391261.133947:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.133980:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103497856:12345-0@lo:400:kworker.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.133983:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788391261.134013:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103497984:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134037:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134060:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103498112 00000100:00100000:3.0:1788391261.134064:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103498112 00000100:00100000:3.0:1788391261.134084:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103498368 00000100:00100000:3.0:1788391261.134086:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103498368 00000100:00100000:3.0:1788391261.134094:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103498240 00000100:00100000:3.0:1788391261.134095:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103498240 00000100:00100000:3.0:1788391261.134103:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788391261.134106:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103498112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134138:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103498112:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.134143:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788391261.134155:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788391261.134161:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134195:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103498368:12345-0@lo:400:kworker.0 Request processed in 36us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.134201:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788391261.134212:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788391261.134217:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103498240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134242:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103498240:12345-0@lo:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.134247:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788391261.134277:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103498112:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134297:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103498240:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134306:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103498368:0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134332:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497728 00000100:00100000:3.0:1788391261.134336:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497728 00000100:00100000:3.0:1788391261.134358:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788391261.134364:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391261.134396:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103497728:12345-0@lo:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391261.134402:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788391261.134431:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103497728:0@lo:400:kworker.0 00000100:00080000:1.0:1788391261.134631:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391261.134637:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391261.134639:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391261.134647:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391261.134859:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103497600 00000100:00100000:2.0:1788391261.134863:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103497600 00000100:00100000:2.0:1788391261.134924:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788391261.134930:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103497600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391261.134971:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391261.135005:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103497600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391261.135130:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103497600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391261.135172:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000040:00080000:3.0:1788391261.197269:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391261.197278:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391261.197639:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 4 00000040:00080000:3.0:1788391261.197646:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391262.158520:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391262.158707:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391262.158748:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103498496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391262.158817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391262.159053:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103498496 00000100:00100000:1.0:1788391262.159061:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103498496 00000100:00100000:1.0:1788391262.159113:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788391262.159124:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103498496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391262.159158:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391262.159211:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103498496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391262.159219:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788391262.159293:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103498496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391262.837282:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391262.837317:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391262.837342:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391262.837365:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391262.837380:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391262.837440:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318208 00000100:00100000:3.0:1788391262.837449:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318208 00000100:00100000:2.0:1788391262.837467:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318080 00000100:00100000:2.0:1788391262.837473:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318080 00000100:00100000:3.0:1788391262.837513:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318592 00000100:00100000:2.0:1788391262.837517:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:3.0:1788391262.837518:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318592 00000100:00100000:2.0:1788391262.837534:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094318080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391262.837538:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318464 00000100:00100000:3.0:1788391262.837544:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788391262.837545:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318464 00000100:00100000:3.0:1788391262.837552:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2357:x1875263094318208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391262.837588:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318336 00000100:00100000:0.0:1788391262.837593:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318336 00000100:00100000:2.0:1788391262.837605:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094318080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00080000:1.0:1788391262.837612:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391262.837614:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00080000:1.0:1788391262.837619:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391262.837624:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391262.837625:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1788391262.837638:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094318464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391262.837644:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:1.0:1788391262.837658:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094318592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391262.837683:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:2.0:1788391262.837692:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094318336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391262.837920:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2357:x1875263094318208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 368us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391262.837929:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788391262.844065:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094318464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 6416us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391262.844081:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1788391262.848681:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094318592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 10898us (11168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391262.848717:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:2.0:1788391262.860195:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094318336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22490us (22813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391262.860212:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00010000:00010000:1.0:1788391263.181564:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391264.205242:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391264.873365:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391264.873658:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318720 00000100:00100000:1.0:1788391264.873672:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318720 00000100:00080000:2.0:1788391264.873733:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391264.874941:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:1.0:1788391264.874977:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2356:x1875263094318720:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:1.0:1788391264.875043:0:44885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.875071:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 11 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.875081:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=20s v=(0 0) 00010000:00010000:1.0:1788391264.875086:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391264.875092:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.875139:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 11 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.875157:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 11 pid: 44885 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391264.875175:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103498624:192.168.202.1@tcp:104: 00000100:00100000:1.0:1788391264.875309:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68a6e4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788391264.879883:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391264.879906:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:44885:1875263103498624:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391264.879948:0:44885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391264.880007:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094318848 00000100:00100000:0.0:1788391264.880024:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094318848 00010000:00010000:0.0:1788391264.880083:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391264.880121:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1788391264.880130:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+12:2357:x1875263094318848:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391264.880159:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391264.880181:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.880195:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.880217:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006916ab94/0x9aafc5f04cd38981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00645 expref: 12 pid: 44885 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.880233:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391264.880238:0:45855:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391264.880242:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.880251:0:45855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.880281:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391264.880318:0:44885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880332:0:44885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391264.880355:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+11:2357:x1875263094318848:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391264.880363:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00010000:00010000:2.0:1788391264.880371:0:44885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880383:0:44885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880393:0:44885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880401:0:44885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391264.880407:0:44885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880418:0:44885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880438:0:44885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.880453:0:44885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a91d414f/0x9aafc5f04cd389ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391264.880533:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094318720:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 5578us (7180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391264.880544:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:0.0:1788391264.891516:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391264.894164:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319104 00000100:00100000:3.0:1788391264.894184:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319104 00000100:00100000:3.0:1788391264.894303:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1788391264.894320:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:41852:x1875263094319104:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:3.0:1788391264.894405:0:42648:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ff expref: 54 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788391264.894734:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771546 00000001:00080000:3.0:1788391264.895525:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771547 00010000:00010000:3.0:1788391264.895602:0:42648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895621:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895630:0:42648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895646:0:42648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895694:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895712:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 57 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391264.895729:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103498752:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391264.895885:0:42648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391264.895896:0:42648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 57 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391264.895907:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103498880:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391264.895937:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d687ba2540 going to sleep for 11 seconds 00000100:00080000:2.0:1788391264.896917:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391264.902689:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391264.902792:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391264.902919:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319232 00000100:00100000:2.0:1788391264.902933:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319232 00010000:00010000:2.0:1788391264.903034:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 58 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391264.903080:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319360 00000100:00100000:2.0:1788391264.903084:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319360 00010000:00010000:2.0:1788391264.903098:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391264.903127:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:2.0:1788391264.903138:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:2357:x1875263094319232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391264.903157:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391264.903167:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 59 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.903186:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 59 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391264.903208:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00010000:00010000:2.0:1788391264.903242:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00000100:00100000:1.0:1788391264.903245:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:2357:x1875263094319360:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391264.903252:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391264.903266:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.903270:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391264.903275:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391264.903287:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 59 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391264.903350:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:2357:x1875263094319232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391264.903360:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00010000:00010000:0.0:1788391264.903437:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd389ab lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00653 expref: 58 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391264.903483:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103498752:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391264.903500:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:42648:1875263103498880:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391264.903532:0:42648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904213:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 57 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904236:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd388af lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00606 expref: 57 pid: 42644 timeout: 1182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904251:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:1.0:1788391264.904256:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904265:0:42630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904272:0:42630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.904580:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391264.904985:0:42648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.904994:0:42648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391264.905124:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771548 00000001:00080000:0.0:1788391264.905353:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771549 00000100:00100000:0.0:1788391264.905445:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103499008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391264.905498:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391264.905699:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2357:x1875263094319360:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2474us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391264.905710:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:0.0:1788391264.907974:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788391264.912098:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499008 00000100:00100000:3.0:1788391264.912121:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499008 00000100:00100000:2.0:1788391264.912318:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788391264.912334:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103499008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391264.912511:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103499008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (7011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391264.912519:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788391264.912625:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103499008:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1788391264.912810:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788391264.913362:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771550 00000100:00100000:0.0:1788391264.913438:0:42648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103499136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788391264.913494:0:42648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391264.913535:0:42648:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d683727600 going to sleep for 11 seconds 00000100:00100000:2.0:1788391264.915094:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499136 00000100:00100000:2.0:1788391264.915112:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499136 00000100:00100000:2.0:1788391264.915241:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788391264.915254:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42648:x1875263103499136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788391264.916333:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42648:x1875263103499136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1073us (2829us total) trans 30064771220 rc 0/0 00000100:00100000:2.0:1788391264.916346:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788391264.916426:0:42648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:42648:1875263103499136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788391264.916524:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771551 00010000:00010000:0.0:1788391264.916587:0:42648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916614:0:42648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916622:0:42648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916628:0:42648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391264.916633:0:42648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916640:0:42648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916655:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391264.916657:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788391264.916661:0:42648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391264.916665:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd389d5 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788391264.917222:0:42648:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788391264.917533:0:42648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].20, 64 off9712 00000004:00080000:0.0:1788391264.917545:0:42648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1082024583279ns, next at 1083024580953ns, rc = 0 00000001:00080000:0.0:1788391264.917552:0:42648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771552 00010000:00010000:0.0:1788391264.917600:0:42648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d6a0d29100) 00010000:00010000:0.0:1788391264.917604:0:42648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788391264.917612:0:42648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd3889a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc005ff expref: 60 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391264.917761:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41852:x1875263094319104:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 23445us (26252us total) trans 30064771553 rc 0/0 00000100:00100000:0.0:1788391264.917779:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000020:00080000:0.0:1788391264.917787:0:42648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1788391264.927634:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391264.927717:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319488 00000100:00100000:3.0:1788391264.927732:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319488 00000100:00100000:3.0:1788391264.927933:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 537 00000100:00100000:3.0:1788391264.927945:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:41852:x1875263094319488:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391264.928274:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391264.928319:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd389dc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00661 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.928382:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd389dc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00661 expref: 60 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.928397:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16de00/0x9aafc5f04cd389dc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00661 expref: 60 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391264.928418:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff95d692d30200) 00010000:00010000:1.0:1788391264.928421:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391264.928424:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16de00, rc 0) 00000100:00100000:1.0:1788391264.928494:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:41852:x1875263094319488:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 552us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391264.928501:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 537 00000100:00100000:3.0:1788391264.931088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391264.931182:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319744 00000100:00100000:2.0:1788391264.931200:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319744 00000100:00100000:2.0:1788391264.931355:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1788391264.931368:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:41852:x1875263094319744:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1788391264.931879:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:41852:x1875263094319744:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 511us (797us total) trans 30064771554 rc 0/0 00000100:00100000:2.0:1788391264.931889:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00010000:00010000:1.0:1788391265.229272:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788391265.274079:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771553 is committed 00000004:00080000:0.0:1788391265.274115:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000020:00080000:0.0:1788391265.274141:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a69edd80 refcount 2 committed 0 result 0 batchid 25769803914 00000020:00080000:0.0:1788391265.274147:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6d39700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d69191ecc0 00000020:00080000:0.0:1788391265.274150:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6a6d39200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d688551400 00000001:00080000:0.0:1788391265.274168:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771554 is committed 00000020:00080000:0.0:1788391265.274336:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803914 committed batchid 25769803913 00000020:00080000:0.0:1788391265.274546:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803913 00000100:00100000:0.0:1788391265.274572:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103499264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788391265.274664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391265.274752:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499264 00000100:00100000:0.0:1788391265.274761:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499264 00000100:00100000:0.0:1788391265.274815:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788391265.274827:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103499264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788391265.274874:0:43698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:207 count 1 00002000:00010000:0.0:1788391265.274919:0:43698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6a98af4c, atime: 0x6a98af4c, ctime: 0x6a98af4c, blocks: 0xb 00010000:00010000:0.0:1788391265.274930:0:43698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.274950:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=1082s v=(0 0) 00010000:00010000:0.0:1788391265.274997:0:43698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391265.275006:0:43698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275024:0:43698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275035:0:43698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275043:0:43698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275065:0:43698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788391265.275669:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875263103499264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 841us (1004us total) trans 30064771221 rc 0/0 00000100:00100000:0.0:1788391265.275679:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:0.0:1788391265.275716:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788391265.275724:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275735:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc176a230) 00010000:00010000:0.0:1788391265.275741:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275751:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275787:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275796:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006098a519/0x9aafc5f04cd389e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391265.275818:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391265.275820:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391265.275822:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788391265.275875:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d5853d6d80/2, rc 0, transno 30064771221 00000100:00100000:0.0:1788391265.275883:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103499264:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788391265.286485:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771220 is committed 00000100:00100000:3.0:1788391266.255358:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103499392:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255430:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255475:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103499904:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255503:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255528:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788391266.255534:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103499520:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255560:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255578:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103500032:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255598:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255626:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103499648:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255649:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255665:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391266.255671:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103499776:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255695:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.255726:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499392 00000100:00100000:3.0:1788391266.255733:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499392 00000100:00100000:3.0:1788391266.255780:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788391266.255790:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103499392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.255847:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103499392:12345-0@lo:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.255854:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788391266.255886:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499904 00000100:00100000:3.0:1788391266.255890:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499904 00000100:00100000:3.0:1788391266.255930:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103500032 00000100:00100000:3.0:1788391266.255934:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103500032 00000100:00100000:3.0:1788391266.255949:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499776 00000100:00100000:3.0:1788391266.255952:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499776 00000100:00100000:3.0:1788391266.255988:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788391266.255995:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103499904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256028:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103499904:12345-0@lo:400:kworker.0 Request processed in 34us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.256034:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788391266.256045:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788391266.256052:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103500032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256077:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103500032:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.256082:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788391266.256092:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788391266.256098:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103499776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256126:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103499776:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.256132:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788391266.256148:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499520 00000100:00100000:3.0:1788391266.256151:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499520 00000100:00100000:3.0:1788391266.256176:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103499648 00000100:00100000:3.0:1788391266.256178:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103499648 00000100:00100000:3.0:1788391266.256199:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788391266.256205:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103499520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256233:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103499520:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.256249:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788391266.256261:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788391266.256267:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103499648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256294:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103499648:12345-0@lo:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.256299:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788391266.256327:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391266.256331:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391266.256333:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391266.256370:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103499776:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256381:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103499648:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256406:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:3.0:1788391266.256412:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771220 committed transno 30064771220 00000100:00100000:3.0:1788391266.256430:0:3288:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d5853d6d80 x1875263103499264/t30064771221(30064771221) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391281 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788391266.256441:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103499520:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256452:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103500032:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256460:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103499392:0@lo:400:kworker.0 00000100:00100000:3.0:1788391266.256467:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103499904:0@lo:400:kworker.0 00010000:00010000:1.0:1788391266.258315:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391266.258485:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391266.262159:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391266.262298:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391266.266789:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103500160 00000100:00100000:3.0:1788391266.266803:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103500160 00000100:00100000:3.0:1788391266.267053:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788391266.267064:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103500160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391266.267109:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391266.267188:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103500160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (4890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391266.267195:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788391266.267264:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103500160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788391267.280073:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391267.283621:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103500288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391267.283777:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391267.283887:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103500288 00000100:00100000:0.0:1788391267.283897:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103500288 00000100:00100000:0.0:1788391267.283984:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788391267.283997:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103500288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391267.284045:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391267.284099:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103500288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391267.284107:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788391267.284166:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103500288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391267.965911:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391267.965986:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391267.966023:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391267.966048:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391267.966076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391267.966113:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094319872 00000100:00100000:2.0:1788391267.966127:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094319872 00000100:00100000:2.0:1788391267.966193:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:2.0:1788391267.966206:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094319872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391267.966297:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094319872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391267.966306:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:2.0:1788391267.966349:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320128 00000100:00100000:2.0:1788391267.966354:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320128 00000100:00100000:2.0:1788391267.966395:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320256 00000100:00100000:2.0:1788391267.966399:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320256 00000100:00100000:2.0:1788391267.966425:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391267.966432:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094320128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391267.966468:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094320128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391267.966479:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1788391267.966491:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788391267.966498:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094320256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391267.966527:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094320256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391267.966534:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:2.0:1788391267.966586:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320384 00000100:00100000:2.0:1788391267.966590:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320384 00000100:00100000:2.0:1788391267.966618:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320000 00000100:00100000:2.0:1788391267.966621:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320000 00000100:00100000:2.0:1788391267.966637:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:2.0:1788391267.966644:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094320384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391267.966672:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094320384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391267.966679:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:2.0:1788391267.966690:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1788391267.968031:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2357:x1875263094320000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391267.968107:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:2357:x1875263094320000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1410us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391267.968118:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00080000:2.0:1788391267.968184:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391267.968191:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391267.968194:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391268.307934:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391268.361421:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391268.361624:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320512 00000100:00100000:2.0:1788391268.361638:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320512 00000100:00100000:2.0:1788391268.361757:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 538 00000100:00100000:2.0:1788391268.361771:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41797:x1875263094320512:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788391268.361988:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41797:x1875263094320512:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 191us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391268.361997:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 538 00000100:00100000:2.0:1788391268.364470:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391268.364567:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094320768 00000100:00100000:0.0:1788391268.364577:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094320768 00000100:00100000:0.0:1788391268.364643:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1788391268.364652:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+52:41797:x1875263094320768:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788391268.365046:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:41797:x1875263094320768:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 393us (588us total) trans 30064771555 rc 0/0 00000100:00100000:0.0:1788391268.365055:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00010000:00010000:2.0:1788391269.326205:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788391269.390082:0:47535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 19:21:08 (1788391268) 00000100:00100000:1.0:1788391269.549165:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391269.549255:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321024 00000100:00100000:2.0:1788391269.549264:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321024 00000100:00100000:2.0:1788391269.549375:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 539 00000100:00100000:2.0:1788391269.549387:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+53:42484:x1875263094321024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391269.549411:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391269.549430:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd389ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00668 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549499:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549514:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549525:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549541:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549553:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549559:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549784:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd389ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549793:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd389ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549800:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd389ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391269.549824:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788391269.549908:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549915:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549922:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549928:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.549932:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549938:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.549952:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95d6830d2600) 00010000:00010000:2.0:1788391269.549955:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.550042:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550048:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd389f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550059:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550065:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550071:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550076:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.550079:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550085:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550092:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95d691bfe900) 00010000:00010000:2.0:1788391269.550094:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.550097:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550103:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd389f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550445:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd389ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00668 expref: 56 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550460:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd389ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00668 expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.550468:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:2.0:1788391269.550470:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.550473:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177600, rc 0) 00000100:00100000:2.0:1788391269.550533:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42484:x1875263094321024:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1378us total) trans 30064771556 rc 0/0 00000100:00100000:2.0:1788391269.550541:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 539 00000100:00080000:3.0:1788391269.550929:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391269.554708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391269.554739:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391269.554786:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321152 00000100:00100000:1.0:1788391269.554793:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321152 00000100:00100000:1.0:1788391269.554859:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1788391269.554866:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:2356:x1875263094321152:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391269.554878:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391269.554897:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd389ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00668 expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.554924:0:42629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391269.554928:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391269.554995:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:2356:x1875263094321152:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 129us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391269.555000:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1788391269.555080:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321280 00000100:00100000:3.0:1788391269.555084:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321280 00000100:00100000:3.0:1788391269.555117:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 540 00000100:00100000:3.0:1788391269.555122:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42484:x1875263094321280:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788391269.555172:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42484:x1875263094321280:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 50us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391269.555176:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 540 00000100:00100000:1.0:1788391269.685331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391269.687121:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321408 00000100:00100000:2.0:1788391269.687135:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321408 00000100:00100000:2.0:1788391269.687204:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 541 00000100:00100000:2.0:1788391269.687215:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42505:x1875263094321408:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391269.687289:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391269.687311:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0066f expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687376:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687389:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687401:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687414:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687420:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687426:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687609:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687616:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687623:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687628:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.687632:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687639:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687743:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe300) 00010000:00010000:2.0:1788391269.687746:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.687751:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687757:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687769:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687775:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687781:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687786:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.687789:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687795:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687814:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff95d691bfe900) 00010000:00010000:2.0:1788391269.687817:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.687821:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687826:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687859:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38a0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0066f expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687874:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe300) 00010000:00010000:2.0:1788391269.687876:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.687880:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0066f expref: 55 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.687889:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176200, rc 0) 00000100:00100000:2.0:1788391269.688064:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42505:x1875263094321408:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 849us (2742us total) trans 0 rc 301/301 00000100:00100000:2.0:1788391269.688071:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 541 00000100:00100000:0.0:1788391269.692590:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391269.692761:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321664 00000100:00100000:3.0:1788391269.692772:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321664 00000100:00100000:3.0:1788391269.692838:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 542 00000100:00100000:3.0:1788391269.692849:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42505:x1875263094321664:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:3.0:1788391269.693044:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391269.693072:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd3898f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0064c expref: 54 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693093:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe300) 00010000:00010000:3.0:1788391269.693103:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391269.693310:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693323:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693340:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693354:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693361:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.693368:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391269.695602:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:3.0:1788391269.695618:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695625:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695630:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695634:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.695638:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695642:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695653:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d68641e200) 00010000:00010000:3.0:1788391269.695655:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.695665:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.695670:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391269.695693:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbd24510 reply state 000000000eb5ed11 transno 30064771557 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391269.695700:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788391269.696074:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42505:x1875263094321664:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 3223us (3491us total) trans 30064771557 rc 0/0 00000100:00100000:3.0:1788391269.696081:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 542 00010000:00010000:2.0:1788391269.702071:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702086:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702091:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702095:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.702098:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702110:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702124:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff95d68641ed00) 00010000:00010000:2.0:1788391269.702126:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.702129:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.702134:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38a29 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391269.713947:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391269.714069:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321792 00000100:00100000:2.0:1788391269.714082:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321792 00000100:00100000:2.0:1788391269.714152:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 543 00000100:00100000:2.0:1788391269.714162:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+54:42506:x1875263094321792:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:2.0:1788391269.714187:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391269.714210:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00676 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714276:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714290:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714300:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391269.714347:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391269.714351:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391269.714389:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714412:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00676 expref: 56 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714432:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00676 expref: 55 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.714440:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:2.0:1788391269.714443:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391269.714447:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176e00, rc 0) 00000100:00100000:2.0:1788391269.714506:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42506:x1875263094321792:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 346us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391269.714513:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 543 00000100:00100000:3.0:1788391269.716566:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391269.716638:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094321920 00000100:00100000:1.0:1788391269.716646:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094321920 00000100:00100000:1.0:1788391269.716713:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 544 00000100:00100000:1.0:1788391269.716720:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42506:x1875263094321920:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:1.0:1788391269.716734:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391269.716748:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0067d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716797:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716818:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716828:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716843:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716850:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.716873:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717003:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717010:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717014:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391269.717040:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788391269.717042:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391269.717058:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717066:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717070:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717075:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717078:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391269.717081:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717085:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717098:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:1.0:1788391269.717100:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391269.717103:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717107:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c200/0x9aafc5f04cd38a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717115:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717118:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717122:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717125:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391269.717127:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717130:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717133:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff95d692d30000) 00010000:00010000:1.0:1788391269.717134:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391269.717136:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717139:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717172:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0067d expref: 57 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717184:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0067d expref: 56 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.717191:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30800) 00010000:00010000:1.0:1788391269.717193:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391269.717196:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c800, rc 0) 00000100:00100000:1.0:1788391269.717244:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42506:x1875263094321920:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 524us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391269.717249:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 544 00000100:00100000:2.0:1788391269.722378:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391269.722455:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094322176 00000100:00100000:0.0:1788391269.722470:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094322176 00000100:00100000:0.0:1788391269.722556:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 545 00000100:00100000:0.0:1788391269.722568:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42506:x1875263094322176:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:0.0:1788391269.722637:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391269.722675:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38a53 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0067d expref: 56 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.722701:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30800) 00010000:00010000:0.0:1788391269.722727:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391269.722762:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.722787:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.722798:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788391269.723104:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093e8ac34 reply state 00000000341179f4 transno 30064771558 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391269.723114:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788391269.723121:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000100:00100000:0.0:1788391269.723215:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42506:x1875263094322176:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 650us (845us total) trans 30064771558 rc 0/0 00000100:00100000:0.0:1788391269.723220:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 545 00010000:00010000:1.0:1788391269.725074:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725089:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725095:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725099:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391269.725103:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725108:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725121:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d6a704c900) 00010000:00010000:1.0:1788391269.725135:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788391269.725139:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.725143:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38a5a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391269.732200:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391269.732309:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094322304 00000100:00100000:3.0:1788391269.732317:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094322304 00000100:00100000:3.0:1788391269.732369:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 546 00000100:00100000:3.0:1788391269.732376:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42507:x1875263094322304:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788391269.732397:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391269.732416:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00684 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732478:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732491:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732502:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732528:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732533:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732538:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732607:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732612:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732617:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391269.732635:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788391269.732638:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391269.732651:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732659:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732664:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732668:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732678:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.732681:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732686:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732694:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:3.0:1788391269.732696:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.732699:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732703:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732717:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732720:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732724:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732727:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.732729:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732732:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732742:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff95d68641e200) 00010000:00010000:3.0:1788391269.732743:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.732745:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732749:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732770:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00684 expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732779:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00684 expref: 57 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.732786:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391269.732788:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788391269.732790:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa600, rc 0) 00000100:00100000:3.0:1788391269.732860:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42507:x1875263094322304:12345-192.168.202.1@tcp:101:rm.0 Request processed in 483us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391269.732867:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 546 00000100:00100000:0.0:1788391269.740113:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391269.740194:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094322432 00000100:00100000:3.0:1788391269.740204:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094322432 00000100:00100000:3.0:1788391269.740252:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 547 00000100:00100000:3.0:1788391269.740259:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42507:x1875263094322432:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1788391269.740276:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391269.740292:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a7d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0068b expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740367:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740377:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740385:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740394:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740398:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740405:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740462:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740470:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740476:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740482:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.740487:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740504:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740515:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391269.740519:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.740525:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740530:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38a84 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740542:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740547:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740552:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740556:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.740559:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740564:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740571:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d68641e200) 00010000:00010000:3.0:1788391269.740574:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.740576:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740587:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38a8b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740620:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a7d lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0068b expref: 58 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740630:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391269.740632:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.740635:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38a7d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0068b expref: 58 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.740643:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fb400, rc 0) 00000100:00100000:3.0:1788391269.740703:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42507:x1875263094322432:12345-192.168.202.1@tcp:101:rm.0 Request processed in 443us (598us total) trans 0 rc 301/301 00000100:00100000:3.0:1788391269.740717:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 547 00000100:00100000:3.0:1788391269.745389:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391269.745474:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094322560 00000100:00100000:0.0:1788391269.745485:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094322560 00000100:00100000:0.0:1788391269.745542:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 548 00000100:00100000:0.0:1788391269.745551:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42507:x1875263094322560:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:0.0:1788391269.745568:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391269.745585:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38a92 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00692 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745635:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745646:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745656:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745671:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745697:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745704:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745765:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745772:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745778:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745784:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391269.745788:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745795:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745816:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:0.0:1788391269.745819:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391269.745824:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745830:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38a99 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745843:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745855:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745861:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745866:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391269.745869:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745875:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745894:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d6a704c600) 00010000:00010000:0.0:1788391269.745897:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391269.745900:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745905:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aa0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745942:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38a92 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00692 expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.745953:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:0.0:1788391269.745955:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391269.745984:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38a92 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00692 expref: 58 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.746005:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9a00, rc 0) 00000100:00100000:0.0:1788391269.746069:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42507:x1875263094322560:12345-192.168.202.1@tcp:101:rm.0 Request processed in 518us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1788391269.746075:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 548 00000100:00100000:2.0:1788391269.787669:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391269.787900:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094322816 00000100:00100000:3.0:1788391269.787909:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094322816 00000100:00100000:3.0:1788391269.788096:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 549 00000100:00100000:3.0:1788391269.788107:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42513:x1875263094322816:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:3.0:1788391269.788131:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391269.788152:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38aa7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00699 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788471:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788501:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788513:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788526:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788533:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.788539:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790067:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38abc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790083:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38abc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790095:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38abc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391269.790107:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:3.0:1788391269.790132:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790140:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790147:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790327:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391269.790391:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790462:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790477:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391269.790480:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391269.790485:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790491:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38aae lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391269.790506:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d12d4216 reply state 000000001813453a transno 30064771559 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391269.790515:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788391269.790548:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38aa7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00699 expref: 60 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790562:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38abc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00699 expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391269.790569:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391269.790572:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788391269.790574:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:3.0:1788391269.790705:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42513:x1875263094322816:12345-192.168.202.1@tcp:101:dd.500 Request processed in 2599us (3044us total) trans 30064771559 rc 0/0 00000100:00100000:3.0:1788391269.790721:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 549 00010000:00010000:2.0:1788391269.792995:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793013:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793021:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793027:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391269.793032:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793039:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793055:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d68641e200) 00010000:00010000:2.0:1788391269.793058:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391269.793062:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391269.793068:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38ab5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391269.794263:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391269.794589:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094323072 00000100:00100000:1.0:1788391269.794599:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094323072 00000100:00100000:1.0:1788391269.794701:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:1.0:1788391269.794712:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:42513:x1875263094323072:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391269.795127:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42513:x1875263094323072:12345-192.168.202.1@tcp:35:dd.500 Request processed in 415us (869us total) trans 30064771560 rc 0/0 00000100:00100000:1.0:1788391269.795135:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1788391269.856761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391269.863035:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094323328 00000100:00100000:1.0:1788391269.863051:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094323328 00000100:00100000:1.0:1788391269.863117:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 550 00000100:00100000:1.0:1788391269.863129:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42523:x1875263094323328:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391269.863156:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391269.863176:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006a0 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391269.864117:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:1.0:1788391269.865929:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38aca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006a0 expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.865953:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:1.0:1788391269.865956:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788391269.866004:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006a0 expref: 62 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.866022:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c400, rc 0) 00000100:00100000:1.0:1788391269.866103:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42523:x1875263094323328:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 2975us (9350us total) trans 30064771561 rc 301/301 00000100:00100000:1.0:1788391269.866112:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 550 00000100:00100000:2.0:1788391269.869904:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391269.870368:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094323584 00000100:00100000:3.0:1788391269.870378:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094323584 00000100:00100000:3.0:1788391269.870451:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:3.0:1788391269.870461:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42523:x1875263094323584:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391269.871015:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a558450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:42523:x1875263094323584:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 553us (1117us total) trans 30064771562 rc 0/0 00000100:00100000:3.0:1788391269.871024:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1788391269.930357:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391269.930503:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094323840 00000100:00100000:0.0:1788391269.930512:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094323840 00000100:00100000:0.0:1788391269.930579:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 551 00000100:00100000:0.0:1788391269.930591:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:42529:x1875263094323840:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:0.0:1788391269.930618:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391269.930640:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38ad8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006a7 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.930738:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38adf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.930752:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.930765:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391269.930775:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:0.0:1788391269.930914:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38ad8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006a7 expref: 65 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.930933:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38adf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006a7 expref: 64 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.931005:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391269.931008:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391269.931013:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9200, rc 0) 00000100:00100000:0.0:1788391269.931083:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42529:x1875263094323840:12345-192.168.202.1@tcp:101:dd.500 Request processed in 495us (745us total) trans 30064771563 rc 0/0 00000100:00100000:0.0:1788391269.931090:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 551 00000100:00100000:0.0:1788391269.936222:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391269.936324:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094324096 00000100:00100000:1.0:1788391269.936335:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094324096 00000100:00100000:1.0:1788391269.936400:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1788391269.936410:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42529:x1875263094324096:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:1.0:1788391269.936811:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:42529:x1875263094324096:12345-192.168.202.1@tcp:35:dd.500 Request processed in 240us (438us total) trans 30064771564 rc 0/0 00000100:00100000:1.0:1788391269.936821:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1788391269.986154:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391269.986694:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094324352 00000100:00100000:0.0:1788391269.986834:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094324352 00000100:00100000:0.0:1788391269.986946:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 552 00000100:00100000:0.0:1788391269.986957:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:42535:x1875263094324352:12345-192.168.202.1@tcp:36:truncate.500 00010000:00010000:0.0:1788391269.987049:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391269.987075:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38adf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006a7 expref: 65 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.987094:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391269.987099:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391269.987311:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.987324:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391269.987333:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391269.987384:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771565 00000004:00010000:0.0:1788391269.987428:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb4995d0 reply state 00000000f5507f01 transno 30064771566 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391269.987449:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391269.987611:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:42535:x1875263094324352:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 655us (1464us total) trans 30064771566 rc 0/0 00000100:00100000:0.0:1788391269.987618:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 552 00000020:00080000:0.0:1788391269.987623:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391269.991075:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991093:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991100:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991106:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391269.991110:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991118:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991147:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391269.991150:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391269.991155:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391269.991160:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38aed lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.051915:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.052034:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094324480 00000100:00100000:0.0:1788391270.052044:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094324480 00000100:00100000:0.0:1788391270.052107:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 553 00000100:00100000:0.0:1788391270.052119:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:42541:x1875263094324480:12345-192.168.202.1@tcp:101:truncate.500 00010000:00010000:0.0:1788391270.052144:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391270.052166:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38af4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006ae expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052234:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052248:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052259:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052275:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052282:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052305:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052398:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052406:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052412:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391270.052440:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 256 00000004:00200000:0.0:1788391270.052444:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391270.052462:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052474:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052483:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052490:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052496:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.052503:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391270.052507:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053617:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053634:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:0.0:1788391270.053637:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391270.053642:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053648:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38afb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053663:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053669:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053676:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053681:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391270.053685:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053691:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053698:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d6a704c600) 00010000:00010000:0.0:1788391270.053701:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391270.053703:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053716:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b02 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053760:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38af4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ae expref: 68 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053775:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ae expref: 67 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.053782:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391270.053784:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391270.053787:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8c00, rc 0) 00000100:00100000:0.0:1788391270.053914:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:42541:x1875263094324480:12345-192.168.202.1@tcp:101:truncate.500 Request processed in 1796us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.053923:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 553 00000100:00100000:2.0:1788391270.062761:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.062950:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094324736 00000100:00100000:1.0:1788391270.062990:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094324736 00000100:00100000:1.0:1788391270.063122:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 554 00000100:00100000:1.0:1788391270.063134:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:42541:x1875263094324736:12345-192.168.202.1@tcp:36:truncate.500 00010000:00010000:1.0:1788391270.063191:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391270.063218:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38b09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ae expref: 67 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.063239:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391270.063244:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391270.063461:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.063476:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.063485:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788391270.063533:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771567 00000004:00010000:1.0:1788391270.063574:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b22b3edb reply state 00000000264d6000 transno 30064771568 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.063583:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788391270.063677:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42541:x1875263094324736:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 544us (924us total) trans 30064771568 rc 0/0 00000100:00100000:1.0:1788391270.063685:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 554 00000020:00080000:1.0:1788391270.063690:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391270.065249:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065261:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065266:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065270:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391270.065273:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065278:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065289:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391270.065291:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391270.065294:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.065298:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38b10 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.109676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.109793:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094324992 00000100:00100000:3.0:1788391270.109813:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094324992 00000100:00100000:3.0:1788391270.109874:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 555 00000100:00100000:3.0:1788391270.109885:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:42547:x1875263094324992:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:3.0:1788391270.109910:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391270.109929:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38b17 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006b5 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110110:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110126:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110138:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110153:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110171:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110177:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110356:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38b2c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110365:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38b2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110372:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38b2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391270.110436:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:3.0:1788391270.110604:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110612:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110619:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110624:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391270.110629:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110636:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110659:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391270.110662:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391270.110666:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110671:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38b1e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110684:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110690:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110695:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110700:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391270.110703:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110709:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110716:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d68641e600) 00010000:00010000:3.0:1788391270.110719:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788391270.110721:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110726:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38b25 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110780:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38b17 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006b5 expref: 71 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110812:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38b2c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006b5 expref: 70 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.110820:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:3.0:1788391270.110822:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788391270.110825:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fba00, rc 0) 00000100:00100000:3.0:1788391270.110933:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42547:x1875263094324992:12345-192.168.202.1@tcp:101:dd.500 Request processed in 1050us (1266us total) trans 30064771569 rc 0/0 00000100:00100000:3.0:1788391270.110941:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 555 00000100:00100000:2.0:1788391270.116073:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.116115:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.116230:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094325376 00000100:00100000:1.0:1788391270.116242:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094325376 00000100:00100000:1.0:1788391270.116315:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1788391270.116327:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:2357:x1875263094325376:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391270.116344:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391270.116369:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38b2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006b5 expref: 70 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.116394:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391270.116398:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391270.116454:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:2357:x1875263094325376:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 129us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391270.116461:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1788391270.116534:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094325248 00000100:00100000:0.0:1788391270.116538:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094325248 00000100:00100000:0.0:1788391270.116571:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 556 00000100:00100000:0.0:1788391270.116578:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42547:x1875263094325248:12345-192.168.202.1@tcp:36:dd.500 00010000:00010000:0.0:1788391270.116834:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.116849:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.116860:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391270.116924:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771570 00000004:00010000:0.0:1788391270.116950:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d1543c2 reply state 0000000093d4b946 transno 30064771571 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.116978:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391270.117044:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42547:x1875263094325248:12345-192.168.202.1@tcp:36:dd.500 Request processed in 466us (980us total) trans 30064771571 rc 0/0 00000100:00100000:0.0:1788391270.117051:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 556 00000020:00080000:0.0:1788391270.117054:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788391270.122809:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122880:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122888:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122913:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.122918:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122923:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122938:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391270.122939:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.122943:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.122947:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38b3a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.124508:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.124815:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094325632 00000100:00100000:3.0:1788391270.124831:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094325632 00000100:00100000:3.0:1788391270.124893:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788391270.124904:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:42547:x1875263094325632:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:3.0:1788391270.125723:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42547:x1875263094325632:12345-192.168.202.1@tcp:35:dd.500 Request processed in 818us (1218us total) trans 30064771572 rc 0/0 00000100:00100000:3.0:1788391270.125732:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788391270.195847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.195983:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094325888 00000100:00100000:0.0:1788391270.195993:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094325888 00000100:00100000:0.0:1788391270.196089:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 557 00000100:00100000:0.0:1788391270.196101:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42557:x1875263094325888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391270.196124:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391270.196144:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006bc expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391270.196235:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1788391270.196373:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006bc expref: 74 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.196388:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:0.0:1788391270.196391:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391270.196396:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006bc expref: 74 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.196410:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9a00, rc 0) 00000100:00100000:0.0:1788391270.196478:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:42557:x1875263094325888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 380us (642us total) trans 30064771573 rc 301/301 00000100:00100000:0.0:1788391270.196483:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 557 00000100:00100000:2.0:1788391270.198580:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.198696:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094326144 00000100:00100000:1.0:1788391270.198714:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094326144 00000100:00100000:1.0:1788391270.198766:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:1.0:1788391270.198776:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:42557:x1875263094326144:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1788391270.199129:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:42557:x1875263094326144:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 355us (557us total) trans 30064771574 rc 0/0 00000100:00100000:1.0:1788391270.199135:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:2.0:1788391270.250068:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.250124:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094326272 00000100:00100000:0.0:1788391270.250133:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094326272 00000100:00100000:0.0:1788391270.250242:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 558 00000100:00100000:0.0:1788391270.250254:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:42563:x1875263094326272:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:0.0:1788391270.250277:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391270.250296:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006c3 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250364:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250378:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250389:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391270.250418:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:0.0:1788391270.250422:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391270.250438:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250461:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006c3 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250477:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006c3 expref: 75 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.250502:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:0.0:1788391270.250504:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391270.250507:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9000, rc 0) 00000100:00100000:0.0:1788391270.250561:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094326272:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 310us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.250568:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 558 00000100:00100000:3.0:1788391270.254112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.255006:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094326400 00000100:00100000:2.0:1788391270.255015:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094326400 00000100:00100000:2.0:1788391270.255066:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 559 00000100:00100000:2.0:1788391270.255075:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094326400:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391270.255090:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391270.255105:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38b5d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006ca expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255355:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255365:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255373:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391270.255406:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:2.0:1788391270.255410:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391270.255428:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255439:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255462:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38b5d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ca expref: 77 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255480:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ca expref: 76 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.255488:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:2.0:1788391270.255491:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391270.255495:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391270.255558:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:42563:x1875263094326400:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 483us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.255565:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 559 00000100:00100000:2.0:1788391270.258502:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.258581:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094326656 00000100:00100000:1.0:1788391270.258590:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094326656 00000100:00100000:1.0:1788391270.258638:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 560 00000100:00100000:1.0:1788391270.258661:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:42563:x1875263094326656:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:1.0:1788391270.258678:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391270.258701:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b6b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006d1 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.258790:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38b72 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.258812:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38b72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.258823:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38b72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391270.258834:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:1.0:1788391270.258957:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b6b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d1 expref: 79 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.259002:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38b72 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d1 expref: 78 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.259011:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:1.0:1788391270.259013:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391270.259017:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16ca00, rc 0) 00000100:00100000:1.0:1788391270.259074:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:42563:x1875263094326656:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 427us (578us total) trans 30064771575 rc 0/0 00000100:00100000:1.0:1788391270.259081:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 560 00000100:00100000:1.0:1788391270.264187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.264278:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094326912 00000100:00100000:0.0:1788391270.264287:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094326912 00000100:00100000:0.0:1788391270.264352:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1788391270.264362:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:42563:x1875263094326912:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:0.0:1788391270.264376:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788391270.264400:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ca00/0x9aafc5f04cd38b72 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d1 expref: 78 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.264419:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38b64 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ca expref: 77 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.264432:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38abc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00699 expref: 76 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.264443:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d68641e300) 00010000:00010000:0.0:1788391270.264454:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391270.264507:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094326912:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.264514:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1788391270.266612:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.266746:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327040 00000100:00100000:2.0:1788391270.266755:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327040 00000100:00100000:2.0:1788391270.266826:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 561 00000100:00100000:2.0:1788391270.266837:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094327040:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:2.0:1788391270.266936:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.266950:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.266981:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391270.267301:0:42646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].12, 136 off9824 00000100:00100000:2.0:1788391270.267380:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094327040:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 545us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.267386:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 561 00000100:00100000:2.0:1788391270.269324:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.269366:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327168 00000100:00100000:0.0:1788391270.269375:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327168 00000100:00100000:0.0:1788391270.269438:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 562 00000100:00100000:0.0:1788391270.269448:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+75:42563:x1875263094327168:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391270.269465:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391270.269483:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006d8 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269550:0:43348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269561:0:43348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269580:0:43348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269593:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269603:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:0.0:1788391270.269606:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788391270.269609:0:43348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 76 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.269617:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9a00, rc 0) 00000100:00100000:0.0:1788391270.269665:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:42563:x1875263094327168:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 219us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.269671:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 562 00010000:00010000:2.0:1788391270.349111:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788391270.390152:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771573 is committed 00000020:00080000:2.0:1788391270.390195:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803914 batchid updated 00000001:00080000:2.0:1788391270.390211:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771575 is committed 00000020:00080000:2.0:1788391270.390248:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000020:00080000:2.0:1788391270.390260:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000001:00080000:3.0:1788391270.401338:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771221 is committed 00000040:00080000:0.0:1788391270.413279:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391270.413290:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391270.413348:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 13 count 5 00000040:00080000:0.0:1788391270.413355:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391270.413488:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103500416:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391270.413597:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b511b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788391270.417506:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103500416:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391270.421090:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.421410:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327296 00000100:00100000:2.0:1788391270.421421:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327296 00000100:00100000:2.0:1788391270.421477:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 563 00000100:00100000:2.0:1788391270.421488:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42564:x1875263094327296:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788391270.421520:0:42646:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788391270.421622:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42564:x1875263094327296:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 135us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.421630:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 563 00000100:00100000:2.0:1788391270.425691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.426162:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327424 00000100:00100000:1.0:1788391270.426171:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327424 00000100:00100000:1.0:1788391270.426234:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 564 00000100:00100000:1.0:1788391270.426244:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42564:x1875263094327424:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788391270.426328:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426345:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426357:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426443:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426452:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426460:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426483:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426492:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426499:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391270.426539:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:1.0:1788391270.426544:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391270.426558:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426568:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426581:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426588:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426594:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16d600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.426598:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426606:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426619:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:1.0:1788391270.426622:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.426627:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426633:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d600/0x9aafc5f04cd38b8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426646:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426652:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426657:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426662:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.426671:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426677:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426685:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x898fe5e1 (ffff95d692d30000) 00010000:00010000:1.0:1788391270.426687:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.426690:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426695:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38b95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426924:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426931:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426936:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.426941:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.427132:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.427140:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.427148:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391270.427150:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.427160:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.427166:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38b9c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.427244:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42564:x1875263094327424:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1000us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391270.427253:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 564 00000100:00100000:1.0:1788391270.431432:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.431513:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327680 00000100:00100000:0.0:1788391270.431522:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327680 00000100:00100000:0.0:1788391270.431585:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 565 00000100:00100000:0.0:1788391270.431595:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+55:42564:x1875263094327680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788391270.431615:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391270.431634:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd38ba3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006df expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.431728:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.431742:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.431752:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391270.431763:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:0.0:1788391270.431921:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.431929:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432035:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432042:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391270.432046:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432052:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432063:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:0.0:1788391270.432065:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788391270.432070:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432075:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8200/0x9aafc5f04cd38baa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432115:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd38ba3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006df expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432125:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95d6830d2100) 00010000:00010000:0.0:1788391270.432127:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788391270.432130:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8400/0x9aafc5f04cd38ba3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006df expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.432140:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8400, rc 0) 00000100:00100000:0.0:1788391270.432287:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094327680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 692us (862us total) trans 30064771576 rc 301/301 00000100:00100000:0.0:1788391270.432304:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 565 00000100:00100000:0.0:1788391270.437456:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.437559:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094327808 00000100:00100000:3.0:1788391270.437582:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094327808 00000100:00100000:3.0:1788391270.437682:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 566 00000100:00100000:3.0:1788391270.437693:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094327808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788391270.437737:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788391270.437855:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094327808:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 164us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.437864:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 566 00000100:00100000:0.0:1788391270.440690:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.440836:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328064 00000100:00100000:2.0:1788391270.440846:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328064 00000100:00100000:2.0:1788391270.440898:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 567 00000100:00100000:2.0:1788391270.440908:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094328064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391270.440926:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391270.440929:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788391270.440954:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9000/0x9aafc5f04cd38b56 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006c3 expref: 56 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.441164:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788391270.441168:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391270.441183:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38bb8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006e6 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788391270.441990:0:42646:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcf:0x0], index 1: 0 00010000:00010000:2.0:1788391270.442245:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38bbf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.442258:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38bbf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.442269:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38bbf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.442320:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38bb8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006e6 expref: 58 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.442336:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38bbf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006e6 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.442344:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfef00) 00010000:00010000:2.0:1788391270.442347:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391270.442349:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391270.442408:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094328064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1501us (1727us total) trans 30064771577 rc 0/0 00000100:00100000:2.0:1788391270.442416:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 567 00000100:00100000:2.0:1788391270.445279:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.445376:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328320 00000100:00100000:1.0:1788391270.445385:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328320 00000100:00100000:1.0:1788391270.445438:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 568 00000100:00100000:1.0:1788391270.445446:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094328320:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788391270.445493:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391270.445513:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38bbf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006e6 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445526:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfef00) 00010000:00010000:1.0:1788391270.445534:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788391270.445549:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445558:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445564:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445616:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445632:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445636:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445819:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445827:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445832:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445836:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16cc00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.445839:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445843:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445849:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:1.0:1788391270.445851:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.445854:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445859:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16cc00/0x9aafc5f04cd38bcd lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445868:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445879:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445885:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445890:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c000 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.445893:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445900:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445908:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x2830925b (ffff95d692d30000) 00010000:00010000:1.0:1788391270.445910:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.445912:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.445915:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c000/0x9aafc5f04cd38bd4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x2830925b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.446189:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094328320:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 742us (915us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788391270.446194:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 568 00000100:00100000:0.0:1788391270.448111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.448183:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328448 00000100:00100000:2.0:1788391270.448190:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328448 00000100:00100000:2.0:1788391270.448255:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 569 00000100:00100000:2.0:1788391270.448263:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094328448:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391270.448277:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391270.448293:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38bdb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006ed expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448316:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448326:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448336:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448426:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38bdb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 58 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448442:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.448450:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:2.0:1788391270.448452:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391270.448454:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177600, rc 0) 00000100:00100000:2.0:1788391270.448502:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094328448:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 240us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.448510:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 569 00000100:00100000:0.0:1788391270.450407:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.450484:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328704 00000100:00100000:3.0:1788391270.450491:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328704 00000100:00100000:3.0:1788391270.450549:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 570 00000100:00100000:3.0:1788391270.450556:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094328704:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.450619:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.450632:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.450643:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391270.451421:0:43348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].19, 88 off9720 00000004:00080000:2.0:1788391270.451430:0:43348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1087558468748ns, next at 1088558467246ns, rc = 0 00000004:00010000:2.0:1788391270.451498:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000525ad693 reply state 000000004dc1d157 transno 30064771578 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.451505:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391270.451622:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:42564:x1875263094328704:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1065us (1219us total) trans 30064771578 rc 0/0 00000100:00100000:2.0:1788391270.451630:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 570 00010000:00010000:2.0:1788391270.453395:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453409:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453417:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453422:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fa400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391270.453426:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453434:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453449:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:2.0:1788391270.453452:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391270.453456:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.453463:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38be9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.453763:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.453854:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328832 00000100:00100000:3.0:1788391270.453863:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328832 00000100:00100000:3.0:1788391270.453915:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 571 00000100:00100000:3.0:1788391270.453924:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:42564:x1875263094328832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.453944:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391270.454057:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006f4 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.454128:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.454141:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 59 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.454158:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:3.0:1788391270.454161:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788391270.454164:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbc00, rc 0) 00000100:00100000:3.0:1788391270.454214:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:42564:x1875263094328832:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 291us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.454221:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 571 00000100:00100000:1.0:1788391270.457130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.457289:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094328960 00000100:00100000:3.0:1788391270.457300:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094328960 00000100:00100000:3.0:1788391270.457405:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1788391270.457415:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094328960:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788391270.461045:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094328960:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 3620us (3913us total) trans 30064771284 rc 0/0 00000100:00100000:3.0:1788391270.461059:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00080000:2.0:1788391270.464127:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391270.464580:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.464666:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094329216 00000100:00100000:3.0:1788391270.464676:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094329216 00000100:00100000:3.0:1788391270.464785:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:3.0:1788391270.464808:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+59:42564:x1875263094329216:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788391270.465075:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42564:x1875263094329216:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 279us (500us total) trans 30064771579 rc 0/0 00000100:00100000:3.0:1788391270.465100:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1788391270.467012:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.467112:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094329472 00000100:00100000:3.0:1788391270.467121:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094329472 00000100:00100000:3.0:1788391270.467170:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 572 00000100:00100000:3.0:1788391270.467180:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42564:x1875263094329472:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788391270.467284:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42564:x1875263094329472:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.467291:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 572 00000100:00100000:1.0:1788391270.470170:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.470220:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094329600 00000100:00100000:3.0:1788391270.470230:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094329600 00000100:00100000:3.0:1788391270.470286:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 573 00000100:00100000:3.0:1788391270.470297:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42564:x1875263094329600:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.470316:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391270.470336:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38bf7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc006fb expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470406:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470417:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470424:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391270.470453:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788391270.470466:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470499:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38bf7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006fb expref: 62 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470510:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006fb expref: 61 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.470515:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:3.0:1788391270.470517:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788391270.470520:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391270.470562:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42564:x1875263094329600:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 269us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.470567:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 573 00000100:00100000:2.0:1788391270.472444:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.472491:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094329728 00000100:00100000:3.0:1788391270.472501:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094329728 00000100:00100000:3.0:1788391270.472549:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788391270.472559:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094329728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.472575:0:43328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391270.472593:0:43328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00702 expref: -99 pid: 43328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788391270.472618:0:43328:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98af66, blocks: 0x1 00010000:00010000:3.0:1788391270.472636:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=1087s v=(0 0) 00010000:00010000:3.0:1788391270.472641:0:43328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788391270.472661:0:43328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 15 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.472710:0:43328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 15 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.472723:0:43328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:3.0:1788391270.472783:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094329728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 222us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.472791:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1788391270.474596:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.474678:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094329984 00000100:00100000:2.0:1788391270.474687:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094329984 00000100:00100000:2.0:1788391270.474743:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 574 00000100:00100000:2.0:1788391270.474753:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42564:x1875263094329984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788391270.474875:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42564:x1875263094329984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 123us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.474883:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 574 00000100:00100000:1.0:1788391270.477073:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.477143:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330112 00000100:00100000:2.0:1788391270.477151:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330112 00000100:00100000:2.0:1788391270.477212:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1788391270.477222:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:42564:x1875263094330112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788391270.477238:0:44885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391270.477256:0:44885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00709 expref: -99 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.477285:0:44885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.477294:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391270.477299:0:44885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391270.477305:0:44885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.477339:0:44885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.477354:0:44885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 1187 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.477367:0:44885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103500544:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391270.477442:0:44885:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391270.480469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.480618:0:44885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:44885:1875263103500544:192.168.202.1@tcp:104: 00010000:00010000:2.0:1788391270.480652:0:44885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.480671:0:44885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176a00, rc 0) 00000100:00100000:2.0:1788391270.480731:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:42564:x1875263094330112:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3510us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.480740:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1788391270.481204:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330240 00000100:00100000:3.0:1788391270.481212:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330240 00010000:00010000:2.0:1788391270.481627:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 1187 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.481722:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:2.0:1788391270.481732:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2356:x1875263094330240:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391270.481747:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391270.481779:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 1187 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.481801:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 1187 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.481823:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca611cc9/0x9aafc5f04cd38c05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00702 expref: 16 pid: 43328 timeout: 1187 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.481838:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391270.481842:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391270.481849:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.481860:0:45446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.481897:0:45446:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.481911:0:45446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45446:1875263103500672:192.168.202.1@tcp:105: 00000100:00100000:2.0:1788391270.482030:0:45446:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6b326ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391270.485469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.485569:0:43333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330368 00000100:00100000:1.0:1788391270.485579:0:43333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330368 00002000:00100000:1.0:1788391270.485627:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcf:0x0] (0->1023) req@ffff95d5853d6300 x1875263094330368/t0(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:131/0 lens 1512/0 e 0 to 0 dl 1788391281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391270.485638:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d6300 with x1875263094330368 ext(0->1023) 00002000:00010000:1.0:1788391270.485643:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d6300 00000100:00100000:1.0:1788391270.485676:0:43333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:1.0:1788391270.485686:0:43333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094330368:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788391270.486192:0:43333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+18:2357:x1875263094330368:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 505us (730us total) trans 30064771285 rc 0/0 00000100:00100000:1.0:1788391270.486200:0:43333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 364 00002000:00100000:1.0:1788391270.486207:0:43333:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcf:0x0] (0->1023) req@ffff95d5853d6300 x1875263094330368/t30064771285(0) o4->a67cef5d-639a-4d25-af65-3d93a762bd9f@192.168.202.1@tcp:131/0 lens 1512/448 e 0 to 0 dl 1788391281 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788391270.486215:0:43333:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95d5853d6300 with x1875263094330368 ext(0->1023) 00002000:00010000:1.0:1788391270.486219:0:43333:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95d5853d6300 00000100:00100000:0.0:1788391270.486489:0:45446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:45446:1875263103500672:192.168.202.1@tcp:105: 00010000:00010000:0.0:1788391270.486510:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391270.486547:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094330240:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 4817us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.486556:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:3.0:1788391270.488567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.488623:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330496 00000100:00100000:2.0:1788391270.488632:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330496 00000100:00100000:2.0:1788391270.488725:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 575 00000100:00100000:2.0:1788391270.488736:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42564:x1875263094330496:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788391270.510376:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771576 is committed 00000001:00080000:3.0:1788391270.510393:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771578 is committed 00000004:00080000:3.0:1788391270.510398:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000001:00080000:3.0:1788391270.510419:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771579 is committed 00000100:00100000:0.0:1788391270.510581:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391270.510602:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103500800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788391270.510689:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391270.510747:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103500800 00000100:00100000:0.0:1788391270.510755:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103500800 00000100:00100000:0.0:1788391270.510818:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788391270.510829:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103500800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788391270.511003:0:43698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788391270.511006:0:43698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1788391270 00002000:00010000:0.0:1788391270.511009:0:43698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788391270.511011:0:43698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1788391270 -> 1788391270 00002000:00010000:0.0:1788391270.511013:0:43698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788391270.511054:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1875263103500800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (364us total) trans 30064771286 rc 0/0 00000100:00100000:0.0:1788391270.511068:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:0.0:1788391270.511107:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d5853d5880/2, rc 0, transno 30064771286 00000100:00100000:0.0:1788391270.511113:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103500800:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788391270.511395:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391270.511564:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094330496:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 22826us (22999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391270.511573:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 575 00000100:00100000:2.0:1788391270.516272:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.516345:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330624 00000100:00100000:3.0:1788391270.516354:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330624 00000100:00100000:3.0:1788391270.516412:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1788391270.516420:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094330624:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788391270.548848:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+17:2356:x1875263094330624:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 32418us (32574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.548861:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000001:00080000:3.0:1788391270.548897:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771286 is committed 00000001:00080000:3.0:1788391270.548909:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771285 is committed 00000100:00100000:3.0:1788391270.553627:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.553722:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094330880 00000100:00100000:2.0:1788391270.553732:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094330880 00000100:00100000:2.0:1788391270.553805:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 576 00000100:00100000:2.0:1788391270.553816:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094330880:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788391270.553868:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391270.553896:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38bfe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006fb expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.553915:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:2.0:1788391270.553920:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391270.553949:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.554134:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.554145:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391270.554305:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2c0d7fa reply state 00000000ccf6d1ed transno 30064771580 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.554320:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391270.554459:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:42564:x1875263094330880:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 644us (841us total) trans 30064771580 rc 0/0 00000100:00100000:2.0:1788391270.554466:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 576 00000100:00100000:2.0:1788391270.558447:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.558519:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331008 00000100:00100000:3.0:1788391270.558545:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331008 00000100:00100000:3.0:1788391270.558645:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:3.0:1788391270.558657:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094331008:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788391270.558914:0:44885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1788391270.558919:0:44885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 1788391270 -> 1788391270 00002000:00010000:3.0:1788391270.558921:0:44885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1788391270 00002000:00010000:3.0:1788391270.558924:0:44885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1788391270 -> 1788391270 00002000:00010000:3.0:1788391270.558926:0:44885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788391270.559160:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094331008:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 504us (720us total) trans 30064771287 rc 0/0 00000100:00100000:3.0:1788391270.559168:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00010000:00010000:1.0:1788391270.559464:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559475:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559482:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559502:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.559507:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559514:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559530:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:1.0:1788391270.559533:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.559539:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.559545:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38c13 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.565360:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.565549:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331264 00000100:00100000:3.0:1788391270.565558:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331264 00000100:00100000:3.0:1788391270.565647:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 577 00000100:00100000:3.0:1788391270.565658:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:42564:x1875263094331264:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.565727:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.565744:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.565754:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.565811:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 57 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.565826:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 57 pid: 42644 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.565856:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103500928:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391270.565942:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:3.0:1788391270.568153:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103500928:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391270.568286:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.568395:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.568534:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331392 00000100:00100000:1.0:1788391270.568540:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331392 00010000:00010000:1.0:1788391270.568576:0:45855:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 58 pid: 42644 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.568647:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:1.0:1788391270.568658:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2356:x1875263094331392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391270.568671:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391270.568677:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 58 pid: 42644 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568688:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 58 pid: 42644 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568725:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38be2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x39:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006ed expref: 58 pid: 42644 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568742:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:1.0:1788391270.568746:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568753:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568760:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.568788:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391270.568846:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2356:x1875263094331392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391270.568853:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00010000:00010000:3.0:1788391270.569069:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569077:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569105:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569112:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569118:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569123:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:3.0:1788391270.569127:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569134:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569144:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:3.0:1788391270.569153:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788391270.569158:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.569163:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c1a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.569222:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094331264:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 3566us (3880us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788391270.569231:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 577 00000100:00100000:0.0:1788391270.571250:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.571348:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331520 00000100:00100000:2.0:1788391270.571358:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331520 00000100:00100000:2.0:1788391270.571444:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:2.0:1788391270.571454:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2358:x1875263094331520:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788391270.571497:0:43326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.571517:0:43326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.571525:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391270.571529:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788391270.571534:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.571566:0:43326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.571580:0:43326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 15 pid: 44885 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.571594:0:43326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103501056:192.168.202.1@tcp:104: 00000100:00100000:2.0:1788391270.571693:0:43326:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6bc24c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788391270.574393:0:43326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:43326:1875263103501056:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391270.574424:0:43326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.576432:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.576511:0:42629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331648 00000100:00100000:1.0:1788391270.576520:0:42629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331648 00010000:00010000:1.0:1788391270.576564:0:42629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.576605:0:42629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:1.0:1788391270.576616:0:42629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+16:2357:x1875263094331648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391270.576630:0:42629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391270.576653:0:42629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.576686:0:42629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.576719:0:42629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebfecc28/0x9aafc5f04cd38c0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00709 expref: 16 pid: 44885 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.576736:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391270.576741:0:42629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788391270.576748:0:42629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.576757:0:42629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.576803:0:42629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391270.576856:0:42629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2357:x1875263094331648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391270.576864:0:42629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00010000:00010000:2.0:1788391270.577031:0:43326:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577042:0:43326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577068:0:43326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577075:0:43326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577083:0:43326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577090:0:43326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176c00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:2.0:1788391270.577094:0:43326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577101:0:43326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577113:0:43326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.577121:0:43326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000295252e3/0x9aafc5f04cd38c21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.577168:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2358:x1875263094331520:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5716us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.577178:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:2.0:1788391270.581211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.581292:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094331904 00000100:00100000:3.0:1788391270.581303:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094331904 00000100:00100000:3.0:1788391270.581358:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 578 00000100:00100000:3.0:1788391270.581368:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:42564:x1875263094331904:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788391270.581441:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581457:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581469:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581681:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581693:0:42645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581700:0:42645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581749:0:42645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 57 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.581762:0:42645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 57 pid: 42646 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.581787:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103501184:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391270.581954:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d692228840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391270.584512:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103501184:192.168.202.1@tcp:104: 00010000:00010000:1.0:1788391270.584542:0:42645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391270.585392:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391270.585478:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094332032 00000100:00100000:0.0:1788391270.585486:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094332032 00010000:00010000:0.0:1788391270.585526:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 58 pid: 42646 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391270.585564:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:0.0:1788391270.585574:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bcb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+58:2356:x1875263094332032:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391270.585587:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391270.585594:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 58 pid: 42646 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585616:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 58 pid: 42646 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585637:0:45446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbc00/0x9aafc5f04cd38bf0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006f4 expref: 58 pid: 42646 timeout: 1187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585667:0:45446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:0.0:1788391270.585672:0:45446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585681:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585689:0:45446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391270.585717:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391270.585779:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bcb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+57:2356:x1875263094332032:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 206us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.585786:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00010000:00010000:3.0:1788391270.585928:0:42645:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391270.585937:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391270.586216:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771581 00000001:00080000:2.0:1788391270.586367:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771582 00000001:00080000:2.0:1788391270.586412:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771583 00000100:00100000:2.0:1788391270.586489:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103501312:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391270.586537:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391270.586573:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788391270.586689:0:42650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103501312 00000100:00100000:3.0:1788391270.586695:0:42650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103501312 00000100:00100000:3.0:1788391270.586926:0:42650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788391270.586936:0:42650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103501312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788391270.587060:0:42650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103501312:12345-0@lo:1000:mdt00_001.0 Request processed in 127us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.587067:0:42650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788391270.587125:0:42645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771286 gen 2 00000004:00080000:2.0:1788391270.587132:0:42645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d5853d5880, transno 30064771286 00000100:00100000:2.0:1788391270.587152:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103501312:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788391270.587589:0:42645:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771584 00000100:00100000:2.0:1788391270.588317:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103501440:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788391270.588372:0:42645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391270.588400:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d6a69f7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788391270.588420:0:42649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103501440 00000100:00100000:0.0:1788391270.588427:0:42649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103501440 00000100:00100000:0.0:1788391270.588471:0:42649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788391270.588481:0:42649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42645:x1875263103501440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788391270.589042:0:42649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:42645:x1875263103501440:12345-0@lo:1000:mdt00_001.0 Request processed in 561us (667us total) trans 30064771288 rc 0/0 00000100:00100000:0.0:1788391270.589051:0:42649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788391270.589108:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:42645:1875263103501440:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788391270.589143:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589166:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589173:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589180:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fba00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.589183:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589190:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589206:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe100) 00010000:00010000:1.0:1788391270.589208:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391270.589213:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589219:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fba00/0x9aafc5f04cd38c2f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589252:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589259:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589265:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589270:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.589279:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589286:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589295:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391270.589297:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788391270.589304:0:42645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 60 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589315:0:42645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 60 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589323:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 60 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.589351:0:42645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 60 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.589363:0:42645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103501568:192.168.202.1@tcp:105: 00000100:00100000:1.0:1788391270.589432:0:42645:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68673f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788391270.593069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.593094:0:42645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:42645:1875263103501568:192.168.202.1@tcp:105: 00010000:00010000:1.0:1788391270.593131:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593143:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38b80 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.593179:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094332160 00000100:00100000:3.0:1788391270.593187:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094332160 00010000:00010000:1.0:1788391270.593196:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593211:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593223:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593233:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593245:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593252:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593258:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16c400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.593262:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593270:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593283:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391270.593287:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391270.593290:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.593293:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00010000:00010000:1.0:1788391270.593302:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c400/0x9aafc5f04cd38c36 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391270.593308:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42563:x1875263094332160:12345-192.168.202.1@tcp:49:lfs.0 00010000:00010000:1.0:1788391270.593328:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593335:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593341:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593346:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fb400 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391270.593349:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593355:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593363:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391270.593366:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788391270.593368:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.593374:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fb400/0x9aafc5f04cd38c28 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391270.593596:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+61:42564:x1875263094331904:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 12227us (12392us total) trans 30064771585 rc 0/0 00000100:00100000:1.0:1788391270.593605:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 578 00000020:00080000:1.0:1788391270.593610:0:42645:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788391270.593658:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42563:x1875263094332160:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 353us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391270.593674:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000040:00080000:0.0:1788391270.593899:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391270.593905:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391270.594558:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:0.0:1788391270.594567:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391270.596460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391270.596958:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094332416 00000100:00100000:1.0:1788391270.596993:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094332416 00000100:00100000:0.0:1788391270.597207:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 579 00000100:00100000:0.0:1788391270.597223:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42563:x1875263094332416:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:0.0:1788391270.597580:0:42644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].13, 136 off9960 00000100:00100000:0.0:1788391270.597662:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42563:x1875263094332416:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 445us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391270.597670:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 579 00000100:00100000:2.0:1788391270.598335:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.598385:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094332672 00000100:00100000:3.0:1788391270.598391:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094332672 00000100:00100000:3.0:1788391270.598430:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1788391270.598438:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+60:42564:x1875263094332672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788391270.599491:0:42647:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788391270.599601:0:42647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771586 00010000:00010000:2.0:1788391270.599662:0:42647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599678:0:42647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599690:0:42647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599720:0:42647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599728:0:42647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599734:0:42647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.599759:0:42647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391270.599781:0:42633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391270.599788:0:42633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.599832:0:42633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391270.599837:0:42633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.599845:0:42633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.599858:0:42633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x39:0x0].0x0 (ffff95d691bfe700) 00010000:00010000:1.0:1788391270.599861:0:42633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391270.599865:0:42633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.599871:0:42633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c3d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391270.599889:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391270.599891:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391270.599893:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391270.600018:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:42564:x1875263094332672:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 1576us (1681us total) trans 30064771587 rc 0/0 00000100:00100000:2.0:1788391270.600028:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000020:00080000:2.0:1788391270.600034:0:42647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391270.601599:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391270.601694:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094332928 00000100:00100000:3.0:1788391270.601701:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094332928 00000100:00100000:3.0:1788391270.601743:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:3.0:1788391270.601750:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+62:42563:x1875263094332928:12345-192.168.202.1@tcp:35:lfs.500 00000100:00100000:3.0:1788391270.601990:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:42563:x1875263094332928:12345-192.168.202.1@tcp:35:lfs.500 Request processed in 239us (395us total) trans 30064771588 rc 0/0 00000100:00100000:3.0:1788391270.601996:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788391270.631345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391270.631404:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094333056 00000100:00100000:2.0:1788391270.631413:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094333056 00000100:00100000:2.0:1788391270.631475:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 580 00000100:00100000:2.0:1788391270.631486:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+63:42566:x1875263094333056:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391270.631511:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391270.631526:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c44 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00710 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631575:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631585:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631593:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631603:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631608:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631611:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631850:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631859:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631864:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391270.631898:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00000004:00200000:2.0:1788391270.631902:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391270.631916:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631925:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631930:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631934:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631941:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631945:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391270.631948:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631952:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631985:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:2.0:1788391270.631989:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391270.631994:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.631999:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38c4b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632012:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632018:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632024:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632029:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177600 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391270.632032:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632041:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632047:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d691bfef00) 00010000:00010000:2.0:1788391270.632049:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391270.632050:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632054:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c52 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632077:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c44 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00710 expref: 65 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632086:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00710 expref: 64 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391270.632091:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:2.0:1788391270.632092:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391270.632094:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176200, rc 0) 00000100:00100000:2.0:1788391270.632144:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42566:x1875263094333056:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 661us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391270.632152:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 580 00000040:00080000:2.0:1788391271.125807:0:47589:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391271.125818:0:47589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391271.125885:0:47589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 6 00000040:00080000:2.0:1788391271.125892:0:47589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391271.373260:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788391271.373375:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391271.373957:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103501824:0@lo:400:kworker.0 00000100:00100000:2.0:1788391271.374044:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391271.374106:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391271.374112:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103501952:0@lo:400:kworker.0 00000100:00100000:2.0:1788391271.374138:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391271.374274:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103501824 00000100:00100000:3.0:1788391271.374282:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103501824 00000100:00100000:3.0:1788391271.374336:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788391271.374346:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103501824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.374397:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103501824:12345-0@lo:400:kworker.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391271.374404:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788391271.374435:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103501952 00000100:00100000:3.0:1788391271.374439:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103501952 00000100:00100000:3.0:1788391271.374476:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788391271.374483:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103501952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.374513:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103501952:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391271.374533:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788391271.374548:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391271.374574:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771221 gen 2 00000004:00080000:3.0:1788391271.374579:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d5853d6d80, transno 30064771221 00000100:00100000:3.0:1788391271.374592:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103501952:0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.374602:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103501824:0@lo:400:kworker.0 00000100:00100000:1.0:1788391271.375410:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103502080:0@lo:400:kworker.0 00000100:00100000:1.0:1788391271.375456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391271.375478:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391271.375498:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391271.375534:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103501696 00000100:00100000:1.0:1788391271.375539:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103501696 00000100:00100000:1.0:1788391271.375571:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788391271.375578:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391271.375596:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3709861888 00000100:00100000:1.0:1788391271.375635:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391271.375641:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788391271.375680:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391271.375894:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103502080 00000100:00100000:3.0:1788391271.375899:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103502080 00000100:00100000:3.0:1788391271.375934:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788391271.375941:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103502080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.376006:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103502080:12345-0@lo:400:kworker.0 Request processed in 65us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391271.376012:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788391271.376086:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103502080:0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.376549:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103502208:0@lo:400:kworker.0 00000100:00100000:3.0:1788391271.376602:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391271.376665:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103502208 00000100:00100000:2.0:1788391271.376670:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103502208 00000100:00100000:2.0:1788391271.376712:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788391271.376720:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103502208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.376828:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103502464:0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.376856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391271.376876:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391271.376882:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103502336:0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.376901:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391271.376935:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103502464 00000100:00100000:0.0:1788391271.376939:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103502464 00000100:00100000:0.0:1788391271.376991:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103502336 00000100:00100000:0.0:1788391271.376995:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103502336 00000100:00100000:0.0:1788391271.377017:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788391271.377024:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103502464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.377058:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103502464:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391271.377064:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788391271.377091:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788391271.377098:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103502336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.377126:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103502336:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391271.377132:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788391271.377147:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391271.377190:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103502336:0@lo:400:kworker.0 00000100:00100000:0.0:1788391271.377200:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103502464:0@lo:400:kworker.0 00000100:00100000:2.0:1788391271.377558:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103502208:12345-0@lo:400:kworker.0 Request processed in 838us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391271.377565:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788391271.377622:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103502208:0@lo:400:kworker.0 00000040:00080000:0.0:1788391271.629237:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391271.629245:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391271.629466:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391271.629473:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391271.629600:0:42679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103502592:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788391271.629692:0:42679:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391271.634547:0:42679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:42679:1875263103502592:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788391271.636505:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391271.636570:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094333184 00000100:00100000:0.0:1788391271.636579:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094333184 00000100:00100000:0.0:1788391271.636674:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 581 00000100:00100000:0.0:1788391271.636685:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42578:x1875263094333184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1788391271.636699:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1788391271.636716:0:43348:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788391271.636837:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42578:x1875263094333184:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391271.636845:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 581 00000100:00100000:0.0:1788391271.641571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391271.642106:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094333440 00000100:00100000:1.0:1788391271.642481:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094333440 00000100:00100000:1.0:1788391271.642543:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 582 00000100:00100000:1.0:1788391271.642554:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+64:42578:x1875263094333440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788391271.642575:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391271.642658:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38c60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00717 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.642896:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.642911:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.642923:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391271.642933:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:1.0:1788391271.643084:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38c60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00717 expref: 67 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.643102:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00717 expref: 66 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.643332:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391271.643335:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788391271.643339:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d400, rc 0) 00000100:00100000:1.0:1788391271.643402:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:42578:x1875263094333440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 849us (1841us total) trans 30064771589 rc 0/0 00000100:00100000:1.0:1788391271.643410:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 582 00000100:00100000:2.0:1788391271.650753:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391271.650921:0:45855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094333568 00000100:00100000:1.0:1788391271.650932:0:45855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094333568 00000100:00100000:1.0:1788391271.651030:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1788391271.651041:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:2357:x1875263094333568:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391271.651056:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391271.651081:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00717 expref: 66 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391271.651099:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:1.0:1788391271.651104:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391271.651299:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:2357:x1875263094333568:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 259us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391271.651309:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1788391271.652320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391271.652501:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094333824 00000100:00100000:2.0:1788391271.652509:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094333824 00000100:00100000:2.0:1788391271.652585:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 583 00000100:00100000:2.0:1788391271.652595:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+65:42578:x1875263094333824:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788391271.652672:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652688:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652699:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652873:0:43348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652881:0:43348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652888:0:43348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652893:0:43348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391271.652898:0:43348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652905:0:43348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652916:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:2.0:1788391271.652919:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788391271.652923:0:43348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391271.652929:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38c75 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391271.653087:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:42578:x1875263094333824:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 493us (770us total) trans 30064771590 rc 0/0 00000100:00100000:2.0:1788391271.653095:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 583 00000040:00080000:3.0:1788391271.653335:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391271.653340:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391271.653857:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:3.0:1788391271.653865:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391271.656770:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391271.656827:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094334080 00000100:00100000:2.0:1788391271.656836:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094334080 00000100:00100000:2.0:1788391271.656897:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:2.0:1788391271.656919:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+66:42578:x1875263094334080:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788391271.657545:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:42578:x1875263094334080:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 626us (793us total) trans 30064771591 rc 0/0 00000100:00100000:2.0:1788391271.657553:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:3.0:1788391272.398062:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391272.398090:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391272.398166:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391272.398238:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103502720 00000100:00100000:3.0:1788391272.398247:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103502720 00000100:00100000:3.0:1788391272.398293:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788391272.398303:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103502720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391272.398336:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391272.398381:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103502720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391272.398388:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788391272.398432:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103502720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391272.399018:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391272.705546:0:47640:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391272.705554:0:47640:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391272.705603:0:47640:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391272.705608:0:47640:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391272.771084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391272.771381:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094334336 00000100:00100000:3.0:1788391272.771391:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094334336 00000100:00100000:3.0:1788391272.771450:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 584 00000100:00100000:3.0:1788391272.771462:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+67:42596:x1875263094334336:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1788391272.771484:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391272.771504:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0071e expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391272.771593:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:3.0:1788391272.771720:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38c7c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0071e expref: 69 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.771734:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:3.0:1788391272.771737:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788391272.771741:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0071e expref: 69 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.771768:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fbe00, rc 0) 00000100:00100000:3.0:1788391272.771836:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:42596:x1875263094334336:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 375us (759us total) trans 30064771592 rc 301/301 00000100:00100000:3.0:1788391272.771843:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 584 00000100:00100000:1.0:1788391272.776899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391272.778592:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094334592 00000100:00100000:3.0:1788391272.778603:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094334592 00000100:00100000:3.0:1788391272.778666:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:3.0:1788391272.778992:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+68:42596:x1875263094334592:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391272.779266:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42596:x1875263094334592:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 591us (2376us total) trans 30064771593 rc 0/0 00000100:00100000:3.0:1788391272.779274:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:3.0:1788391272.957496:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391272.958646:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094334720 00000100:00100000:1.0:1788391272.958657:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094334720 00000100:00100000:1.0:1788391272.958770:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 585 00000100:00100000:1.0:1788391272.958790:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42623:x1875263094334720:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1788391272.958814:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391272.958831:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00725 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.958891:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.958905:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.958918:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391272.958949:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788391272.958952:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391272.958985:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.959008:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00725 expref: 71 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.959023:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00725 expref: 70 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.959032:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:1.0:1788391272.959035:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788391272.959038:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d400, rc 0) 00000100:00100000:1.0:1788391272.959100:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42623:x1875263094334720:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 312us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391272.959107:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 585 00000100:00100000:0.0:1788391272.964121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391272.964210:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094334976 00000100:00100000:3.0:1788391272.964218:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094334976 00000100:00100000:3.0:1788391272.964266:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 586 00000100:00100000:3.0:1788391272.964273:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42623:x1875263094334976:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:3.0:1788391272.964329:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788391272.964352:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38a37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00676 expref: 70 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.964368:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfe900) 00010000:00010000:3.0:1788391272.964377:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788391272.964605:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42623:x1875263094334976:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 331us (493us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788391272.964617:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 586 00000100:00100000:3.0:1788391272.979070:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391272.979761:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094335104 00000100:00100000:2.0:1788391272.979780:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094335104 00000100:00100000:2.0:1788391272.979891:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 587 00000100:00100000:2.0:1788391272.979902:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42624:x1875263094335104:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:2.0:1788391272.979922:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391272.979943:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0072c expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980054:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980067:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980078:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391272.980112:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788391272.980115:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391272.980134:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980157:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177600/0x9aafc5f04cd38c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0072c expref: 71 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980176:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176000/0x9aafc5f04cd38c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0072c expref: 70 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.980188:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfef00) 00010000:00010000:2.0:1788391272.980191:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391272.980195:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176000, rc 0) 00000100:00100000:2.0:1788391272.980248:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42624:x1875263094335104:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 348us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391272.980255:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 587 00000100:00100000:0.0:1788391272.984224:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391272.984275:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094335360 00000100:00100000:3.0:1788391272.984285:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094335360 00000100:00100000:3.0:1788391272.984612:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 588 00000100:00100000:3.0:1788391272.984625:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42624:x1875263094335360:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:3.0:1788391272.984677:0:42646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788391272.984703:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d400/0x9aafc5f04cd38c91 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00725 expref: 70 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.984725:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38a76 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00684 expref: 69 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.984737:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e900) 00010000:00010000:3.0:1788391272.984747:0:42646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788391272.984809:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.984826:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391272.984836:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788391272.985106:0:42646:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c0d9bee reply state 000000002c14a5d9 transno 30064771594 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391272.985116:0:42646:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788391272.985137:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000100:00100000:3.0:1788391272.985230:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42624:x1875263094335360:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 607us (1012us total) trans 30064771594 rc 0/0 00000100:00100000:3.0:1788391272.985238:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 588 00010000:00010000:2.0:1788391272.987123:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987137:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987145:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987150:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6b64fbe00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391272.987155:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987162:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987177:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d68641e400) 00010000:00010000:2.0:1788391272.987179:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788391272.987183:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391272.987189:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fbe00/0x9aafc5f04cd38ca6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391272.992907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391272.993347:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094335488 00000100:00100000:1.0:1788391272.993358:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094335488 00000100:00100000:1.0:1788391272.993436:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 589 00000100:00100000:1.0:1788391272.993447:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42625:x1875263094335488:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1788391272.993472:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391272.993491:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00733 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993555:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993568:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993580:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993596:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993603:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993611:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993861:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38cc2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993871:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993879:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391272.993905:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788391272.993909:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788391272.993926:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993939:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993945:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993953:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.993994:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391272.993999:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994007:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994018:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfef00) 00010000:00010000:1.0:1788391272.994021:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391272.994026:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994038:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994049:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994056:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994062:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994066:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391272.994070:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994076:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994083:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff95d692d30c00) 00010000:00010000:1.0:1788391272.994085:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391272.994088:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994095:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994125:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00733 expref: 71 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994143:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16c800/0x9aafc5f04cd38cc2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00733 expref: 70 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391272.994151:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:1.0:1788391272.994153:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788391272.994156:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16c800, rc 0) 00000100:00100000:1.0:1788391272.994210:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42625:x1875263094335488:12345-192.168.202.1@tcp:101:rm.0 Request processed in 764us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391272.994217:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 589 00000100:00100000:0.0:1788391273.000937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.001079:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094335616 00000100:00100000:2.0:1788391273.001090:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094335616 00000100:00100000:2.0:1788391273.001152:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1788391273.001163:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2356:x1875263094335616:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1788391273.001180:0:43326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.001199:0:43326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0073a expref: -99 pid: 43326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788391273.001224:0:43326:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 1024, mtime: 0x6a98af66, atime: 0x6a98af66, ctime: 0x6a98af66, blocks: 0xb 00010000:00010000:2.0:1788391273.001240:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=1090s v=(0 0) 00010000:00010000:2.0:1788391273.001245:0:43326:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788391273.001254:0:43326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 15 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.001272:0:43326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 15 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.001286:0:43326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177600, rc 0) 00000100:00100000:2.0:1788391273.001341:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+15:2356:x1875263094335616:12345-192.168.202.1@tcp:101:rm.0 Request processed in 180us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.001348:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00080000:3.0:1788391273.001458:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391273.004345:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.004583:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094335872 00000100:00100000:2.0:1788391273.004592:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094335872 00000100:00100000:2.0:1788391273.004663:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 590 00000100:00080000:3.0:1788391273.004756:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391273.004833:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42625:x1875263094335872:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1788391273.004886:0:42645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788391273.004912:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38c59 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00710 expref: 70 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.004935:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38b87 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc006d8 expref: 69 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.004946:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe200) 00010000:00010000:2.0:1788391273.004991:0:42645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391273.005015:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005030:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005040:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005056:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005064:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005071:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005301:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005311:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.005319:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788391273.006203:0:42645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].20, 64 off9784 00000004:00080000:2.0:1788391273.006214:0:42645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1090113252382ns, next at 1091113249519ns, rc = 0 00010000:00010000:2.0:1788391273.006275:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006285:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006293:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006301:0:42645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006307:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006314:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006372:0:42645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788391273.006392:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006398:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006403:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006409:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.006423:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006431:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006440:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe000) 00010000:00010000:2.0:1788391273.006443:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788391273.006447:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006452:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38cde lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006469:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006475:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006481:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006486:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.006488:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006494:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006505:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:2.0:1788391273.006507:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.006510:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.006515:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38cd0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788391273.006525:0:42645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b92f787 reply state 00000000ea112e77 transno 30064771595 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391273.006532:0:42645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391273.006651:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+70:42625:x1875263094335872:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1976us (2311us total) trans 30064771595 rc 0/0 00000100:00100000:2.0:1788391273.006660:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 590 00010000:00010000:1.0:1788391273.006899:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391273.006906:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.006912:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391273.006916:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.006922:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.006930:0:42632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff95d691bfe000) 00010000:00010000:1.0:1788391273.006933:0:42632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788391273.006935:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.006941:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38ce5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.006954:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391273.006957:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391273.006994:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391273.008344:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008373:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008381:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008387:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2177c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391273.008392:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008400:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008413:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d691bfe600) 00010000:00010000:0.0:1788391273.008473:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391273.008478:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.008485:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38cd7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391273.049019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391273.049215:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094336128 00000100:00100000:1.0:1788391273.049226:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094336128 00000100:00100000:1.0:1788391273.049287:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 591 00000100:00100000:1.0:1788391273.049297:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+69:42631:x1875263094336128:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:1.0:1788391273.049321:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788391273.049341:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38cec lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00741 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.049731:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.049747:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.049759:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.052222:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.052246:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.052259:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.053992:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054007:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054018:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788391273.054029:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:1.0:1788391273.054057:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054063:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054070:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054076:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16da00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:1.0:1788391273.054080:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054087:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054100:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:1.0:1788391273.054103:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788391273.054107:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054687:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16da00/0x9aafc5f04cd38cf3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788391273.054704:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000695a7911 reply state 0000000027e1acd3 transno 30064771596 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391273.054717:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788391273.054755:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d000/0x9aafc5f04cd38cec lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 72 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054781:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 71 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391273.054834:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:1.0:1788391273.054836:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788391273.054838:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58d16d200, rc 0) 00000100:00100000:1.0:1788391273.054906:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42631:x1875263094336128:12345-192.168.202.1@tcp:101:dd.500 Request processed in 5610us (5944us total) trans 30064771596 rc 0/0 00000100:00100000:1.0:1788391273.054914:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 591 00010000:00010000:2.0:1788391273.057885:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057902:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057911:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057917:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58d16ce00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.057923:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057931:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057953:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d692d30c00) 00010000:00010000:2.0:1788391273.057956:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.057990:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.057998:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16ce00/0x9aafc5f04cd38cfa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391273.058747:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.058808:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094336384 00000100:00100000:2.0:1788391273.058816:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094336384 00000100:00100000:2.0:1788391273.058874:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1788391273.058884:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+71:42631:x1875263094336384:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:2.0:1788391273.059237:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42631:x1875263094336384:12345-192.168.202.1@tcp:35:dd.500 Request processed in 353us (494us total) trans 30064771597 rc 0/0 00000100:00100000:2.0:1788391273.059244:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:1.0:1788391273.084257:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391273.084293:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391273.084327:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.084354:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094336768 00000100:00100000:0.0:1788391273.084365:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094336768 00000100:00100000:2.0:1788391273.084381:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094336512 00000100:00100000:2.0:1788391273.084385:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094336512 00000100:00100000:2.0:1788391273.084438:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1788391273.084438:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1788391273.084448:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094336512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391273.084448:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094336768:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:1.0:1788391273.084518:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391273.084638:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094336640 00000100:00100000:3.0:1788391273.084643:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094336640 00000100:00100000:2.0:1788391273.084647:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094336512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 201us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.084654:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1788391273.084677:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:3.0:1788391273.084685:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094336640:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788391273.084701:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391273.084738:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094336768:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 291us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391273.084745:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1788391273.084811:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094336640:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 126us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391273.084818:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:1.0:1788391273.129128:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.129233:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094337024 00000100:00100000:2.0:1788391273.129243:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094337024 00000100:00100000:2.0:1788391273.129591:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 592 00000100:00100000:2.0:1788391273.129603:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+72:42641:x1875263094337024:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1788391273.129701:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.129721:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00748 expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.129819:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:2.0:1788391273.129939:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00748 expref: 74 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.129953:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95d691bfef00) 00010000:00010000:2.0:1788391273.129956:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788391273.130648:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00748 expref: 74 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.130667:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176e00, rc 0) 00000100:00100000:2.0:1788391273.130785:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:42641:x1875263094337024:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1184us (1667us total) trans 30064771598 rc 301/301 00000100:00100000:2.0:1788391273.130794:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 592 00000100:00100000:1.0:1788391273.135898:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391273.136518:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094337280 00000100:00100000:3.0:1788391273.136528:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094337280 00000100:00100000:3.0:1788391273.136627:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:3.0:1788391273.136639:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+73:42641:x1875263094337280:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1788391273.136884:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:42641:x1875263094337280:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 246us (994us total) trans 30064771599 rc 0/0 00000100:00100000:3.0:1788391273.136892:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1788391273.174583:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.174688:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094337536 00000100:00100000:2.0:1788391273.174701:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094337536 00000100:00100000:2.0:1788391273.174759:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 593 00000100:00100000:2.0:1788391273.174776:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+74:42647:x1875263094337536:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:2.0:1788391273.174820:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.174849:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d1d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0074f expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.175212:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d24 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.175237:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.175252:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.175263:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:2.0:1788391273.175400:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d1d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0074f expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.175416:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d24 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0074f expref: 76 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.175424:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.175426:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391273.175429:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177200, rc 0) 00000100:00100000:2.0:1788391273.175528:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:42647:x1875263094337536:12345-192.168.202.1@tcp:101:dd.500 Request processed in 761us (963us total) trans 30064771600 rc 0/0 00000100:00100000:2.0:1788391273.175533:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 593 00000100:00100000:1.0:1788391273.180428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.180532:0:46617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094337792 00000100:00100000:0.0:1788391273.180560:0:46617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094337792 00000100:00100000:0.0:1788391273.180625:0:46617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:0.0:1788391273.180635:0:46617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+76:42647:x1875263094337792:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:0.0:1788391273.180952:0:46617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a559c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:42647:x1875263094337792:12345-192.168.202.1@tcp:35:dd.500 Request processed in 317us (539us total) trans 30064771601 rc 0/0 00000100:00100000:0.0:1788391273.180998:0:46617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:1.0:1788391273.218196:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.218334:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094338048 00000100:00100000:0.0:1788391273.218348:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094338048 00000100:00100000:0.0:1788391273.218546:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 594 00000100:00100000:0.0:1788391273.218560:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+77:42653:x1875263094338048:12345-192.168.202.1@tcp:36:truncate.500 00010000:00010000:0.0:1788391273.218905:0:42644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391273.219005:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d24 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0074f expref: 77 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.219031:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.219037:0:42644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788391273.219335:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.219353:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.219364:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788391273.219452:0:42644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771602 00000004:00010000:0.0:1788391273.219481:0:42644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfcf83d6 reply state 0000000085304de9 transno 30064771603 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391273.219515:0:42644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788391273.219648:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:42653:x1875263094338048:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 1091us (1465us total) trans 30064771603 rc 0/0 00000100:00100000:0.0:1788391273.219656:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 594 00000020:00080000:0.0:1788391273.219666:0:42644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788391273.222198:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222220:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222229:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222235:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391273.222240:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222250:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222270:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.222273:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391273.222279:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.222286:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d32 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391273.258860:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.262243:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094338176 00000100:00100000:0.0:1788391273.262289:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094338176 00000100:00100000:0.0:1788391273.262472:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 595 00000100:00100000:0.0:1788391273.262485:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+78:42659:x1875263094338176:12345-192.168.202.1@tcp:101:truncate.500 00010000:00010000:0.0:1788391273.262520:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391273.262549:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d39 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00756 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262654:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262672:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262686:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262702:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262709:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262717:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262858:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262867:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262874:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391273.262919:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 256 00000004:00200000:0.0:1788391273.262924:0:42646:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788391273.262952:0:42646:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262986:0:42646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.262996:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263002:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263008:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263013:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391273.263018:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263025:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263037:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:0.0:1788391273.263040:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391273.263044:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263050:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38d40 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263077:0:42646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263083:0:42646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263089:0:42646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263094:0:42646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391273.263098:0:42646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263104:0:42646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263112:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d6a704c600) 00010000:00010000:0.0:1788391273.263114:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391273.263117:0:42646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263122:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d47 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263163:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d39 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00756 expref: 80 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263178:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00756 expref: 79 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.263196:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.263198:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788391273.263201:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8e00, rc 0) 00000100:00100000:0.0:1788391273.263293:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:42659:x1875263094338176:12345-192.168.202.1@tcp:101:truncate.500 Request processed in 810us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391273.263300:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 595 00000100:00100000:1.0:1788391273.266211:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.266516:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094338432 00000100:00100000:2.0:1788391273.266529:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094338432 00000100:00100000:2.0:1788391273.266601:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 596 00000100:00100000:2.0:1788391273.266725:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+79:42659:x1875263094338432:12345-192.168.202.1@tcp:36:truncate.500 00010000:00010000:2.0:1788391273.266804:0:43348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391273.266836:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8e00/0x9aafc5f04cd38d4e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00756 expref: 79 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.266864:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.266870:0:43348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788391273.267181:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.267197:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.267207:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391273.267263:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771604 00000004:00010000:2.0:1788391273.267289:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000968963fb reply state 000000005ebf5e39 transno 30064771605 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391273.267299:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391273.267401:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+81:42659:x1875263094338432:12345-192.168.202.1@tcp:36:truncate.500 Request processed in 789us (1202us total) trans 30064771605 rc 0/0 00000100:00100000:2.0:1788391273.267410:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 596 00000020:00080000:2.0:1788391273.267415:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788391273.271205:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271228:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271236:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271243:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176e00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.271250:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271258:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271282:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.271285:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.271291:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.271298:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d55 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391273.313802:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.313871:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094338688 00000100:00100000:2.0:1788391273.313886:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094338688 00000100:00100000:2.0:1788391273.313993:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 597 00000100:00100000:2.0:1788391273.314003:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+80:42665:x1875263094338688:12345-192.168.202.1@tcp:101:dd.500 00010000:00010000:2.0:1788391273.314031:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.314059:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d5c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0075d expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314237:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314249:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314260:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314270:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314276:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314279:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314326:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d71 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314331:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d71 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314335:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d71 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.314345:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 2048 00010000:00010000:2.0:1788391273.314464:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314472:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314479:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314485:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176200 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.314490:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314498:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314517:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:2.0:1788391273.314520:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.314525:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314532:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38d63 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314549:0:42645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314555:0:42645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314561:0:42645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314567:0:42645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176c00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.314570:0:42645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314577:0:42645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314585:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d691bfe200) 00010000:00010000:2.0:1788391273.314587:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.314590:0:42645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314595:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38d6a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314649:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d5c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0075d expref: 83 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314664:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d71 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0075d expref: 82 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.314673:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.314675:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788391273.314678:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177200, rc 0) 00000100:00100000:2.0:1788391273.314755:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+82:42665:x1875263094338688:12345-192.168.202.1@tcp:101:dd.500 Request processed in 753us (1002us total) trans 30064771606 rc 0/0 00000100:00100000:2.0:1788391273.314764:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 597 00000100:00100000:1.0:1788391273.317668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391273.317718:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.317875:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094338816 00000100:00100000:0.0:1788391273.317887:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094338816 00000100:00100000:0.0:1788391273.318013:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1788391273.318178:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094339072 00000100:00100000:2.0:1788391273.318183:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094339072 00000100:00100000:2.0:1788391273.318217:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 598 00000100:00100000:2.0:1788391273.318226:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:42665:x1875263094339072:12345-192.168.202.1@tcp:36:dd.500 00010000:00010000:2.0:1788391273.318589:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.318623:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.318637:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788391273.318696:0:43348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771607 00000004:00010000:2.0:1788391273.318726:0:43348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1dc213 reply state 0000000075feb4c1 transno 30064771608 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391273.318737:0:43348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788391273.318853:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+86:42665:x1875263094339072:12345-192.168.202.1@tcp:36:dd.500 Request processed in 628us (1133us total) trans 30064771608 rc 0/0 00000100:00100000:2.0:1788391273.318861:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 598 00000020:00080000:2.0:1788391273.318867:0:43348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788391273.319278:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+85:2358:x1875263094338816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391273.319293:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391273.319317:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177200/0x9aafc5f04cd38d71 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0075d expref: 85 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.319338:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.319343:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391273.319380:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:2358:x1875263094338816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 114us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391273.319387:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:0.0:1788391273.321474:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321493:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321502:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321531:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d6c2176a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:0.0:1788391273.321537:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321545:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321565:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.321568:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788391273.321573:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.321579:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176a00/0x9aafc5f04cd38d7f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391273.325657:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391273.325723:0:42648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094339328 00000100:00100000:3.0:1788391273.325737:0:42648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094339328 00000100:00100000:3.0:1788391273.325868:0:42648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:3.0:1788391273.325881:0:42648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+83:42665:x1875263094339328:12345-192.168.202.1@tcp:35:dd.500 00000100:00100000:3.0:1788391273.326337:0:42648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:42665:x1875263094339328:12345-192.168.202.1@tcp:35:dd.500 Request processed in 457us (693us total) trans 30064771609 rc 0/0 00000100:00100000:3.0:1788391273.326355:0:42648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:1.0:1788391273.369747:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.369835:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094339584 00000100:00100000:0.0:1788391273.369850:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094339584 00000100:00100000:0.0:1788391273.370143:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 599 00000100:00100000:0.0:1788391273.370158:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+84:42675:x1875263094339584:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391273.370193:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391273.370220:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00764 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.370355:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d8d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.370396:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d8d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.370411:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d8d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788391273.370457:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1788391273.370628:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00764 expref: 87 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.370648:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9200/0x9aafc5f04cd38d8d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00764 expref: 86 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.370659:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:0.0:1788391273.370662:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788391273.370666:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec9200, rc 0) 00000100:00100000:0.0:1788391273.370754:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+86:42675:x1875263094339584:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 600us (1019us total) trans 30064771610 rc 0/0 00000100:00100000:0.0:1788391273.370763:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 599 00000100:00100000:1.0:1788391273.409360:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.409443:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094339712 00000100:00100000:2.0:1788391273.409457:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094339712 00000100:00100000:2.0:1788391273.409532:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 600 00000100:00100000:2.0:1788391273.409543:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+86:42681:x1875263094339712:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391273.409572:0:43348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.409594:0:43348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc0076b expref: -99 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409671:0:43348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38da2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409690:0:43348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38da2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409711:0:43348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38da2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.409764:0:43348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:2.0:1788391273.409779:0:43348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391273.409804:0:43348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38da2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 43348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409834:0:43348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176e00/0x9aafc5f04cd38d9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0076b expref: 88 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409857:0:43348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176c00/0x9aafc5f04cd38da2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0076b expref: 87 pid: 43348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.409865:0:43348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:2.0:1788391273.409868:0:43348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788391273.409871:0:43348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2176c00, rc 0) 00000100:00100000:2.0:1788391273.409938:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+87:42681:x1875263094339712:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 398us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.409944:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 600 00000100:00100000:1.0:1788391273.411398:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391273.411452:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094339840 00000100:00100000:2.0:1788391273.411460:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094339840 00000100:00100000:2.0:1788391273.411511:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 601 00000100:00100000:2.0:1788391273.411521:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+87:42681:x1875263094339840:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:2.0:1788391273.411538:0:42645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788391273.411556:0:42645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38da9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00772 expref: -99 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411661:0:42645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411676:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411688:0:42645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.411737:0:42645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00000004:00200000:2.0:1788391273.411741:0:42645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391273.411755:0:42645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411779:0:42645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411796:0:42645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2176200/0x9aafc5f04cd38da9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 89 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411809:0:42645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 88 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.411814:0:42645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.411816:0:42645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391273.411819:0:42645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6c2177c00, rc 0) 00000100:00100000:2.0:1788391273.411858:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+88:42681:x1875263094339840:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 341us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.411862:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 601 00000100:00100000:1.0:1788391273.413191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391273.413272:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340096 00000100:00100000:3.0:1788391273.413281:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340096 00000100:00100000:3.0:1788391273.413340:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 602 00000100:00100000:3.0:1788391273.413350:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+88:42681:x1875263094340096:12345-192.168.202.1@tcp:101:lfs.500 00010000:00010000:3.0:1788391273.413369:0:42646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788391273.413392:0:42646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38db7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00779 expref: -99 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413480:0:42646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413492:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 89 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413498:0:42646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 89 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413503:0:42646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 5/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413533:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 89 pid: 42645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413543:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 89 pid: 42645 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391273.413554:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103502848:192.168.202.1@tcp:104: 00010000:00010000:3.0:1788391273.413703:0:42646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 89 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.413714:0:42646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 89 pid: 42644 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391273.413723:0:42646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b135180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103502976:192.168.202.1@tcp:104: 00000100:00100000:3.0:1788391273.413749:0:42646:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d69193d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788391273.416302:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391273.416343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.416486:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340224 00000100:00100000:0.0:1788391273.416498:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340224 00010000:00010000:0.0:1788391273.416551:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 90 pid: 42645 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391273.416611:0:42630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340352 00000100:00100000:0.0:1788391273.416615:0:42630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340352 00010000:00010000:0.0:1788391273.416639:0:42630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 91 pid: 42644 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391273.416666:0:42630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:0.0:1788391273.416679:0:42630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+91:2356:x1875263094340224:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391273.416696:0:42630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788391273.416700:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103502848:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391273.416724:0:42630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 91 pid: 42645 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788391273.416726:0:42646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b135180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:42646:1875263103502976:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391273.416746:0:42630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 91 pid: 42645 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.416760:0:42646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.416786:0:42630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6c2177c00/0x9aafc5f04cd38db0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00772 expref: 91 pid: 42645 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.416808:0:42630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.416814:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.416824:0:42630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.416831:0:42630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391273.416881:0:45855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:0.0:1788391273.416884:0:42630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+90:2356:x1875263094340224:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 207us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391273.416897:0:42630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1788391273.416898:0:45855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+90:2356:x1875263094340352:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788391273.416909:0:45855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788391273.416916:0:45855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 90 pid: 42644 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.416929:0:45855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 89 pid: 42644 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.416944:0:45855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58d16d200/0x9aafc5f04cd38d01 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00741 expref: 89 pid: 42644 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.416957:0:45855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.416977:0:45855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.416986:0:45855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.416994:0:45855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.417011:0:45855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788391273.417040:0:45855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+88:2356:x1875263094340352:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 149us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.417048:0:45855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00010000:00010000:3.0:1788391273.417117:0:42646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.417125:0:42646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42646 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788391273.417147:0:42646:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00010000:00010000:3.0:1788391273.417373:0:42646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa600/0x9aafc5f04cd38db7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 89 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.417390:0:42646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 88 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788391273.417398:0:42646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:3.0:1788391273.417407:0:42646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788391273.417410:0:42646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d6b64fa400, rc 0) 00000100:00100000:3.0:1788391273.417448:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+88:42681:x1875263094340096:12345-192.168.202.1@tcp:101:lfs.500 Request processed in 4100us (4262us total) trans 30064771611 rc 0/0 00000100:00100000:3.0:1788391273.417455:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 602 00010000:00010000:0.0:1788391273.421865:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391273.431074:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.431151:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340480 00000100:00100000:0.0:1788391273.431166:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340480 00000100:00100000:0.0:1788391273.431248:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 603 00000100:00100000:0.0:1788391273.431262:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+88:42683:x1875263094340480:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1788391273.431308:0:42644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788391273.431336:0:42644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38dcc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d553ccadcc00780 expref: -99 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431447:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431464:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431477:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431492:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431497:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431501:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431590:0:42644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431597:0:42644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 89 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431602:0:42644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431640:0:42644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 89 pid: 42646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.431669:0:42644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 89 pid: 42646 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391273.431685:0:42644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103503104:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391273.431793:0:42644:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f4026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788391273.433411:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.433429:0:42644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:42644:1875263103503104:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391273.433460:0:42644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788391273.433484:0:42647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340736 00000100:00100000:2.0:1788391273.433491:0:42647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340736 00000100:00100000:2.0:1788391273.433563:0:42647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:2.0:1788391273.433575:0:42647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+90:36381:x1875263094340736:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788391273.433842:0:42647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+91:36381:x1875263094340736:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 270us (437us total) trans 30064771612 rc 0/0 00000100:00100000:2.0:1788391273.433849:0:42647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:1.0:1788391273.434935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391273.434998:0:42631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340864 00000100:00100000:0.0:1788391273.435006:0:42631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340864 00010000:00010000:0.0:1788391273.435041:0:42631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 91 pid: 42646 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391273.435083:0:42631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:0.0:1788391273.435094:0:42631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+91:2356:x1875263094340864:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788391273.435108:0:42631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788391273.435116:0:42631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 91 pid: 42646 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435130:0:42631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 91 pid: 42646 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435154:0:42631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d6b64fa400/0x9aafc5f04cd38dbe lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00779 expref: 91 pid: 42646 timeout: 1190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435190:0:42631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:0.0:1788391273.435196:0:42631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435206:0:42631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435215:0:42631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391273.435258:0:42631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788391273.435311:0:42631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+90:2356:x1875263094340864:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 219us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391273.435319:0:42631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00010000:00010000:2.0:1788391273.435490:0:42644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435499:0:42644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788391273.435541:0:42644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3b:0x0]: returning size 0 00000004:00200000:2.0:1788391273.435547:0:42644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788391273.435567:0:42644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435581:0:42644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435591:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435599:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435606:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435612:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9a00 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.435616:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435625:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435635:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff95d692d30000) 00010000:00010000:2.0:1788391273.435639:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.435643:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435650:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9a00/0x9aafc5f04cd38dd3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435662:0:42644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435674:0:42644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435680:0:42644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435685:0:42644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec9800 already unused, calling callback (ffffffffc21754f0) 00010000:00010000:2.0:1788391273.435688:0:42644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435694:0:42644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435701:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff95d6a704c600) 00010000:00010000:2.0:1788391273.435707:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788391273.435710:0:42644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435715:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec9800/0x9aafc5f04cd38dda lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435751:0:42644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8c00/0x9aafc5f04cd38dcc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00780 expref: 90 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435777:0:42644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95d58fec8600/0x9aafc5f04cd38de1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc00780 expref: 89 pid: 42644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788391273.435785:0:42644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3b:0x0].0x0 (ffff95d692d30500) 00010000:00010000:2.0:1788391273.435787:0:42644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788391273.435791:0:42644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95d58fec8600, rc 0) 00000100:00100000:2.0:1788391273.435833:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+89:42683:x1875263094340480:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 4576us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391273.435840:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 603 00000040:00080000:3.0:1788391273.950116:0:47691:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391273.950124:0:47691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391273.950171:0:47691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391273.950177:0:47691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391274.447081:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391275.414182:0:47742:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391275.414190:0:47742:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391275.414235:0:47742:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391275.414241:0:47742:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391275.469230:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788391276.004410:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771288 is committed 00000001:00080000:1.0:1788391276.004433:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771287 is committed 00000001:00080000:1.0:1788391276.011862:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771610 is committed 00000001:00080000:1.0:1788391276.011905:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771612 is committed 00000004:00080000:1.0:1788391276.011926:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000020:00080000:1.0:1788391276.011995:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95d6a69f7600 refcount 2 committed 0 result 0 batchid 25769803915 00000020:00080000:1.0:1788391276.012001:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6864dd600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95d6a69f7780 00000020:00080000:1.0:1788391276.012004:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95d6864dde00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95d58ca75800 00000020:00080000:2.0:1788391276.012051:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803915 committed batchid 25769803914 00000100:00100000:1.0:1788391276.012274:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391276.012297:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103503232:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788391276.012311:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803914 00000100:00100000:1.0:1788391276.012369:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391276.012411:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103503232 00000100:00100000:0.0:1788391276.012419:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103503232 00000100:00100000:0.0:1788391276.012485:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788391276.012501:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103503232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788391276.012528:0:43327:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:207 count 1 00010000:00010000:0.0:1788391276.012555:0:43327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.012576:0:43327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 13 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.012585:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=3s v=(0 0) 00000100:00080000:2.0:1788391276.012592:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788391276.012606:0:43327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788391276.012612:0:43327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.012642:0:43327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 13 pid: 43326 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.012656:0:43327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 13 pid: 43326 timeout: 1193 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391276.012668:0:43327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103503360:192.168.202.1@tcp:104: 00000100:00100000:0.0:1788391276.012802:0:43327:0:(client.c:2715:ptlrpc_set_wait()) set ffff95d68f402b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788391276.017128:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391276.017220:0:45446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094340992 00000100:00100000:1.0:1788391276.017229:0:45446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094340992 00000100:00080000:2.0:1788391276.017288:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391276.017296:0:45446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 14 pid: 43326 timeout: 1193 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788391276.017340:0:45446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1788391276.017351:0:45446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094340992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788391276.017364:0:45446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788391276.017371:0:45446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 14 pid: 43326 timeout: 1193 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.017385:0:45446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 14 pid: 43326 timeout: 1193 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.017559:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391276.017565:0:45446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788391276.017571:0:45446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.017582:0:45446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.017603:0:45446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788391276.017667:0:45446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+14:2357:x1875263094340992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 316us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391276.017675:0:45446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00010000:00010000:0.0:1788391276.018602:0:43327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bf3da12/0x9aafc5f04cd38cc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.1@tcp remote: 0x7d553ccadcc0073a expref: 13 pid: 43326 timeout: 1193 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788391276.018631:0:43327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:43327:1875263103503360:192.168.202.1@tcp:104: 00010000:00010000:0.0:1788391276.018657:0:43327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.018668:0:43327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.018675:0:43327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.018684:0:43327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.018707:0:43327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788391276.018732:0:43327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788391276.019568:0:42632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788391276.019576:0:42632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.019585:0:42632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95d58fec8400 already unused, calling callback (ffffffffc176a230) 00010000:00010000:1.0:1788391276.019589:0:42632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.019598:0:42632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.019615:0:42632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.019623:0:42632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000754eeb35/0x9aafc5f04cd38de8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788391276.019641:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391276.019643:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391276.019645:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391276.020863:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103503232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8362us (8486us total) trans 30064771289 rc 0/0 00000100:00100000:0.0:1788391276.020876:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788391276.021256:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771288 gen 2 00000004:00080000:1.0:1788391276.021263:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771288 committed transno 30064771288 00000100:00100000:1.0:1788391276.021285:0:3288:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95d58a93ce00 x1875263103503232/t30064771289(30064771289) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788391292 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788391276.021297:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95d58a93ce00/2, rc 0, transno 30064771289 00000100:00100000:1.0:1788391276.021303:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103503232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788391276.493140:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103503488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391276.493206:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391276.493278:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103503488 00000100:00100000:1.0:1788391276.493285:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103503488 00000100:00100000:1.0:1788391276.493328:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788391276.493338:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103503488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391276.493370:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391276.493414:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103503488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391276.493422:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788391276.493691:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103503488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391276.494895:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103503744:0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.494941:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391276.494990:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391276.494996:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103503872:0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.495024:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391276.495052:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103503744 00000100:00100000:1.0:1788391276.495057:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103503744 00000100:00100000:1.0:1788391276.495100:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788391276.495108:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103503744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.495150:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103503744:12345-0@lo:400:kworker.0 Request processed in 43us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391276.495157:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788391276.495182:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391276.495205:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103503744:0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.495237:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103503872 00000100:00100000:1.0:1788391276.495241:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103503872 00000100:00100000:1.0:1788391276.495266:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788391276.495272:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103503872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.495306:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103503872:12345-0@lo:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391276.495311:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788391276.495334:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103503872:0@lo:400:kworker.0 00000100:00100000:3.0:1788391276.495574:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103504000:0@lo:400:kworker.0 00000100:00100000:3.0:1788391276.495604:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391276.495632:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788391276.495638:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103503616:0@lo:400:kworker.0 00000100:00100000:2.0:1788391276.495943:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504000 00000100:00100000:2.0:1788391276.495948:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504000 00000100:00100000:2.0:1788391276.496000:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788391276.496007:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103504000:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788391276.496142:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391276.496221:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103504000:12345-0@lo:400:kworker.0 Request processed in 214us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391276.496229:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00010000:0.0:1788391276.496550:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391276.496717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391276.496760:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103504128:0@lo:400:kworker.0 00000100:00100000:3.0:1788391276.496785:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391276.496819:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103504000:0@lo:400:kworker.0 00000100:00100000:2.0:1788391276.496880:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103503616 00000100:00100000:2.0:1788391276.496884:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103503616 00000100:00100000:2.0:1788391276.496919:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788391276.496926:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391276.496989:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103503616:12345-0@lo:400:kworker.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391276.496996:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788391276.497029:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103503616:0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.497097:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504128 00000100:00100000:1.0:1788391276.497102:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504128 00000100:00100000:1.0:1788391276.497147:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788391276.497154:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103504128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391276.497190:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103504128:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391276.497196:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788391276.497265:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103504128:0@lo:400:kworker.0 00000100:00080000:2.0:1788391276.497282:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788391276.855288:0:47797:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391276.855298:0:47797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391276.855431:0:47797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391276.855438:0:47797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391277.517141:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391277.517164:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103504256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391277.517327:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391277.517450:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391277.517454:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504256 00000100:00100000:3.0:1788391277.517462:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504256 00000100:00100000:3.0:1788391277.517515:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788391277.517526:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103504256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391277.517562:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391277.517783:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103504256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391277.517791:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788391277.517907:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103504256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391278.205226:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391278.205316:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391278.205349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391278.205386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391278.205415:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391278.205444:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341632 00000100:00100000:1.0:1788391278.205454:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341632 00000100:00100000:1.0:1788391278.205524:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341248 00000100:00100000:1.0:1788391278.205528:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341248 00000100:00100000:1.0:1788391278.205556:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788391278.205567:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094341632:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391278.205637:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094341632:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391278.205644:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1788391278.205664:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391278.205672:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094341248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391278.205702:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094341248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391278.205708:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391278.205750:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341376 00000100:00100000:1.0:1788391278.205754:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341376 00000100:00100000:1.0:1788391278.205780:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341504 00000100:00100000:1.0:1788391278.205783:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341504 00000100:00100000:1.0:1788391278.205800:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1788391278.205804:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094341376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391278.205823:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094341376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391278.205828:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:1.0:1788391278.205837:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1788391278.205842:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094341504:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391278.205864:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094341504:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391278.205870:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00080000:1.0:1788391278.205885:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391278.205889:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391278.205892:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391278.206873:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341120 00000100:00100000:2.0:1788391278.206880:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341120 00000100:00100000:2.0:1788391278.206927:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:2.0:1788391278.206936:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094341120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391278.207020:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094341120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391278.207029:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000040:00080000:1.0:1788391278.313240:0:47848:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391278.313248:0:47848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391278.313281:0:47848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391278.313286:0:47848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391278.541167:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391279.565310:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391279.904268:0:47899:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391279.904278:0:47899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391279.904341:0:47899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391279.904349:0:47899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391280.589208:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788391281.129392:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803915 batchid updated 00000020:00080000:2.0:1788391281.129486:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803915 00000020:00080000:2.0:1788391281.129500:0:42682:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803915 00000001:00080000:1.0:1788391281.131097:0:7599:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771289 is committed 00000040:00080000:3.0:1788391281.403545:0:47954:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391281.403553:0:47954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391281.403600:0:47954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391281.403606:0:47954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391281.613141:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391281.613162:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391281.613274:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613333:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103504768:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.613353:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613368:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391281.613372:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103504896:0@lo:400:kworker.0 00000100:00100000:1.0:1788391281.613484:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504384 00000100:00100000:1.0:1788391281.613493:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504384 00000100:00100000:0.0:1788391281.613502:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613536:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504768 00000100:00100000:0.0:1788391281.613540:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504768 00000100:00100000:1.0:1788391281.613555:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788391281.613575:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788391281.613579:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103504384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391281.613584:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103504768:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788391281.613617:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391281.613631:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103504768:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391281.613639:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788391281.613662:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103504384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391281.613670:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788391281.613674:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504896 00000100:00100000:0.0:1788391281.613678:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504896 00000100:00100000:1.0:1788391281.613709:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103504640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.613730:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788391281.613738:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103504896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391281.613746:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391281.613771:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.613782:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103504896:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391281.613789:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788391281.613801:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613810:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504640 00000100:00100000:0.0:1788391281.613815:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504640 00000100:00100000:1.0:1788391281.613825:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788391281.613834:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103504512:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.613844:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788391281.613852:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391281.613866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613894:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103504640:12345-0@lo:400:kworker.0 Request processed in 42us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391281.613901:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103505024:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.613903:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788391281.613926:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505152 00000100:00100000:0.0:1788391281.613930:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505152 00000100:00100000:1.0:1788391281.613935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391281.613955:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505024 00000100:00100000:1.0:1788391281.614002:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103504640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.614002:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505024 00000100:00100000:0.0:1788391281.614028:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788391281.614034:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391281.614036:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103505152:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788391281.614039:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391281.614044:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391281.614065:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788391281.614075:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103505152:12345-0@lo:400:kworker.0 Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391281.614077:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103505024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.614086:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788391281.614119:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103505024:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391281.614127:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788391281.614167:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788391281.614171:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103504512 00000100:00100000:1.0:1788391281.614176:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103504512 00000100:00100000:0.0:1788391281.614179:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.614211:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103504896:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.614232:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771289 gen 2 00000004:00080000:0.0:1788391281.614236:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95d58a93ce00, transno 30064771289 00000100:00100000:0.0:1788391281.614245:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103504768:0@lo:400:kworker.0 00000100:00100000:0.0:1788391281.614258:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391281.614329:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788391281.614339:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103504512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391281.614378:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103504512:12345-0@lo:400:kworker.0 Request processed in 40us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391281.614384:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788391281.614770:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103504512:0@lo:400:kworker.0 00010000:00010000:2.0:1788391281.615087:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391281.933224:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391281.933234:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391281.933274:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391281.933283:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391282.640924:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391282.642103:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103505280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391282.642171:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391282.642267:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505280 00000100:00100000:1.0:1788391282.642274:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505280 00000100:00100000:1.0:1788391282.642326:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788391282.642335:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103505280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391282.642368:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391282.646345:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103505280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4000us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391282.646360:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788391282.646372:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103505280:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788391282.912550:0:48005:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391282.912558:0:48005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391282.912595:0:48005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391282.912602:0:48005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391283.319220:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391283.319262:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391283.319287:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391283.319316:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391283.319369:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341760 00000100:00100000:2.0:1788391283.319377:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341760 00000100:00100000:3.0:1788391283.319405:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342016 00000100:00100000:3.0:1788391283.319412:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342016 00000100:00100000:2.0:1788391283.319424:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:2.0:1788391283.319433:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094341760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391283.319462:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1788391283.319473:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094342016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391283.319492:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094341760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391283.319498:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:3.0:1788391283.319527:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094342016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 54us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391283.319535:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00080000:3.0:1788391283.319594:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391283.319608:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391283.319685:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342144 00000100:00100000:2.0:1788391283.319690:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342144 00000100:00100000:2.0:1788391283.319731:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00080000:3.0:1788391283.319735:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391283.319741:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094342144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391283.319780:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094342144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391283.319787:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1788391283.320205:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094341888 00000100:00100000:0.0:1788391283.320211:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094341888 00000100:00100000:0.0:1788391283.320257:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342272 00000100:00080000:2.0:1788391283.320259:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391283.320260:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342272 00000100:00100000:2.0:1788391283.320292:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1788391283.320301:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1788391283.320306:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094341888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391283.320315:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094342272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391283.320343:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094341888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391283.320351:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:0.0:1788391283.320357:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094342272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391283.320365:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00080000:2.0:1788391283.320373:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788391283.661127:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391284.466280:0:48057:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391284.466288:0:48057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391284.466344:0:48057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391284.466349:0:48057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391284.685264:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391285.709108:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391285.998631:0:48108:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391285.998640:0:48108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391285.998782:0:48108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391285.998847:0:48108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391286.733158:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391286.733301:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391286.733324:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103505408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391286.733453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391286.733734:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505408 00000100:00100000:2.0:1788391286.733742:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505408 00000100:00100000:2.0:1788391286.733794:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788391286.733804:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103505408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391286.733838:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391286.733905:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103505408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391286.733910:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788391286.734080:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103505408:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788391286.734144:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391286.734447:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103505536:0@lo:400:kworker.0 00000100:00100000:2.0:1788391286.734493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391286.734864:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505536 00000100:00100000:3.0:1788391286.734868:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505536 00000100:00100000:3.0:1788391286.734903:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788391286.734908:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103505536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735196:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103505920:0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735246:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391286.735270:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391286.735276:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103505792:0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735293:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391286.735315:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505920 00000100:00100000:1.0:1788391286.735318:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505920 00000100:00100000:1.0:1788391286.735341:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505792 00000100:00100000:1.0:1788391286.735343:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505792 00000100:00100000:1.0:1788391286.735354:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788391286.735358:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103505920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735382:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103505920:12345-0@lo:400:kworker.0 Request processed in 23us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391286.735386:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788391286.735396:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391286.735400:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735414:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103505792:12345-0@lo:400:kworker.0 Request processed in 14us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391286.735417:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391286.735436:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103505792:0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.735442:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103505920:0@lo:400:kworker.0 00000100:00080000:1.0:1788391286.735470:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391286.735513:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6c1d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103505664:0@lo:400:kworker.0 00000100:00100000:0.0:1788391286.735535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391286.735557:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391286.735560:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103506048:0@lo:400:kworker.0 00000100:00100000:0.0:1788391286.735572:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391286.735587:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506048 00000100:00100000:0.0:1788391286.735589:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506048 00000100:00100000:0.0:1788391286.735611:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788391286.735615:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103506048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391286.735634:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103506048:12345-0@lo:400:kworker.0 Request processed in 20us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391286.735638:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788391286.735660:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391286.735675:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103506048:0@lo:400:kworker.0 00000100:00100000:3.0:1788391286.735832:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103505536:12345-0@lo:400:kworker.0 Request processed in 922us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391286.735839:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788391286.735907:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103505536:0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.736556:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103505664 00000100:00100000:1.0:1788391286.736561:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103505664 00000100:00100000:1.0:1788391286.736620:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788391286.736628:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103505664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391286.736694:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103505664:12345-0@lo:400:kworker.0 Request processed in 63us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391286.736700:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788391286.736726:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6c1d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103505664:0@lo:400:kworker.0 00000100:00080000:0.0:1788391286.736752:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788391287.560001:0:48160:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391287.560011:0:48160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391287.560062:0:48160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391287.560068:0:48160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391287.757128:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391287.757439:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103506176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391287.757516:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391287.757751:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506176 00000100:00100000:1.0:1788391287.757758:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506176 00000100:00100000:1.0:1788391287.757846:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788391287.757858:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103506176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391287.757893:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391287.757948:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103506176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391287.757955:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788391287.758057:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103506176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391288.437231:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391288.437274:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391288.437320:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391288.437373:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391288.437401:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391288.437431:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342784 00000100:00100000:1.0:1788391288.437439:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342528 00000100:00100000:3.0:1788391288.437440:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342784 00000100:00100000:1.0:1788391288.437452:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342528 00000100:00100000:3.0:1788391288.437494:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342656 00000100:00100000:3.0:1788391288.437497:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342656 00000100:00100000:3.0:1788391288.437519:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:3.0:1788391288.437529:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094342784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391288.437541:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342912 00000100:00100000:1.0:1788391288.437544:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342912 00000100:00100000:1.0:1788391288.437573:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1788391288.437581:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094342528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391288.437659:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094342528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391288.437667:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1788391288.437686:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:1.0:1788391288.437692:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094342912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391288.437693:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1788391288.437701:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094342656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391288.437763:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094342400 00000100:00100000:2.0:1788391288.437769:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094342400 00000100:00100000:2.0:1788391288.437803:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1788391288.437811:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094342400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391288.437955:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094342784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 426us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391288.437991:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00080000:3.0:1788391288.438039:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391288.438044:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391288.438045:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094342912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 352us (641us total) trans 0 rc 0/0 00000100:00080000:3.0:1788391288.438046:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391288.438055:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1788391288.438128:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094342656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 427us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391288.438135:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1788391288.440871:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094342400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 3050us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391288.440886:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00010000:00010000:0.0:1788391288.781174:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391289.078273:0:48211:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391289.078282:0:48211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391289.078336:0:48211:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391289.078344:0:48211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391289.805212:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391290.614227:0:48262:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391290.614236:0:48262:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391290.614284:0:48262:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391290.614290:0:48262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391290.829983:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391291.149201:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391291.149210:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391291.149244:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391291.149252:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391291.853133:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391291.853842:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103506304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391291.853857:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103506432:0@lo:400:kworker.0 00000100:00100000:3.0:1788391291.854065:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391291.856827:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391291.856853:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103506560:0@lo:400:kworker.0 00000100:00100000:0.0:1788391291.856900:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103506816:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.856918:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391291.856942:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391291.856953:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103507072:0@lo:400:kworker.0 00000100:00100000:0.0:1788391291.856992:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391291.857001:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103506944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857002:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391291.857033:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391291.857038:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391291.857045:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103506688:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391291.857081:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506816 00000100:00100000:0.0:1788391291.857089:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506816 00000100:00100000:2.0:1788391291.857106:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506304 00000100:00100000:2.0:1788391291.857110:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506304 00000100:00100000:0.0:1788391291.857144:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788391291.857157:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857169:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788391291.857177:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103506304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391291.857203:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391291.857215:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103506816:12345-0@lo:400:kworker.0 Request processed in 61us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391291.857223:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788391291.857237:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103506304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391291.857242:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507072 00000100:00100000:2.0:1788391291.857243:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788391291.857248:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507072 00000100:00100000:2.0:1788391291.857263:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506944 00000100:00100000:2.0:1788391291.857267:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506944 00000100:00100000:0.0:1788391291.857276:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788391291.857287:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857289:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788391291.857299:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857332:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103506944:12345-0@lo:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391291.857336:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788391291.857342:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103507072:12345-0@lo:400:kworker.0 Request processed in 56us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391291.857350:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788391291.857366:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506560 00000100:00100000:2.0:1788391291.857369:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506560 00000100:00100000:2.0:1788391291.857391:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506688 00000100:00100000:2.0:1788391291.857393:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506688 00000100:00100000:0.0:1788391291.857398:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103506944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857406:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788391291.857410:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103506560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391291.857438:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103506816:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857443:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103506560:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391291.857449:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788391291.857457:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788391291.857460:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103506688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.857474:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103506688:12345-0@lo:400:kworker.0 Request processed in 14us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391291.857477:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788391291.857486:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391291.857490:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391291.857491:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391291.857719:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103506432 00000100:00100000:3.0:1788391291.857725:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103506432 00000100:00100000:3.0:1788391291.858328:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788391291.858335:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103506432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391291.858367:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103506432:12345-0@lo:400:kworker.0 Request processed in 34us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391291.858371:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788391291.858402:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103506432:0@lo:400:kworker.0 00000100:00100000:0.0:1788391291.859126:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103506304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391291.859127:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103506688:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.859153:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103506560:0@lo:400:kworker.0 00000100:00100000:2.0:1788391291.859167:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103507072:0@lo:400:kworker.0 00000040:00080000:3.0:1788391292.157384:0:48315:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391292.157394:0:48315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391292.157445:0:48315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391292.157456:0:48315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391292.877185:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788391292.877185:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391292.877207:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103507200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391292.877265:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391292.877288:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507200 00000100:00100000:2.0:1788391292.877298:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507200 00000100:00100000:2.0:1788391292.877346:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788391292.877358:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103507200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391292.877403:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391292.877455:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103507200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391292.877461:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788391292.877520:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103507200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391293.558887:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391293.558928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391293.558954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391293.558996:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391293.559015:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391293.559049:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343040 00000100:00100000:3.0:1788391293.559057:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343040 00000100:00100000:3.0:1788391293.559098:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:3.0:1788391293.559107:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094343040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391293.559168:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094343040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391293.559175:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:3.0:1788391293.559210:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343424 00000100:00100000:3.0:1788391293.559213:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343424 00000100:00100000:3.0:1788391293.559242:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343296 00000100:00100000:3.0:1788391293.559244:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343296 00000100:00100000:3.0:1788391293.559261:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788391293.559267:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094343424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391293.559290:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094343424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391293.559296:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1788391293.559305:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1788391293.559310:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094343296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391293.559328:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094343296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 18us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391293.559344:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00080000:3.0:1788391293.559366:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391293.559370:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391293.559446:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343168 00000100:00100000:1.0:1788391293.559451:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343168 00000100:00100000:1.0:1788391293.559488:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343552 00000100:00100000:1.0:1788391293.559491:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343552 00000100:00100000:1.0:1788391293.559509:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1788391293.559514:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094343168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391293.559541:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094343168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391293.559547:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1788391293.559558:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1788391293.559563:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094343552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391293.559579:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094343552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 16us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391293.559596:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00080000:3.0:1788391293.559801:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788391293.780348:0:48366:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391293.780358:0:48366:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391293.780415:0:48366:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391293.780421:0:48366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391293.903077:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391294.925699:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391295.329515:0:48417:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391295.329528:0:48417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391295.329603:0:48417:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391295.329609:0:48417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391295.949137:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391296.789431:0:48468:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391296.789439:0:48468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391296.789670:0:48468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391296.789676:0:48468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391296.974329:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103507712:0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.974384:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391296.974432:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391296.974436:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103507584:0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.974454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391296.974488:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507712 00000100:00100000:2.0:1788391296.974494:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507712 00000100:00100000:2.0:1788391296.974533:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788391296.974543:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103507712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.974598:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103507712:12345-0@lo:400:kworker.0 Request processed in 57us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391296.974604:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788391296.974636:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103507712:0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.974658:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507584 00000100:00100000:2.0:1788391296.974661:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507584 00000100:00100000:2.0:1788391296.974683:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788391296.974687:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103507584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.974709:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103507584:12345-0@lo:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391296.974713:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788391296.974727:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103507584:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.974830:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103507328:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.974857:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391296.974882:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103507840:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.974896:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391296.974908:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788391296.974911:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103507456:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.974923:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391296.974932:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103507968:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.974943:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788391296.974957:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391296.974984:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507456 00000100:00100000:3.0:1788391296.974986:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507456 00000100:00100000:3.0:1788391296.975006:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788391296.975010:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103507456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.975033:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103507456:12345-0@lo:400:kworker.0 Request processed in 23us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391296.975039:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788391296.975057:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391296.975071:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103507456:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.975096:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507840 00000100:00100000:3.0:1788391296.975099:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507840 00000100:00100000:3.0:1788391296.975162:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507968 00000100:00100000:3.0:1788391296.975175:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507968 00000100:00100000:3.0:1788391296.975196:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788391296.975199:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103507840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.975223:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103507840:12345-0@lo:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391296.975227:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788391296.975234:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788391296.975237:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103507968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.975251:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103507968:12345-0@lo:400:kworker.0 Request processed in 14us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391296.975255:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788391296.975263:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391296.975273:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103507968:0@lo:400:kworker.0 00000100:00100000:3.0:1788391296.975278:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103507840:0@lo:400:kworker.0 00010000:00010000:0.0:1788391296.975413:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391296.975635:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103507328 00000100:00100000:2.0:1788391296.975638:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103507328 00000100:00100000:2.0:1788391296.975666:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788391296.975671:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.975705:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103507328:12345-0@lo:400:kworker.0 Request processed in 34us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391296.975711:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788391296.976145:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103507328:0@lo:400:kworker.0 00000100:00100000:2.0:1788391296.976282:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103508096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391296.976319:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391296.976427:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508096 00000100:00100000:3.0:1788391296.976434:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508096 00000100:00100000:3.0:1788391296.976471:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788391296.976480:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103508096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391296.976506:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391296.977597:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103508096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1115us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391296.977605:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788391296.977637:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103508096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788391297.997366:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391297.997495:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391297.997516:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391297.997782:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391297.997883:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508224 00000100:00100000:2.0:1788391297.997891:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508224 00000100:00100000:2.0:1788391297.997946:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788391297.997956:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103508224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391297.998191:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391297.998292:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103508224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 338us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391297.998299:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788391298.000770:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103508224:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788391298.323020:0:48520:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391298.323031:0:48520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391298.323091:0:48520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391298.323097:0:48520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391298.679592:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391298.679651:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391298.679723:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343808 00000100:00100000:1.0:1788391298.679733:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343808 00000100:00100000:1.0:1788391298.679793:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1788391298.679801:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094343808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391298.679861:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094343808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391298.679867:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00080000:2.0:1788391298.679868:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391298.680593:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343680 00000100:00100000:3.0:1788391298.680600:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343680 00000100:00100000:3.0:1788391298.680643:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1788391298.680653:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094343680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391298.680720:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094343680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391298.680727:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:0.0:1788391298.683747:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391298.683784:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391298.683817:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391298.683832:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344064 00000100:00100000:2.0:1788391298.683840:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344064 00000100:00080000:0.0:1788391298.683876:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391298.683888:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344192 00000100:00100000:1.0:1788391298.683894:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344192 00000100:00100000:1.0:1788391298.684095:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:1.0:1788391298.684105:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094344192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391298.684139:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094343936 00000100:00100000:3.0:1788391298.684145:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094343936 00000100:00100000:1.0:1788391298.684179:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094344192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391298.684187:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1788391298.684189:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1788391298.684196:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:3.0:1788391298.684201:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094343936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391298.684209:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094344064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391298.684238:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094343936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391298.684245:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094344064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391298.684251:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:2.0:1788391298.684258:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00080000:0.0:1788391298.684316:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391298.684321:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788391299.025846:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391299.805357:0:48571:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391299.805366:0:48571:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391299.805414:0:48571:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391299.805420:0:48571:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391300.046596:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391301.069058:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391301.196003:0:48622:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391301.196011:0:48622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391301.196063:0:48622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391301.196068:0:48622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1788391301.389277:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391301.389286:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391301.389321:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391301.389330:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391302.093693:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391302.093722:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391302.093741:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103508480:0@lo:400:kworker.0 00000100:00100000:0.0:1788391302.093772:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103508736:0@lo:400:kworker.0 00000100:00100000:3.0:1788391302.093807:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391302.093820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391302.093874:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391302.093881:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103508608:0@lo:400:kworker.0 00000100:00100000:0.0:1788391302.093914:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508736 00000100:00100000:0.0:1788391302.093934:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508736 00000100:00100000:1.0:1788391302.093954:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103509120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391302.093986:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103508352:0@lo:400:kworker.0 00000100:00100000:0.0:1788391302.094005:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788391302.094014:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.094025:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391302.094031:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391302.094083:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103508992:0@lo:400:kworker.0 00000100:00100000:0.0:1788391302.094094:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103508736:12345-0@lo:400:kworker.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391302.094096:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509120 00000100:00100000:1.0:1788391302.094102:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509120 00000100:00100000:0.0:1788391302.094104:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788391302.094123:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391302.094134:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103508864:0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.094145:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788391302.094155:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f7ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103509120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391302.094170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391302.094172:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508352 00000100:00100000:3.0:1788391302.094177:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508352 00002000:00000024:1.0:1788391302.094186:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391302.094216:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788391302.094220:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391302.094228:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103508352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.094233:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f7ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103509120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391302.094242:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788391302.094287:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103508352:12345-0@lo:400:kworker.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391302.094295:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788391302.094368:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103508352:0@lo:400:kworker.0 00000100:00100000:3.0:1788391302.094437:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508992 00000100:00100000:3.0:1788391302.094440:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508992 00000100:00100000:1.0:1788391302.094470:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508864 00000100:00100000:1.0:1788391302.094476:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508864 00000100:00100000:3.0:1788391302.094484:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788391302.094493:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103508992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.094504:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788391302.094526:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103508864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391302.094540:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103508992:12345-0@lo:400:kworker.0 Request processed in 49us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391302.094545:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788391302.094561:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391302.094564:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391302.094578:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103508864:12345-0@lo:400:kworker.0 Request processed in 53us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391302.094586:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788391302.094596:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103508992:0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.094624:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103508864:0@lo:400:kworker.0 00000100:00100000:3.0:1788391302.094646:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d585a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103509120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391302.095351:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103508736:0@lo:400:kworker.0 00000100:00100000:2.0:1788391302.096569:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508480 00000100:00100000:2.0:1788391302.096579:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508480 00000100:00100000:2.0:1788391302.096655:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103508608 00000100:00100000:2.0:1788391302.096658:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103508608 00000100:00100000:2.0:1788391302.096699:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788391302.096709:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103508480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391302.096741:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788391302.096752:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103508608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391302.096785:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103508480:12345-0@lo:400:kworker.0 Request processed in 77us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391302.096793:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788391302.096806:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103508608:12345-0@lo:400:kworker.0 Request processed in 55us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391302.096815:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788391302.096841:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103508480:0@lo:400:kworker.0 00000100:00080000:0.0:1788391302.096993:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391302.097019:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103508608:0@lo:400:kworker.0 00000040:00080000:0.0:1788391302.648782:0:48673:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391302.648792:0:48673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391302.648841:0:48673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391302.648847:0:48673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391303.117112:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391303.117223:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103509248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391303.117293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391303.117808:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509248 00000100:00100000:1.0:1788391303.117815:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509248 00000100:00100000:1.0:1788391303.117882:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788391303.117888:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103509248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391303.117917:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391303.117990:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103509248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391303.117998:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788391303.118077:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103509248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391303.796917:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391303.796997:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344320 00000100:00100000:3.0:1788391303.797008:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344320 00000100:00100000:3.0:1788391303.797068:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:3.0:1788391303.797080:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094344320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391303.797108:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391303.797148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391303.797168:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094344320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391303.797177:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:2.0:1788391303.797189:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344448 00000100:00100000:2.0:1788391303.797195:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344448 00000100:00100000:3.0:1788391303.797230:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344576 00000100:00100000:3.0:1788391303.797236:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344576 00000100:00100000:2.0:1788391303.797254:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:2.0:1788391303.797268:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094344448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391303.797271:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788391303.797283:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391303.797286:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344704 00000100:00100000:3.0:1788391303.797291:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344704 00000100:00080000:0.0:1788391303.797292:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391303.797310:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:0.0:1788391303.797312:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391303.797334:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344832 00000100:00100000:0.0:1788391303.797339:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344832 00000100:00100000:1.0:1788391303.797348:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:1.0:1788391303.797360:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094344576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391303.797382:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1788391303.797394:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1788391303.797396:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094344704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391303.797406:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094344576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391303.797410:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d585a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094344832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391303.797419:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1788391303.797436:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094344704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391303.797471:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00080000:1.0:1788391303.797520:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391303.797528:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094344832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391303.797537:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391303.797614:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d585a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094344448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 351us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391303.797623:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00010000:00010000:2.0:1788391304.141081:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391304.156310:0:48724:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391304.156319:0:48724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391304.156368:0:48724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1788391304.156374:0:48724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391305.165640:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391305.636857:0:48776:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391305.636865:0:48776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391305.636908:0:48776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391305.636913:0:48776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391306.189108:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391307.137751:0:48827:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391307.137761:0:48827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391307.137810:0:48827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1788391307.137816:0:48827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391307.213118:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391307.213139:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103509376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391307.213207:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391307.213310:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509376 00000100:00100000:3.0:1788391307.213318:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509376 00000100:00100000:3.0:1788391307.213384:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788391307.213397:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103509376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391307.213434:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391307.213441:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103509888:0@lo:400:kworker.0 00000100:00100000:3.0:1788391307.213505:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103509376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391307.213513:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391307.213518:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788391307.213544:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391307.213582:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788391307.213589:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103509504:0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.213639:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391307.213645:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391307.213679:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103510016:0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.213711:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391307.213755:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103509632:0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.213784:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391307.213810:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391307.213816:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103509760:0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.213840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391307.213873:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509888 00000100:00100000:0.0:1788391307.213876:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510016 00000100:00100000:2.0:1788391307.213879:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509888 00000100:00100000:0.0:1788391307.213882:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510016 00000100:00100000:2.0:1788391307.213928:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509760 00000100:00100000:2.0:1788391307.213931:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509760 00000100:00100000:2.0:1788391307.213947:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788391307.213955:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103509888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391307.214028:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103509888:12345-0@lo:400:kworker.0 Request processed in 75us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391307.214035:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788391307.214048:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788391307.214054:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103509760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391307.214082:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103509760:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391307.214088:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788391307.214113:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bbcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103509376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391307.214120:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103509760:0@lo:400:kworker.0 00000100:00100000:2.0:1788391307.214154:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103509888:0@lo:400:kworker.0 00000100:00100000:1.0:1788391307.214159:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509632 00000100:00100000:1.0:1788391307.214164:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509632 00000100:00100000:1.0:1788391307.215392:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788391307.215402:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103509632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.215660:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788391307.215669:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103510016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391307.215712:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103510016:12345-0@lo:400:kworker.0 Request processed in 45us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391307.215717:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788391307.215756:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103510016:0@lo:400:kworker.0 00000100:00080000:3.0:1788391307.215989:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391307.215995:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391307.216037:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103509504 00000100:00100000:3.0:1788391307.216042:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103509504 00000100:00100000:3.0:1788391307.216081:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788391307.216091:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103509504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391307.216134:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103509504:12345-0@lo:400:kworker.0 Request processed in 47us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391307.216140:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788391307.218609:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103509504:0@lo:400:kworker.0 00000100:00100000:1.0:1788391307.219011:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103509632:12345-0@lo:400:kworker.0 Request processed in 3603us (5217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391307.219022:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788391307.219078:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103509632:0@lo:400:kworker.0 00000100:00100000:3.0:1788391308.237530:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391308.237552:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391308.237635:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391308.237701:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510144 00000100:00100000:3.0:1788391308.237709:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510144 00000100:00100000:3.0:1788391308.237766:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788391308.237776:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391308.237809:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391308.237852:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391308.237859:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788391308.237917:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103510144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788391308.238600:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391308.630232:0:48878:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391308.630242:0:48878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391308.630295:0:48878:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1788391308.630301:0:48878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391308.920642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391308.920674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391308.920695:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391308.920787:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391308.920853:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345088 00000100:00100000:2.0:1788391308.920864:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345088 00000100:00100000:2.0:1788391308.920926:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1788391308.920938:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094345088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391308.921043:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094345088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 108us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391308.921050:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:3.0:1788391308.921090:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094344960 00000100:00100000:3.0:1788391308.921094:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094344960 00000100:00100000:3.0:1788391308.921121:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1788391308.921129:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094344960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391308.921159:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094344960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391308.921165:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00080000:3.0:1788391308.921207:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391308.921211:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391308.921412:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345472 00000100:00100000:2.0:1788391308.921417:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345472 00000100:00100000:0.0:1788391308.921453:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345216 00000100:00100000:2.0:1788391308.921459:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:0.0:1788391308.921460:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345216 00000100:00100000:2.0:1788391308.921469:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094345472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391308.921472:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345344 00000100:00100000:1.0:1788391308.921477:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345344 00000100:00100000:0.0:1788391308.921506:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1788391308.921511:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788391308.921514:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094345216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391308.921518:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094345344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391308.921550:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094345344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391308.921557:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1788391308.921575:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bbcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094345216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 63us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391308.921582:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00080000:0.0:1788391308.921628:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391308.921631:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391308.921633:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391308.921759:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094345472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 290us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391308.921768:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00010000:00010000:2.0:1788391309.261132:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391310.134787:0:48929:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391310.134803:0:48929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391310.134865:0:48929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1788391310.134873:0:48929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391310.285225:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391311.309221:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391311.629162:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391311.629171:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391311.631645:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391311.631659:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1788391311.676265:0:48980:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391311.676273:0:48980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391311.676316:0:48980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1788391311.676322:0:48980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391312.333081:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391312.333136:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103510656:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.333136:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103510400:0@lo:400:kworker.0 00000100:00100000:3.0:1788391312.333244:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68f55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391312.334823:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391312.334890:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510400 00000100:00100000:1.0:1788391312.334895:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103510912:0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.334901:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510400 00000100:00100000:1.0:1788391312.334933:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391312.334978:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788391312.334985:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103510528:0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.334995:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788391312.335008:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103510400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.335017:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391312.335037:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103511040:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.335066:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391312.335094:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103510400:12345-0@lo:400:kworker.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391312.335102:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788391312.335107:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103510400:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.335142:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510912 00000100:00100000:1.0:1788391312.335146:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510912 00000100:00100000:0.0:1788391312.335162:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510528 00000100:00100000:0.0:1788391312.335168:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510528 00000100:00100000:1.0:1788391312.335200:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511040 00000100:00100000:1.0:1788391312.335205:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511040 00000100:00100000:2.0:1788391312.335210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391312.335224:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510656 00000100:00100000:0.0:1788391312.335231:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510656 00000100:00100000:1.0:1788391312.335240:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788391312.335250:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103510912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391312.335268:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788391312.335270:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788391312.335283:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103511040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.335284:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58af8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103510528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.335295:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103510912:12345-0@lo:400:kworker.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391312.335302:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788391312.335326:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391312.335330:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391312.335332:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391312.335344:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788391312.335351:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391312.336250:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103511040:12345-0@lo:400:kworker.0 Request processed in 972us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391312.336258:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788391312.336472:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391312.336488:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58af8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103510528:12345-0@lo:400:kworker.0 Request processed in 1199us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391312.336499:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788391312.336509:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103510784:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.336544:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103510656:12345-0@lo:400:kworker.0 Request processed in 1191us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391312.336549:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391312.336568:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103510528:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.336573:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788391312.336588:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103511040:0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.336603:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d687863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103510912:0@lo:400:kworker.0 00000100:00100000:1.0:1788391312.336609:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510784 00000100:00100000:1.0:1788391312.336614:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510784 00000100:00100000:0.0:1788391312.336649:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103510272 00000100:00100000:0.0:1788391312.336654:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103510272 00000100:00100000:1.0:1788391312.336658:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788391312.336677:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103510784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.336690:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788391312.336702:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103510272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391312.336725:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103510784:12345-0@lo:400:kworker.0 Request processed in 58us (177us total) trans 0 rc 0/0 00002000:00000024:0.0:1788391312.336730:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391312.336735:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788391312.336777:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103510272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391312.336781:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691118a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103510784:0@lo:400:kworker.0 00000100:00100000:0.0:1788391312.336791:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788391312.336812:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68f55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391312.337144:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103510656:0@lo:400:kworker.0 00000040:00080000:1.0:1788391313.115275:0:49033:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391313.115285:0:49033:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391313.115331:0:49033:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:1.0:1788391313.115337:0:49033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391313.357148:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391313.357435:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103511168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391313.357503:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391313.357649:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511168 00000100:00100000:0.0:1788391313.357657:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511168 00000100:00100000:0.0:1788391313.357705:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788391313.357714:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103511168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391313.357745:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391313.357958:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103511168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391313.358030:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788391313.358460:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103511168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391314.040915:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391314.041075:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391314.041102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391314.041190:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345728 00000100:00100000:1.0:1788391314.041199:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345728 00000100:00100000:1.0:1788391314.041267:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:1.0:1788391314.041278:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094345728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391314.041349:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094345728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391314.041355:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1788391314.041709:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345984 00000100:00100000:2.0:1788391314.041715:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345984 00000100:00100000:2.0:1788391314.041755:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1788391314.041763:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094345984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391314.041843:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345600 00000100:00100000:3.0:1788391314.041848:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345600 00000100:00100000:1.0:1788391314.041868:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391314.041886:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1788391314.041893:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094345600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391314.041894:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391314.041911:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094345856 00000100:00100000:1.0:1788391314.041914:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094345856 00000100:00100000:3.0:1788391314.041926:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094345600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391314.041932:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:1.0:1788391314.041938:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391314.041944:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094345856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391314.041992:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094345856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391314.041999:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1788391314.042015:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346112 00000100:00100000:1.0:1788391314.042019:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346112 00000100:00100000:1.0:1788391314.042051:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1788391314.042057:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094346112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391314.042082:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094346112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391314.042088:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:2.0:1788391314.042688:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d687863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094345984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 924us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391314.042697:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00080000:0.0:1788391314.043259:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391314.043265:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391314.043268:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788391314.382649:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391314.598496:0:49084:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391314.598507:0:49084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391314.598554:0:49084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:1.0:1788391314.598560:0:49084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391315.405108:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391316.073210:0:49135:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391316.073219:0:49135:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391316.073258:0:49135:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391316.073265:0:49135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391316.429120:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391317.453232:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103511296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391317.453301:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391317.453491:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511296 00000100:00100000:0.0:1788391317.453498:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511296 00000100:00100000:0.0:1788391317.453565:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788391317.453577:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103511296:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788391317.453608:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1788391317.453610:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391317.453661:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103511296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391317.453671:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788391317.453703:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391317.453723:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103511296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391317.454392:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103511424:0@lo:400:kworker.0 00000100:00100000:0.0:1788391317.454427:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391317.454527:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511424 00000100:00100000:3.0:1788391317.454531:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511424 00000100:00100000:3.0:1788391317.454574:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788391317.454582:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103511424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.454778:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103511552:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.454810:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391317.454831:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391317.454837:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103511936:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.454862:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391317.454890:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511552 00000100:00100000:2.0:1788391317.454894:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511552 00000100:00100000:2.0:1788391317.454929:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788391317.454935:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103511552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455103:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103511552:12345-0@lo:400:kworker.0 Request processed in 166us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391317.455111:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788391317.455133:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511936 00000100:00100000:2.0:1788391317.455137:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511936 00000100:00100000:2.0:1788391317.455163:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788391317.455169:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103511936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455199:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103511936:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391317.455205:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788391317.455224:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391317.455228:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391317.455236:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103511680:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455260:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391317.455278:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391317.455283:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103511808:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455303:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391317.455325:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511680 00000100:00100000:2.0:1788391317.455328:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511680 00000100:00100000:2.0:1788391317.455347:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103511808 00000100:00100000:2.0:1788391317.455350:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103511808 00000100:00100000:2.0:1788391317.455387:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788391317.455394:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103511680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455426:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103511680:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391317.455432:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788391317.455442:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788391317.455448:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103511808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455472:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103511808:12345-0@lo:400:kworker.0 Request processed in 25us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391317.455478:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1788391317.455496:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391317.455518:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103511808:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455530:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103511680:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455569:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103511936:0@lo:400:kworker.0 00000100:00100000:2.0:1788391317.455580:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103511552:0@lo:400:kworker.0 00000100:00100000:3.0:1788391317.455667:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103511424:12345-0@lo:400:kworker.0 Request processed in 1085us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391317.455674:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788391317.455838:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103511424:0@lo:400:kworker.0 00000040:00080000:3.0:1788391317.510307:0:49186:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391317.510317:0:49186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391317.510378:0:49186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:3.0:1788391317.510384:0:49186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391318.477307:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391318.477425:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103512064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391318.477494:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391318.477674:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512064 00000100:00100000:0.0:1788391318.477681:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512064 00000100:00100000:0.0:1788391318.477744:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788391318.477755:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103512064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391318.477789:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391318.478213:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103512064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 459us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391318.478221:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788391318.478384:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d691830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103512064:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788391318.889151:0:49237:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391318.889159:0:49237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391318.889276:0:49237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1788391318.889282:0:49237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391319.156996:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391319.157047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391319.157092:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391319.157125:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391319.157166:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391319.157209:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346496 00000100:00100000:1.0:1788391319.157219:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346496 00000100:00100000:1.0:1788391319.157289:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346624 00000100:00100000:1.0:1788391319.157293:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346624 00000100:00100000:1.0:1788391319.157321:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:1.0:1788391319.157345:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094346496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391319.157428:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094346496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391319.157437:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:1.0:1788391319.157453:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:1.0:1788391319.157459:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094346624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391319.157480:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094346624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391319.157486:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:1.0:1788391319.157502:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346368 00000100:00100000:1.0:1788391319.157505:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346368 00000100:00100000:1.0:1788391319.157527:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346752 00000100:00100000:1.0:1788391319.157529:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346752 00000100:00100000:1.0:1788391319.157543:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788391319.157548:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094346368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391319.157575:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094346368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391319.157581:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788391319.157593:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:1.0:1788391319.157599:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094346752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391319.157623:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094346752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391319.157629:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00080000:1.0:1788391319.157645:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391319.157650:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391319.157652:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391319.158242:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346240 00000100:00100000:0.0:1788391319.158248:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346240 00000100:00100000:0.0:1788391319.158294:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1788391319.158303:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094346240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391319.158343:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094346240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391319.158349:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00010000:00010000:3.0:1788391319.501437:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391320.371619:0:49289:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391320.371627:0:49289:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391320.371656:0:49289:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391320.371660:0:49289:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391320.528693:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391321.551236:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391321.852648:0:49341:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391321.852656:0:49341:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391321.852703:0:49341:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1788391321.852709:0:49341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1788391321.869356:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391321.869361:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391321.869389:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391321.869395:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391322.573155:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391322.573157:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391322.573192:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5866a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103512192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391322.573265:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391322.573504:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512192 00000100:00100000:0.0:1788391322.573513:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512192 00000100:00100000:0.0:1788391322.573636:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788391322.573647:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103512192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391322.573681:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391322.573736:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103512192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391322.573744:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788391322.573782:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5866a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103512192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391322.573808:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103512320:0@lo:400:kworker.0 00000100:00100000:0.0:1788391322.573818:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103512448:0@lo:400:kworker.0 00000100:00100000:1.0:1788391322.573831:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103512576:0@lo:400:kworker.0 00000100:00100000:3.0:1788391322.573851:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391322.573860:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391322.573885:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391322.573891:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103512832:0@lo:400:kworker.0 00000100:00100000:0.0:1788391322.573908:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512448 00000100:00100000:0.0:1788391322.573913:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512448 00000100:00100000:3.0:1788391322.573921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391322.573928:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512576 00000100:00100000:1.0:1788391322.573933:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512576 00000100:00100000:3.0:1788391322.573955:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391322.573989:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512832 00000100:00100000:1.0:1788391322.573994:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512832 00000100:00100000:3.0:1788391322.573998:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103512704:0@lo:400:kworker.0 00000100:00100000:3.0:1788391322.574024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391322.574051:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512320 00000100:00100000:3.0:1788391322.574055:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512320 00000100:00100000:3.0:1788391322.574083:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788391322.574090:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103512320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391322.574124:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103512320:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391322.574131:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788391322.574155:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512704 00000100:00100000:3.0:1788391322.574159:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512704 00000100:00080000:2.0:1788391322.574191:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391322.574196:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391322.574197:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391322.574231:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788391322.574240:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391322.574282:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103512576:12345-0@lo:400:kworker.0 Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391322.574289:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788391322.574331:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103512320:0@lo:400:kworker.0 00000100:00100000:0.0:1788391322.574698:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788391322.574705:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103512448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391322.574756:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788391322.574763:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788391322.574768:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391322.574775:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103512704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391322.577166:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103512704:12345-0@lo:400:kworker.0 Request processed in 2384us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391322.577166:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103512448:12345-0@lo:400:kworker.0 Request processed in 2452us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391322.577182:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788391322.577184:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788391322.577244:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d691830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103512832:12345-0@lo:400:kworker.0 Request processed in 2479us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391322.577246:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103512704:0@lo:400:kworker.0 00000100:00100000:0.0:1788391322.577246:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103512448:0@lo:400:kworker.0 00000100:00100000:1.0:1788391322.577256:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788391322.577271:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788391322.577312:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103512576:0@lo:400:kworker.0 00000040:00080000:3.0:1788391323.285989:0:49393:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391323.286000:0:49393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391323.286046:0:49393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:3.0:1788391323.286051:0:49393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391323.599121:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391323.599567:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391323.599587:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391323.599655:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391323.599784:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103512960 00000100:00100000:3.0:1788391323.599792:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103512960 00000100:00100000:3.0:1788391323.599848:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788391323.599858:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103512960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391323.599907:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391323.600091:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103512960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391323.600099:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788391323.600216:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391324.278012:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391324.278127:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391324.278188:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347264 00000100:00100000:1.0:1788391324.278198:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347264 00000100:00100000:1.0:1788391324.278345:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:1.0:1788391324.278357:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094347264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391324.278437:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094347264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391324.278445:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1788391324.278515:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347008 00000100:00100000:2.0:1788391324.278521:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347008 00000100:00080000:3.0:1788391324.278546:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391324.278553:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391324.278610:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391324.278638:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094346880 00000100:00100000:0.0:1788391324.278641:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094346880 00000100:00100000:0.0:1788391324.278661:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1788391324.278666:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094346880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391324.278681:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:2.0:1788391324.278693:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094347008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391324.278700:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094346880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391324.278709:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:2.0:1788391324.278736:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094347008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391324.278744:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:0.0:1788391324.278785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391324.278816:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347136 00000100:00100000:0.0:1788391324.278820:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347136 00000100:00100000:0.0:1788391324.278870:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1788391324.278877:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094347136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391324.278901:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391324.278913:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094347136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391324.278941:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1788391324.279141:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347392 00000100:00100000:2.0:1788391324.279145:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347392 00000100:00080000:3.0:1788391324.279162:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391324.279167:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391324.279177:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:2.0:1788391324.279185:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094347392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391324.279317:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094347392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 131us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391324.279324:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00010000:00010000:0.0:1788391324.622336:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391324.698783:0:49444:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391324.698791:0:49444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391324.698835:0:49444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391324.698842:0:49444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391325.647617:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391326.222422:0:49495:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391326.222437:0:49495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391326.222494:0:49495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:3.0:1788391326.222501:0:49495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391326.669832:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391327.693105:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391327.693351:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103513216:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.693358:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103513472:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.693508:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391327.693594:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788391327.693603:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103513088:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.693647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391327.693674:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103513600:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.693693:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391327.693723:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513088 00000100:00100000:0.0:1788391327.693732:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513088 00000100:00100000:0.0:1788391327.693806:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788391327.693816:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391327.693847:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103513344:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.693871:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103513088:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391327.693881:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788391327.693941:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103513088:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.694007:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513472 00000100:00100000:0.0:1788391327.694010:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513472 00000100:00100000:0.0:1788391327.694042:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513600 00000100:00100000:0.0:1788391327.694046:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513600 00000100:00100000:1.0:1788391327.694086:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391327.694087:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788391327.694099:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103513472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694114:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103513728:0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694144:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391327.694153:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103513472:12345-0@lo:400:kworker.0 Request processed in 57us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391327.694168:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788391327.694184:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513216 00000100:00100000:0.0:1788391327.694185:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513728 00000100:00100000:0.0:1788391327.694190:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513728 00000100:00100000:1.0:1788391327.694192:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513216 00000100:00100000:0.0:1788391327.694211:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788391327.694218:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103513600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694239:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391327.694256:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103513216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.694257:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103513600:12345-0@lo:400:kworker.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391327.694282:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788391327.694304:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788391327.694314:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103513728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391327.694402:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391327.694403:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103513216:12345-0@lo:400:kworker.0 Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391327.694413:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391327.694455:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103513216:0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694510:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103513600:0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694522:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103513472:0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694604:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513344 00000100:00100000:1.0:1788391327.694610:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513344 00000100:00100000:1.0:1788391327.694646:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788391327.694652:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103513344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391327.694702:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103513344:12345-0@lo:400:kworker.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391327.694709:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788391327.694745:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103513344:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.694794:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103513728:12345-0@lo:400:kworker.0 Request processed in 482us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391327.694800:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788391327.694872:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103513856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391327.694889:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103513728:0@lo:400:kworker.0 00000100:00100000:0.0:1788391327.694900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391327.694930:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513856 00000100:00100000:1.0:1788391327.694935:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513856 00000100:00100000:1.0:1788391327.694994:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788391327.695003:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103513856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391327.695038:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391327.695084:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103513856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391327.695091:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788391327.695125:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103513856:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788391327.695288:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391327.695296:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391327.695300:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788391327.818640:0:49547:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391327.818652:0:49547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391327.818734:0:49547:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1788391327.818740:0:49547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391328.717317:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391328.717554:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391328.717640:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391328.717907:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103513984 00000100:00100000:0.0:1788391328.717916:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103513984 00000100:00100000:0.0:1788391328.718046:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788391328.718059:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103513984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391328.718109:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391328.718180:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103513984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391328.718195:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788391328.718291:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103513984:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788391329.340782:0:49598:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391329.340790:0:49598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391329.340822:0:49598:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391329.340828:0:49598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391329.401129:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391329.401171:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391329.401191:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391329.401210:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391329.401241:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391329.401293:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348032 00000100:00100000:0.0:1788391329.401302:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348032 00000100:00100000:0.0:1788391329.401351:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347648 00000100:00100000:0.0:1788391329.401353:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347648 00000100:00100000:0.0:1788391329.401382:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:0.0:1788391329.401393:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094348032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391329.401461:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094348032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391329.401468:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:0.0:1788391329.401486:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1788391329.401493:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094347648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391329.401514:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094347648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391329.401520:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1788391329.401652:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347776 00000100:00100000:0.0:1788391329.401656:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347776 00000100:00100000:0.0:1788391329.401682:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347904 00000100:00100000:0.0:1788391329.401693:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347904 00000100:00100000:0.0:1788391329.401717:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788391329.401724:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094347776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391329.401749:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094347776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391329.401754:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1788391329.401764:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1788391329.401769:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094347904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391329.401786:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094347904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 18us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391329.401790:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1788391329.402038:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094347520 00000100:00100000:3.0:1788391329.402043:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094347520 00000100:00100000:3.0:1788391329.402075:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:3.0:1788391329.402083:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094347520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391329.402110:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094347520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391329.402123:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00080000:3.0:1788391329.402150:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391329.402153:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391329.402155:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788391329.741195:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391330.765080:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391330.816620:0:49649:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391330.816629:0:49649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391330.816672:0:49649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1788391330.816679:0:49649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1788391331.085408:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391331.085416:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391331.085662:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:2.0:1788391331.085669:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391331.789783:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391332.369380:0:49702:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391332.369392:0:49702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391332.369440:0:49702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:3.0:1788391332.369446:0:49702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391332.813265:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103514112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391332.813368:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391332.813529:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514112 00000100:00100000:3.0:1788391332.813541:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514112 00000100:00100000:3.0:1788391332.813639:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788391332.813652:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103514112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391332.813710:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391332.813777:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103514112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391332.813784:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788391332.813906:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788391332.813950:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391332.814062:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103514496:0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814098:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391332.814121:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391332.814126:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103514624:0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391332.814167:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514496 00000100:00100000:0.0:1788391332.814171:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514496 00000100:00100000:0.0:1788391332.814204:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514624 00000100:00100000:0.0:1788391332.814206:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514624 00000100:00100000:0.0:1788391332.814240:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788391332.814247:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814283:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103514496:12345-0@lo:400:kworker.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391332.814310:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788391332.814322:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788391332.814328:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103514624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814354:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103514624:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391332.814359:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1788391332.814385:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391332.814414:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103514624:0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814424:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103514496:0@lo:400:kworker.0 00000100:00100000:2.0:1788391332.814495:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d587135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103514240:0@lo:400:kworker.0 00000100:00100000:2.0:1788391332.814534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391332.814569:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103514752:0@lo:400:kworker.0 00000100:00100000:2.0:1788391332.814593:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391332.814613:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391332.814617:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103514368:0@lo:400:kworker.0 00000100:00100000:2.0:1788391332.814642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391332.814775:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514240 00000100:00100000:0.0:1788391332.814780:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514240 00000100:00100000:0.0:1788391332.814822:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788391332.814830:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103514240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814872:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103514240:12345-0@lo:400:kworker.0 Request processed in 43us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391332.814879:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788391332.814915:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d587135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103514240:0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.814942:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514752 00000100:00100000:0.0:1788391332.814945:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514752 00000100:00100000:0.0:1788391332.815000:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788391332.815007:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103514752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391332.815042:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103514752:12345-0@lo:400:kworker.0 Request processed in 36us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391332.815049:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788391332.815074:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391332.815093:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d682e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103514752:0@lo:400:kworker.0 00000100:00100000:1.0:1788391332.815658:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514368 00000100:00100000:1.0:1788391332.815664:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514368 00000100:00100000:1.0:1788391332.815732:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788391332.815741:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103514368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391332.815802:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103514112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391332.815806:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103514368:12345-0@lo:400:kworker.0 Request processed in 68us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391332.815812:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788391332.815882:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103514368:0@lo:400:kworker.0 00000100:00080000:0.0:1788391332.815932:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788391333.837242:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391333.838340:0:49753:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391333.838346:0:49753:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788391333.838368:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391333.838386:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103514880:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788391333.838387:0:49753:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:0.0:1788391333.838393:0:49753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391333.838562:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391333.838677:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103514880 00000100:00100000:3.0:1788391333.838683:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103514880 00000100:00100000:3.0:1788391333.838723:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788391333.838732:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103514880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391333.838773:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391333.838816:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103514880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391333.838830:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788391333.838887:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103514880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391334.518508:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391334.518563:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391334.518601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391334.518632:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391334.518661:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348416 00000100:00100000:0.0:1788391334.518668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391334.518672:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348416 00000100:00100000:1.0:1788391334.518689:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348288 00000100:00100000:0.0:1788391334.518698:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348544 00000100:00100000:0.0:1788391334.518704:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348544 00000100:00100000:1.0:1788391334.518706:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348288 00000100:00100000:3.0:1788391334.518741:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1788391334.518753:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1788391334.518754:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094348416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391334.518755:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348672 00000100:00100000:1.0:1788391334.518762:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348672 00000100:00100000:0.0:1788391334.518768:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094348544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391334.518796:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1788391334.518806:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094348288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391334.518866:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348160 00000100:00100000:2.0:1788391334.518871:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348160 00000100:00100000:2.0:1788391334.518899:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:2.0:1788391334.518906:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094348160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391334.519262:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094348544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 497us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391334.519267:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094348416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 516us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391334.519277:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1788391334.519284:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1788391334.519308:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1788391334.519318:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094348672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:3.0:1788391334.519339:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391334.519345:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391334.519348:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094348672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00080000:3.0:1788391334.519349:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391334.519357:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:1.0:1788391334.521006:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d682e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094348288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2194us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391334.521019:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:2.0:1788391334.521034:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094348160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2125us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391334.521044:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00010000:00010000:0.0:1788391334.861320:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391335.281679:0:49805:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391335.281688:0:49805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391335.281725:0:49805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:1.0:1788391335.281731:0:49805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391335.886823:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391336.748162:0:49856:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391336.748172:0:49856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391336.748229:0:49856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:3.0:1788391336.748235:0:49856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391336.909347:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391337.933451:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391337.933854:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391337.933921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391337.934058:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515008 00000100:00100000:3.0:1788391337.934066:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515008 00000100:00100000:3.0:1788391337.934124:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788391337.934135:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391337.934168:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391337.934684:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 548us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391337.934693:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788391337.934704:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103515008:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788391337.934727:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391337.934763:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103515136:0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.934793:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103515264:0@lo:400:kworker.0 00000100:00100000:0.0:1788391337.934801:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391337.934825:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103515392:0@lo:400:kworker.0 00000100:00100000:0.0:1788391337.934833:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103515648:0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.934840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391337.935431:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391337.935434:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515264 00000100:00100000:1.0:1788391337.935440:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515264 00000100:00100000:3.0:1788391337.935475:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515392 00000100:00100000:3.0:1788391337.935480:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515392 00000100:00100000:3.0:1788391337.935514:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788391337.935523:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103515392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.935533:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788391337.935543:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103515264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391337.935663:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103515392:12345-0@lo:400:kworker.0 Request processed in 141us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391337.935671:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788391337.935701:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103515264:12345-0@lo:400:kworker.0 Request processed in 160us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391337.935709:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788391337.935712:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103515392:0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.935750:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103515520:0@lo:400:kworker.0 00000100:00100000:3.0:1788391337.935758:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515136 00000100:00100000:3.0:1788391337.935763:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515136 00000100:00100000:1.0:1788391337.935784:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391337.935790:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788391337.935797:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103515136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.935820:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515520 00000100:00100000:1.0:1788391337.935826:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515520 00000100:00100000:3.0:1788391337.935835:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103515136:12345-0@lo:400:kworker.0 Request processed in 38us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391337.935844:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788391337.935881:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788391337.935886:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103515520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391337.935910:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103515520:12345-0@lo:400:kworker.0 Request processed in 25us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391337.935914:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788391337.936008:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103515264:0@lo:400:kworker.0 00000100:00100000:1.0:1788391337.936032:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103515520:0@lo:400:kworker.0 00000100:00080000:1.0:1788391337.936054:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391337.936058:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391337.938273:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391337.938503:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103515136:0@lo:400:kworker.0 00000100:00100000:3.0:1788391337.938698:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515648 00000100:00100000:3.0:1788391337.938711:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515648 00000100:00100000:3.0:1788391337.938767:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788391337.938774:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103515648:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788391337.938801:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391337.938844:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103515648:12345-0@lo:400:kworker.0 Request processed in 71us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391337.938850:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788391337.938881:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103515648:0@lo:400:kworker.0 00000040:00080000:2.0:1788391338.171951:0:49907:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391338.173045:0:49907:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391338.173105:0:49907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:2.0:1788391338.173111:0:49907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391338.957259:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103515776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391338.957333:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391338.958357:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515776 00000100:00100000:3.0:1788391338.958367:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515776 00000100:00100000:3.0:1788391338.958424:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788391338.958436:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103515776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391338.958472:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00010000:00010000:0.0:1788391338.958536:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391338.958537:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103515776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391338.958547:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788391338.958678:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103515776:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788391339.594195:0:49958:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391339.594204:0:49958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391339.594247:0:49958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:1.0:1788391339.594252:0:49958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391339.636938:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391339.637059:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348800 00000100:00100000:2.0:1788391339.637069:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348800 00000100:00100000:0.0:1788391339.637227:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391339.637251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391339.637269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391339.637304:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391339.637327:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349056 00000100:00100000:0.0:1788391339.637331:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349056 00000100:00100000:0.0:1788391339.637368:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349184 00000100:00100000:0.0:1788391339.637371:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349184 00000100:00100000:0.0:1788391339.637398:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788391339.637409:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094349056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391339.637473:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094349056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391339.637481:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1788391339.637497:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1788391339.637504:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094349184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391339.637527:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094349184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391339.637543:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1788391339.637562:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094348928 00000100:00100000:0.0:1788391339.637566:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094348928 00000100:00100000:0.0:1788391339.637588:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349312 00000100:00100000:0.0:1788391339.637592:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349312 00000100:00100000:0.0:1788391339.637612:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:0.0:1788391339.637619:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094348928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391339.637647:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094348928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391339.637653:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:0.0:1788391339.637664:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:0.0:1788391339.637671:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094349312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391339.637693:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094349312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391339.637699:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:2.0:1788391339.637864:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:2.0:1788391339.637873:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094348800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391339.637911:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094348800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391339.637917:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00080000:1.0:1788391339.638272:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391339.638276:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391339.638278:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788391339.981506:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391341.005367:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391341.074027:0:50010:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391341.074036:0:50010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391341.074082:0:50010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 2 00000040:00080000:1.0:1788391341.074089:0:50010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:3.0:1788391341.325281:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391341.325291:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391341.325537:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 13 count 1 00000040:00080000:3.0:1788391341.325543:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391342.029155:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391342.475804:0:50061:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391342.475814:0:50061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391342.476394:0:50061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391342.476403:0:50061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391343.053239:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103515904:0@lo:400:kworker.0 00000100:00100000:2.0:1788391343.053280:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103516288:0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053310:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103516160:0@lo:400:kworker.0 00000100:00100000:0.0:1788391343.053340:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391343.053355:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391343.053363:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391343.053380:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053383:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391343.053403:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103516416:0@lo:400:kworker.0 00000100:00100000:1.0:1788391343.053426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391343.053437:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391343.053439:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516160 00000100:00100000:2.0:1788391343.053448:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516160 00000100:00100000:1.0:1788391343.053456:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103516544:0@lo:400:kworker.0 00000100:00100000:0.0:1788391343.053478:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516032 00000100:00100000:0.0:1788391343.053484:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516032 00000100:00100000:3.0:1788391343.053489:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516288 00000100:00100000:1.0:1788391343.053489:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391343.053495:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516288 00000100:00080000:1.0:1788391343.053532:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391343.053533:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1788391343.053539:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391343.053542:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516416 00000100:00100000:0.0:1788391343.053544:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788391343.053548:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103516160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053549:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516416 00000100:00100000:1.0:1788391343.053555:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516544 00000100:00100000:0.0:1788391343.053558:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103516032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391343.053561:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516544 00000100:00100000:3.0:1788391343.053594:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788391343.053603:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103516288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391343.053612:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788391343.053625:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103516416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391343.053625:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103516032:12345-0@lo:400:kworker.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391343.053643:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788391343.053671:0:43348:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788391343.053677:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103516288:12345-0@lo:400:kworker.0 Request processed in 73us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391343.053681:0:43348:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788391343.053687:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103516416:12345-0@lo:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391343.053693:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788391343.053702:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788391343.053709:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788391343.053717:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053744:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103515904 00000100:00100000:3.0:1788391343.053749:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103515904 00000100:00100000:2.0:1788391343.053764:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103516160:12345-0@lo:400:kworker.0 Request processed in 219us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391343.053769:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103516544:12345-0@lo:400:kworker.0 Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391343.053775:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788391343.053781:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788391343.053799:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788391343.053809:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103515904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788391343.053835:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391343.053853:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68a750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103515904:12345-0@lo:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391343.053861:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788391343.053887:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103516288:0@lo:400:kworker.0 00000100:00100000:1.0:1788391343.053888:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053899:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103516672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391343.053915:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103516544:0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.053931:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391343.053957:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103516416:0@lo:400:kworker.0 00000100:00100000:1.0:1788391343.053995:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103515904:0@lo:400:kworker.0 00000100:00100000:3.0:1788391343.054002:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103516160:0@lo:400:kworker.0 00000100:00100000:2.0:1788391343.054017:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516672 00000100:00100000:2.0:1788391343.054023:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516672 00000100:00100000:2.0:1788391343.054068:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788391343.054075:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103516672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391343.054112:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391343.054163:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103516672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391343.054169:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788391343.054531:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103516672:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788391344.040818:0:50115:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391344.040824:0:50115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391344.041353:0:50115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391344.041361:0:50115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391344.077147:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391344.077156:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391344.077290:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391344.077656:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516800 00000100:00100000:1.0:1788391344.077665:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516800 00000100:00100000:1.0:1788391344.077718:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788391344.077729:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103516800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391344.077764:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391344.077822:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103516800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391344.077829:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788391344.077876:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391344.762022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391344.762144:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391344.762175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391344.762212:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391344.762227:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349440 00000100:00100000:2.0:1788391344.762238:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349440 00000100:00100000:2.0:1788391344.762293:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1788391344.762305:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094349440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391344.762308:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349696 00000100:00100000:1.0:1788391344.762314:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349696 00000100:00100000:1.0:1788391344.762368:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:1.0:1788391344.762378:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094349696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391344.762389:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094349440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391344.762398:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:1.0:1788391344.762413:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094349696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391344.762418:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00080000:2.0:1788391344.762457:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391344.762562:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349568 00000100:00100000:3.0:1788391344.762568:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349568 00000100:00080000:2.0:1788391344.762612:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391344.762614:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349952 00000100:00100000:3.0:1788391344.762619:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349952 00000100:00080000:2.0:1788391344.762644:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391344.762653:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1788391344.762663:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094349568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391344.762672:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1788391344.762683:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094349952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391344.762721:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094349952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391344.762728:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:3.0:1788391344.762749:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094349568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 88us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391344.762770:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1788391344.762898:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391344.763003:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094349824 00000100:00100000:2.0:1788391344.763008:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094349824 00000100:00100000:2.0:1788391344.763053:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1788391344.763060:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094349824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391344.763096:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094349824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391344.763103:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00080000:3.0:1788391344.763204:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391345.101258:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391345.515175:0:50166:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391345.515184:0:50166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391345.515607:0:50166:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391345.515616:0:50166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391346.125462:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391347.012313:0:50217:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391347.012323:0:50217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391347.014899:0:50217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391347.014915:0:50217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391347.155154:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391348.173378:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391348.173401:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391348.173464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391348.173528:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103516928 00000100:00100000:3.0:1788391348.173534:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103516928 00000100:00100000:3.0:1788391348.173587:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788391348.173599:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103516928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391348.173631:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391348.173674:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103516928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391348.173682:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788391348.173702:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391348.173863:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391348.174520:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103517056:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.174565:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391348.174596:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103517568:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.174622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391348.174649:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391348.174655:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103517184:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.174678:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391348.174702:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517056 00000100:00100000:0.0:1788391348.174708:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517056 00000100:00100000:0.0:1788391348.174742:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788391348.174750:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103517056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.174787:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b642c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103517056:12345-0@lo:400:kworker.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391348.174794:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788391348.174822:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517568 00000100:00100000:0.0:1788391348.174825:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517568 00000100:00100000:0.0:1788391348.174857:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788391348.174864:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103517568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.174894:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103517568:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391348.174900:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788391348.174916:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517184 00000100:00100000:0.0:1788391348.174920:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517184 00000100:00100000:0.0:1788391348.174944:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788391348.174951:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103517184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175002:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103517184:12345-0@lo:400:kworker.0 Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391348.175008:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788391348.175025:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391348.175029:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391348.175051:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103517184:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175069:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103517056:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175078:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103517568:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175121:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103517312:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391348.175165:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391348.175170:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103517440:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391348.175213:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517312 00000100:00100000:0.0:1788391348.175217:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517312 00000100:00100000:0.0:1788391348.175236:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517440 00000100:00100000:0.0:1788391348.175239:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517440 00000100:00100000:0.0:1788391348.175259:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788391348.175265:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103517312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175296:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103517312:12345-0@lo:400:kworker.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391348.175302:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788391348.175313:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788391348.175318:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103517440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175340:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103517440:12345-0@lo:400:kworker.0 Request processed in 22us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391348.175344:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788391348.175356:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391348.175368:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103517440:0@lo:400:kworker.0 00000100:00100000:0.0:1788391348.175375:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103517312:0@lo:400:kworker.0 00010000:00010000:2.0:1788391348.176060:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391348.585144:0:50269:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391348.585153:0:50269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391348.586362:0:50269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391348.586374:0:50269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391349.197447:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103517696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391349.197519:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391349.197670:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391349.197700:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517696 00000100:00100000:1.0:1788391349.197708:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517696 00000100:00100000:1.0:1788391349.197757:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788391349.197766:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103517696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391349.197798:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391349.197926:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103517696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391349.197934:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788391349.198333:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103517696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391349.878875:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391349.878913:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391349.878942:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391349.878981:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391349.879008:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391349.879033:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350464 00000100:00100000:3.0:1788391349.879042:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350464 00000100:00100000:3.0:1788391349.879121:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350336 00000100:00100000:3.0:1788391349.879125:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350336 00000100:00100000:3.0:1788391349.879148:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:3.0:1788391349.879160:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094350464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391349.879228:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094350464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391349.879236:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:3.0:1788391349.879250:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391349.879256:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094350336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391349.879291:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094350336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391349.879296:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:3.0:1788391349.879315:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350208 00000100:00100000:3.0:1788391349.879318:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350208 00000100:00100000:3.0:1788391349.879344:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350592 00000100:00100000:3.0:1788391349.879347:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350592 00000100:00100000:3.0:1788391349.879366:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788391349.879372:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094350208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391349.879399:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094350208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391349.879405:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1788391349.879416:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:3.0:1788391349.879422:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094350592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391349.879444:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094350592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391349.879460:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00080000:3.0:1788391349.879476:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391349.879480:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391349.879482:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391349.881763:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350080 00000100:00100000:1.0:1788391349.881774:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350080 00000100:00100000:1.0:1788391349.881864:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788391349.881873:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094350080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391349.881946:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d683b61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094350080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391349.881953:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000040:00080000:1.0:1788391350.196902:0:50320:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391350.196910:0:50320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391350.197789:0:50320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391350.197800:0:50320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391350.223916:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391351.245853:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391351.566452:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391351.566462:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391351.566945:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391351.566955:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1788391351.756252:0:50371:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391351.756260:0:50371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391351.756769:0:50371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391351.756776:0:50371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391352.269122:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391353.254331:0:50422:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391353.254341:0:50422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391353.254924:0:50422:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391353.254933:0:50422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391353.294787:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391353.294809:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103517824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391353.294929:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391353.295024:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517824 00000100:00100000:3.0:1788391353.295032:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517824 00000100:00100000:3.0:1788391353.295102:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788391353.295112:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103517824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391353.295150:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391353.295197:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103517824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391353.295204:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788391353.295224:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391353.295262:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103517824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391353.296321:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391353.296336:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103518208:0@lo:400:kworker.0 00010000:00010000:2.0:1788391353.296385:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391353.296406:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103517952:0@lo:400:kworker.0 00000100:00100000:2.0:1788391353.296459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391353.296501:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391353.296505:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103518464:0@lo:400:kworker.0 00000100:00100000:2.0:1788391353.296534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391353.296553:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391353.296559:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788391353.296579:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391353.296602:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103517952 00000100:00100000:2.0:1788391353.296606:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103517952 00000100:00100000:3.0:1788391353.296632:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103518080:0@lo:400:kworker.0 00000100:00100000:2.0:1788391353.296639:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788391353.296646:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.296672:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391353.296710:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103517952:12345-0@lo:400:kworker.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391353.296719:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788391353.296729:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518208 00000100:00100000:3.0:1788391353.296734:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518208 00000100:00100000:2.0:1788391353.296767:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.296784:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518464 00000100:00100000:3.0:1788391353.296789:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518464 00000100:00100000:2.0:1788391353.296799:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518336 00000100:00100000:2.0:1788391353.296803:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518336 00000100:00100000:3.0:1788391353.296822:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788391353.296832:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103518208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391353.296837:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788391353.296847:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103518464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.296877:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103518208:12345-0@lo:400:kworker.0 Request processed in 48us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391353.296886:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788391353.296914:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788391353.296922:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103518336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.296951:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103518336:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391353.296957:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788391353.296991:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518080 00000100:00100000:3.0:1788391353.296995:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518080 00000100:00100000:2.0:1788391353.297010:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103518464:12345-0@lo:400:kworker.0 Request processed in 45us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391353.297020:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788391353.297025:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788391353.297034:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.297083:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103518080:12345-0@lo:400:kworker.0 Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391353.297087:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103518336:0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.297093:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788391353.297103:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103518464:0@lo:400:kworker.0 00000100:00080000:3.0:1788391353.297125:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391353.297130:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391353.297143:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103518208:0@lo:400:kworker.0 00000100:00100000:3.0:1788391353.297334:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103518080:0@lo:400:kworker.0 00010000:00010000:2.0:1788391354.317134:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391354.317417:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58cba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103518592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391354.317482:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391354.317603:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518592 00000100:00100000:3.0:1788391354.317611:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518592 00000100:00100000:3.0:1788391354.317660:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788391354.317669:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103518592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391354.317715:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391354.319589:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103518592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1913us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391354.319602:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788391354.319822:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58cba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103518592:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788391354.766259:0:50473:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391354.766269:0:50473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391354.766784:0:50473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391354.766792:0:50473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391354.997358:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391354.997404:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391354.997511:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391354.997532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391354.997554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391354.997604:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351232 00000100:00100000:0.0:1788391354.997613:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351232 00000100:00100000:0.0:1788391354.997656:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350848 00000100:00100000:0.0:1788391354.997658:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350848 00000100:00100000:0.0:1788391354.997679:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1788391354.997686:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094351232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391354.997757:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094351232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391354.997763:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:1.0:1788391354.997776:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350720 00000100:00100000:0.0:1788391354.997780:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1788391354.997782:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350720 00000100:00100000:0.0:1788391354.997787:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094350848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391354.997806:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094350848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391354.997810:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1788391354.997815:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:1.0:1788391354.997822:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094350720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391354.997853:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094350720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (506us total) trans 0 rc 0/0 00000100:00080000:0.0:1788391354.997856:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391354.997864:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:2.0:1788391354.998361:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094350976 00000100:00100000:2.0:1788391354.998368:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094350976 00000100:00100000:2.0:1788391354.998426:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351104 00000100:00100000:2.0:1788391354.998430:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351104 00000100:00100000:2.0:1788391354.998454:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391354.998462:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094350976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391354.998500:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094350976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391354.998507:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:2.0:1788391354.998521:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:2.0:1788391354.998528:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094351104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391354.998552:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094351104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (996us total) trans 0 rc 0/0 00000100:00080000:0.0:1788391354.998555:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391354.998559:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00080000:0.0:1788391354.998561:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788391355.341609:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391356.374721:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391356.421602:0:50525:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391356.421612:0:50525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391356.427151:0:50525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391356.427179:0:50525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391357.389141:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391358.025816:0:50576:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391358.025826:0:50576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391358.026404:0:50576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391358.026416:0:50576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391358.413114:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391358.413187:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103518720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391358.413303:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391358.413395:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103518976:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413437:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391358.413466:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788391358.413472:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103518848:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413499:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391358.413532:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518976 00000100:00100000:3.0:1788391358.413539:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518976 00000100:00100000:3.0:1788391358.413590:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788391358.413615:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103518976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413664:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103518976:12345-0@lo:400:kworker.0 Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391358.413671:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788391358.413693:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518848 00000100:00100000:3.0:1788391358.413696:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518848 00000100:00100000:3.0:1788391358.413736:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788391358.413743:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103518848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413772:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103518848:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391358.413778:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788391358.413818:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103518848:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413830:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103518976:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413872:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103519104:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.413908:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391358.413938:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519104 00000100:00100000:3.0:1788391358.413941:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519104 00000100:00100000:3.0:1788391358.414002:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788391358.414010:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.414047:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103519104:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391358.414054:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788391358.414082:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103519104:0@lo:400:kworker.0 00000100:00080000:3.0:1788391358.414117:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391358.414121:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391358.414139:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103518720 00000100:00100000:3.0:1788391358.414143:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103518720 00000100:00100000:3.0:1788391358.414165:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788391358.414172:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103518720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391358.414199:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391358.414370:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788391358.414407:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103519360:0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.414441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391358.414457:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391358.414461:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103519488:0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.414474:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391358.414498:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519360 00000100:00100000:2.0:1788391358.414501:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519360 00000100:00100000:2.0:1788391358.414525:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788391358.414536:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103519360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.414560:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103519360:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391358.414565:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788391358.414573:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519488 00000100:00100000:2.0:1788391358.414575:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519488 00000100:00100000:2.0:1788391358.414588:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788391358.414591:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103519488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.414607:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103519488:12345-0@lo:400:kworker.0 Request processed in 16us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391358.414611:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788391358.414641:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103519488:0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.414650:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103519360:0@lo:400:kworker.0 00000100:00080000:2.0:1788391358.414665:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391358.414814:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103519232:0@lo:400:kworker.0 00000100:00100000:0.0:1788391358.414836:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391358.414923:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519232 00000100:00100000:2.0:1788391358.414928:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519232 00000100:00100000:2.0:1788391358.415086:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788391358.415092:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103519232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391358.415120:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103519232:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391358.415123:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788391358.415243:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103519232:0@lo:400:kworker.0 00000100:00100000:3.0:1788391358.417150:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103518720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2971us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391358.417176:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788391358.418752:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103518720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788391359.438210:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391359.438863:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103519616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391359.438931:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391359.441374:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519616 00000100:00100000:3.0:1788391359.441388:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519616 00000100:00100000:3.0:1788391359.441459:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788391359.441470:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103519616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391359.441508:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391359.441594:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103519616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391359.441601:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788391359.441676:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103519616:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788391359.649167:0:50627:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391359.649177:0:50627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391359.649704:0:50627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391359.649713:0:50627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391360.117172:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391360.117248:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351360 00000100:00100000:0.0:1788391360.117258:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351360 00000100:00100000:0.0:1788391360.117372:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1788391360.117383:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094351360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391360.117466:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094351360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391360.117475:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:2.0:1788391360.118359:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391360.118397:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391360.118475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391360.118581:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351488 00000100:00100000:0.0:1788391360.118588:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351488 00000100:00100000:0.0:1788391360.118657:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:0.0:1788391360.118670:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094351488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391360.118721:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094351488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 57us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391360.118728:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00080000:3.0:1788391360.118890:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391360.119187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391360.119251:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351872 00000100:00100000:0.0:1788391360.119256:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351872 00000100:00100000:0.0:1788391360.119296:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:0.0:1788391360.119302:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094351872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391360.119339:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094351872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391360.119346:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00080000:2.0:1788391360.119496:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391360.119523:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351744 00000100:00100000:1.0:1788391360.119527:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351744 00000100:00100000:3.0:1788391360.119547:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094351616 00000100:00100000:3.0:1788391360.119552:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094351616 00000100:00100000:1.0:1788391360.119622:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:1.0:1788391360.119631:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094351744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391360.119801:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094351744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 172us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391360.119808:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00080000:2.0:1788391360.120079:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391360.120083:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391360.120778:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:3.0:1788391360.120788:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094351616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391360.120823:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094351616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391360.120828:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00010000:00010000:2.0:1788391360.461107:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391361.195474:0:50678:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391361.195484:0:50678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391361.196068:0:50678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391361.196078:0:50678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391361.485257:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391361.805195:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391361.805204:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391361.805762:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391361.805771:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391362.514570:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391362.732042:0:50730:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391362.732055:0:50730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391362.732644:0:50730:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391362.732653:0:50730:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391363.533213:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103520128:0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.533230:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103519872:0@lo:400:kworker.0 00000100:00100000:0.0:1788391363.533293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391363.533298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391363.533361:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788391363.533368:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103519744:0@lo:400:kworker.0 00000100:00100000:0.0:1788391363.533409:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391363.533638:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519872 00000100:00100000:0.0:1788391363.533646:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519872 00000100:00100000:2.0:1788391363.534238:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103520384:0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.534283:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391363.534325:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391363.534334:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103520000:0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.534369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788391363.534424:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391363.534442:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520128 00000100:00100000:2.0:1788391363.534446:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520128 00000100:00100000:2.0:1788391363.534492:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788391363.534504:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103520128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.534560:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103520128:12345-0@lo:400:kworker.0 Request processed in 58us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391363.534833:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788391363.534859:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520384 00000100:00100000:2.0:1788391363.534863:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520384 00000100:00100000:2.0:1788391363.534987:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788391363.534997:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.535044:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103520384:12345-0@lo:400:kworker.0 Request processed in 50us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391363.535055:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788391363.535083:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520000 00000100:00100000:2.0:1788391363.535087:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520000 00000100:00100000:0.0:1788391363.535255:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788391363.535273:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103519872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391363.535292:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103520512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391363.535323:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103519872:12345-0@lo:400:kworker.0 Request processed in 57us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391363.535335:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391363.535335:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788391363.535437:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520512 00000100:00100000:1.0:1788391363.535441:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520512 00000100:00100000:0.0:1788391363.535470:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788391363.535478:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103520000:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788391363.535488:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391363.535494:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391363.535504:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103520000:12345-0@lo:400:kworker.0 Request processed in 29us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391363.535508:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788391363.535547:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103520256:0@lo:400:kworker.0 00010000:00010000:2.0:1788391363.535549:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391363.535571:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391363.535592:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103520000:0@lo:400:kworker.0 00000100:00100000:0.0:1788391363.535602:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103520128:0@lo:400:kworker.0 00000100:00100000:0.0:1788391363.535627:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520256 00000100:00100000:0.0:1788391363.535631:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520256 00000100:00100000:0.0:1788391363.535660:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788391363.535667:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103520256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.535722:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103519872:0@lo:400:kworker.0 00000100:00100000:1.0:1788391363.535732:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788391363.535740:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103520384:0@lo:400:kworker.0 00000100:00100000:1.0:1788391363.535746:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103520512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391363.535747:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103520256:12345-0@lo:400:kworker.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391363.535759:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1788391363.535770:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1788391363.535777:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391363.535795:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103520256:0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.535801:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103519744 00000100:00100000:2.0:1788391363.535807:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103519744 00000100:00100000:1.0:1788391363.535820:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103520512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391363.535828:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788391363.535845:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788391363.535849:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103520512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391363.535856:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103519744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.535900:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103519744:12345-0@lo:400:kworker.0 Request processed in 47us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391363.535920:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103519744:0@lo:400:kworker.0 00000100:00100000:2.0:1788391363.535999:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000040:00080000:2.0:1788391364.415841:0:50781:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391364.415850:0:50781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391364.417933:0:50781:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391364.417955:0:50781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391364.557149:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391364.557432:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391364.557754:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103520640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391364.557826:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391364.558532:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520640 00000100:00100000:1.0:1788391364.558541:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520640 00000100:00100000:1.0:1788391364.558607:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788391364.558617:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103520640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391364.558653:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391364.558702:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103520640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391364.558709:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788391364.559694:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103520640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391365.238767:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391365.246044:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352128 00000100:00100000:1.0:1788391365.246060:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352128 00000100:00100000:0.0:1788391365.246419:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391365.246486:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391365.246503:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391365.246583:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391365.246608:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352000 00000100:00100000:0.0:1788391365.246612:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352000 00000100:00100000:0.0:1788391365.246664:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:0.0:1788391365.246675:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094352000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391365.246740:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094352000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391365.246748:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:1.0:1788391365.246893:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352512 00000100:00100000:1.0:1788391365.246897:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352512 00000100:00100000:3.0:1788391365.246950:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352384 00000100:00100000:3.0:1788391365.246992:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352384 00000100:00080000:2.0:1788391365.247018:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391365.247024:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391365.247040:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:2.0:1788391365.247050:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094352128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391365.247089:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094352128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (8333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391365.247094:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352256 00000100:00100000:2.0:1788391365.247099:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:3.0:1788391365.247101:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352256 00000100:00100000:3.0:1788391365.247141:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1788391365.247149:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1788391365.247152:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094352384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391365.247161:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094352256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391365.247189:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094352384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391365.247198:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:2.0:1788391365.247198:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094352256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391365.247209:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00080000:3.0:1788391365.247217:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391365.249123:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1788391365.249136:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094352512:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391365.249203:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094352512:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 70us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391365.249222:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00010000:00010000:3.0:1788391365.584673:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391366.139564:0:50832:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391366.141267:0:50832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391366.141773:0:50832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391366.141783:0:50832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391366.605150:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391367.629572:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391367.739803:0:50883:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391367.740133:0:50883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391367.740720:0:50883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391367.740729:0:50883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391368.653145:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391368.653171:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103520768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391368.653242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788391368.653254:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391368.653283:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520768 00000100:00100000:2.0:1788391368.653291:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520768 00000100:00080000:1.0:1788391368.653339:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391368.653356:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788391368.653366:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103520768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391368.653372:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788391368.653387:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103521024:0@lo:400:kworker.0 00002000:00000024:2.0:1788391368.653402:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391368.653424:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391368.653451:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103521408:0@lo:400:kworker.0 00000100:00100000:2.0:1788391368.653451:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103520768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391368.653459:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788391368.653463:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103520896:0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.653487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391368.653494:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521024 00000100:00100000:2.0:1788391368.653498:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521024 00000100:00100000:1.0:1788391368.653504:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391368.653525:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521408 00000100:00100000:3.0:1788391368.653530:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521408 00000100:00100000:2.0:1788391368.653544:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788391368.653554:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.653561:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00080000:1.0:1788391368.653561:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391368.653567:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391368.653574:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103521408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391368.653582:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103521152:0@lo:400:kworker.0 00000100:00100000:2.0:1788391368.653595:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103521024:12345-0@lo:400:kworker.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391368.653603:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788391368.653612:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103521408:12345-0@lo:400:kworker.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391368.653620:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788391368.653624:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103520896 00000100:00100000:1.0:1788391368.653624:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391368.653629:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103520896 00000100:00100000:0.0:1788391368.653660:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103521280:0@lo:400:kworker.0 00000100:00100000:1.0:1788391368.653670:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103520768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391368.653696:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391368.653705:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103521024:0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.653713:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521152 00000100:00100000:3.0:1788391368.653719:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521152 00000100:00100000:2.0:1788391368.653733:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788391368.653740:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103520896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.653744:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788391368.653751:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103521152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391368.653778:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103520896:12345-0@lo:400:kworker.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391368.653785:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788391368.653786:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103521152:12345-0@lo:400:kworker.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391368.653788:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103520896:0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.653796:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788391368.653823:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58afd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103521152:0@lo:400:kworker.0 00000100:00100000:2.0:1788391368.653842:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103521408:0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.658186:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521280 00000100:00100000:3.0:1788391368.658201:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521280 00000100:00100000:3.0:1788391368.658723:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788391368.658737:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391368.658842:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103521280:12345-0@lo:400:kworker.0 Request processed in 109us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391368.658850:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:1.0:1788391368.659014:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391368.659988:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103521280:0@lo:400:kworker.0 00000040:00080000:3.0:1788391369.326701:0:50934:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391369.326712:0:50934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391369.327558:0:50934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391369.327569:0:50934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391369.678339:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391369.679033:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103521536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391369.679129:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391369.679376:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521536 00000100:00100000:3.0:1788391369.679385:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521536 00000100:00100000:3.0:1788391369.679441:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788391369.679452:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103521536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391369.679488:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391369.679540:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103521536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391369.679560:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788391369.679607:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103521536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391370.358476:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391370.358522:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391370.358552:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352768 00000100:00100000:1.0:1788391370.358563:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352768 00000100:00100000:2.0:1788391370.358569:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391370.358604:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391370.358636:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391370.358678:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352640 00000100:00100000:0.0:1788391370.358682:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352640 00000100:00100000:3.0:1788391370.358692:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353024 00000100:00100000:3.0:1788391370.358699:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353024 00000100:00100000:0.0:1788391370.358728:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1788391370.358741:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094352896 00000100:00100000:0.0:1788391370.358741:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094352640:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391370.358746:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094352896 00000100:00100000:3.0:1788391370.358775:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1788391370.358785:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094353024:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391370.358815:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094352640:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391370.358823:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:3.0:1788391370.358842:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094353024:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391370.358851:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:0.0:1788391370.358867:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1788391370.358884:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094352896:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391370.358956:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094352896:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391370.362048:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353152 00000100:00100000:1.0:1788391370.362062:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353152 00000100:00100000:2.0:1788391370.362099:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1788391370.362158:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094352768:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391370.362171:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:1.0:1788391370.362182:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094353152:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391370.362252:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094353152:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391370.362261:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00080000:1.0:1788391370.362314:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391370.362318:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391370.362331:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391370.362497:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:2.0:1788391370.362614:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094352768:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 505us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391370.362622:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00010000:00010000:2.0:1788391370.701276:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391370.915715:0:50986:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391370.915723:0:50986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391370.916319:0:50986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391370.916327:0:50986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1788391371.021175:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391371.021222:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391371.021618:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391371.021627:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391371.726662:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391372.498892:0:51037:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391372.498904:0:51037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391372.499468:0:51037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391372.499477:0:51037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391372.749246:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391373.775719:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103521664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391373.775795:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391373.775927:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521664 00000100:00100000:0.0:1788391373.775935:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521664 00000100:00100000:0.0:1788391373.776046:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788391373.776059:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103521664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391373.776092:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391373.776134:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103521664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391373.776141:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788391373.776213:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391373.776249:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103521664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788391373.779546:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391373.780814:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103521792:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.780897:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391373.780940:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.780986:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391373.781015:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391373.781020:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103522176:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781042:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391373.781066:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103521920:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391373.781109:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391373.781114:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103522048:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781135:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391373.781162:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521792 00000100:00100000:2.0:1788391373.781169:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521792 00000100:00100000:2.0:1788391373.781212:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788391373.781221:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781270:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103521792:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391373.781277:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788391373.781322:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103521792:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781361:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522304 00000100:00100000:2.0:1788391373.781364:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522304 00000100:00100000:2.0:1788391373.781393:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522176 00000100:00100000:2.0:1788391373.781396:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522176 00000100:00100000:2.0:1788391373.781416:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522048 00000100:00100000:2.0:1788391373.781419:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522048 00000100:00100000:2.0:1788391373.781432:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788391373.781439:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781475:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103522304:12345-0@lo:400:kworker.0 Request processed in 36us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391373.781481:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788391373.781494:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788391373.781501:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781528:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103522176:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391373.781533:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788391373.781544:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788391373.781550:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781580:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103522048:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391373.781586:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788391373.781614:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103522176:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781624:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788391373.781646:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103522048:0@lo:400:kworker.0 00000100:00100000:1.0:1788391373.781740:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103521920 00000100:00100000:1.0:1788391373.781744:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103521920 00000100:00100000:1.0:1788391373.781779:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788391373.781787:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391373.781827:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103521920:12345-0@lo:400:kworker.0 Request processed in 42us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391373.781833:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788391373.781880:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103521920:0@lo:400:kworker.0 00000100:00080000:1.0:1788391373.781895:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391373.781899:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788391374.059941:0:51088:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391374.059949:0:51088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391374.060387:0:51088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391374.060394:0:51088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391374.797182:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391374.797251:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391374.797449:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522432 00000100:00100000:0.0:1788391374.797457:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522432 00000100:00100000:0.0:1788391374.797522:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788391374.797533:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391374.797565:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391374.797682:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391374.797690:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:2.0:1788391374.797921:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391374.798140:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391375.477236:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391375.477287:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391375.477319:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353280 00000100:00100000:2.0:1788391375.477324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391375.477337:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353280 00000100:00100000:2.0:1788391375.477353:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391375.477390:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391375.477407:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:2.0:1788391375.477411:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353792 00000100:00100000:2.0:1788391375.477414:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353792 00000100:00100000:1.0:1788391375.477420:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094353280:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391375.477456:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353408 00000100:00100000:2.0:1788391375.477460:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353408 00000100:00100000:2.0:1788391375.477480:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391375.477487:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094353792:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391375.477514:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094353280:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391375.477522:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094353792:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391375.477523:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:2.0:1788391375.477527:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391375.477540:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:2.0:1788391375.477546:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094353408:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391375.477566:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094353408:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391375.477572:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00080000:2.0:1788391375.477592:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391375.477728:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353536 00000100:00100000:3.0:1788391375.477733:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353536 00000100:00080000:2.0:1788391375.477897:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391375.478072:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353664 00000100:00100000:3.0:1788391375.478077:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353664 00000100:00100000:1.0:1788391375.478100:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1788391375.478110:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094353536:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391375.478161:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094353536:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 53us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391375.478168:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1788391375.478246:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1788391375.478257:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69f3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094353664:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391375.478299:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69f3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094353664:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391375.478307:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00080000:1.0:1788391375.478698:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788391375.599371:0:51139:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391375.599382:0:51139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391375.601169:0:51139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391375.601186:0:51139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391375.821915:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391376.845922:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391377.161737:0:51191:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391377.161748:0:51191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391377.165509:0:51191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391377.165539:0:51191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391377.871484:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391378.740157:0:51242:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391378.741521:0:51242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391378.742082:0:51242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391378.742094:0:51242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391378.893135:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391378.893165:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391378.893258:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.893345:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522560 00000100:00100000:1.0:1788391378.893355:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522560 00000100:00100000:1.0:1788391378.893435:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788391378.893446:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391378.893490:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391378.893542:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.893550:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788391378.893576:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391378.893620:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788391378.893825:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391378.898116:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103522688:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898215:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.898267:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103523200:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.898329:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788391378.898335:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103522816:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.898383:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103523328:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898404:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.898434:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522688 00000100:00100000:1.0:1788391378.898442:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522688 00000100:00100000:1.0:1788391378.898493:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788391378.898503:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103522688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898553:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103522688:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.898561:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788391378.898595:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523200 00000100:00100000:1.0:1788391378.898598:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523200 00000100:00100000:1.0:1788391378.898631:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523328 00000100:00100000:1.0:1788391378.898634:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523328 00000100:00100000:1.0:1788391378.898651:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788391378.898657:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898688:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103523200:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.898698:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788391378.898707:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788391378.898712:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103523328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898732:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103523328:12345-0@lo:400:kworker.0 Request processed in 20us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.898738:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788391378.898754:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522816 00000100:00100000:1.0:1788391378.898757:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522816 00000100:00100000:1.0:1788391378.898781:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788391378.898787:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103522816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898848:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103522816:12345-0@lo:400:kworker.0 Request processed in 61us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.898855:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788391378.898877:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391378.898882:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391378.898892:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522944:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898918:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.898936:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391378.898941:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d586ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103523072:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.898986:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391378.899015:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523072 00000100:00100000:1.0:1788391378.899018:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523072 00000100:00100000:1.0:1788391378.899039:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788391378.899044:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.899075:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103523072:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391378.899085:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788391378.899122:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103522816:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.899131:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103523328:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.899139:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103522688:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.899148:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103523200:0@lo:400:kworker.0 00000100:00100000:1.0:1788391378.899175:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103523072:0@lo:400:kworker.0 00000100:00100000:2.0:1788391378.899431:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103522944 00000100:00100000:2.0:1788391378.899436:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103522944 00000100:00100000:2.0:1788391378.899469:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788391378.899476:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391378.899520:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103522944:12345-0@lo:400:kworker.0 Request processed in 45us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391378.899527:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788391378.899557:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d586eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103522944:0@lo:400:kworker.0 00000100:00100000:1.0:1788391379.917182:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391379.917200:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391379.917385:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391379.917451:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523456 00000100:00100000:1.0:1788391379.917461:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523456 00000100:00100000:1.0:1788391379.917510:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788391379.917521:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103523456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391379.917555:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391379.917628:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103523456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391379.917637:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788391379.917673:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523456:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788391380.237258:0:51293:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391380.237266:0:51293:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391380.237932:0:51293:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391380.237942:0:51293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391380.598383:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391380.598416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391380.598446:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094353920 00000100:00100000:1.0:1788391380.598452:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391380.598460:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094353920 00000100:00100000:3.0:1788391380.598466:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354176 00000100:00100000:3.0:1788391380.598488:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354176 00000100:00100000:1.0:1788391380.598495:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391380.598528:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1788391380.598542:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094353920:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391380.598545:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:3.0:1788391380.598559:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094354176:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391380.598576:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391380.598624:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354432 00000100:00100000:3.0:1788391380.598629:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094354176:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391380.598629:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354432 00000100:00100000:2.0:1788391380.598631:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094353920:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391380.598641:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1788391380.598646:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1788391380.598661:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354048 00000100:00100000:1.0:1788391380.598665:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354048 00000100:00100000:2.0:1788391380.598697:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:3.0:1788391380.598700:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354304 00000100:00100000:3.0:1788391380.598706:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354304 00000100:00100000:2.0:1788391380.598708:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094354432:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391380.598736:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:2.0:1788391380.598742:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58afd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094354432:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391380.598747:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094354304:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391380.598779:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094354304:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391380.598786:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:1.0:1788391380.599354:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:1.0:1788391380.599363:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094354048:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391380.599394:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094354048:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391380.599399:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00080000:1.0:1788391380.599527:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391380.599531:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391380.599533:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391380.599586:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00010000:00010000:2.0:1788391380.941148:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391381.261531:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391381.261541:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391381.262126:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391381.262138:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1788391381.626897:0:51344:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391381.626905:0:51344:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391381.627479:0:51344:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391381.627488:0:51344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391381.965313:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391382.989073:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391383.039549:0:51395:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391383.039557:0:51395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391383.040198:0:51395:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391383.040205:0:51395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391384.013310:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391384.013479:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391384.013502:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391384.013608:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103523840:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.013648:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391384.013711:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523968:0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.013733:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103523712:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.013738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391384.013755:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391384.013772:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103524096:0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.013789:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391384.013816:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391384.013818:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103524224:0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.013841:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391384.013847:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523584 00000100:00100000:1.0:1788391384.013853:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523968 00000100:00100000:3.0:1788391384.013857:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523584 00000100:00100000:2.0:1788391384.013859:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391384.013859:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523968 00000100:00100000:2.0:1788391384.013865:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103524352:0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.013886:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391384.013919:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524096 00000100:00100000:3.0:1788391384.013926:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788391384.013926:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524096 00000100:00100000:1.0:1788391384.013926:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788391384.013942:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103523584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391384.013950:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103523968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.013955:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524224 00000100:00100000:2.0:1788391384.013958:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524224 00000100:00100000:2.0:1788391384.014001:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524352 00000100:00100000:2.0:1788391384.014004:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524352 00002000:00000024:3.0:1788391384.014017:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391384.014021:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103523968:12345-0@lo:400:kworker.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391384.014023:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788391384.014030:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103524096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014030:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788391384.014056:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523712 00000100:00100000:1.0:1788391384.014059:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523712 00000100:00100000:2.0:1788391384.014089:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103524096:12345-0@lo:400:kworker.0 Request processed in 53us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391384.014089:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788391384.014090:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103523584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391384.014094:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391384.014101:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103523712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391384.014103:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788391384.014108:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788391384.014124:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788391384.014134:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103524224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014150:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103523712:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391384.014151:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103523840 00000100:00100000:0.0:1788391384.014158:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103523840 00000100:00100000:3.0:1788391384.014162:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788391384.014162:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788391384.014163:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103524224:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391384.014172:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788391384.014179:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103524352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391384.014202:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788391384.014219:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103523840:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788391384.014220:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391384.014226:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103524352:12345-0@lo:400:kworker.0 Request processed in 49us (336us total) trans 0 rc 0/0 00000100:00080000:2.0:1788391384.014228:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391384.014233:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391384.014239:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788391384.014247:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103524352:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014267:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103523712:0@lo:400:kworker.0 00000100:00100000:0.0:1788391384.014275:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103523840:12345-0@lo:400:kworker.0 Request processed in 62us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391384.014282:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103524224:0@lo:400:kworker.0 00000100:00100000:0.0:1788391384.014286:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788391384.014323:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103523840:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014331:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103524096:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014345:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523968:0@lo:400:kworker.0 00000100:00100000:1.0:1788391384.014358:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103523584:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788391384.441519:0:51447:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391384.441529:0:51447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391384.442118:0:51447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391384.442129:0:51447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391385.037115:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391385.037157:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391385.037237:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391385.037278:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524480 00000100:00100000:3.0:1788391385.037286:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524480 00000100:00100000:3.0:1788391385.037335:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788391385.037343:0:43329:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788391385.037346:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103524480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391385.037354:0:43329:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788391385.037412:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391385.037474:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103524480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391385.037482:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788391385.037536:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391385.716940:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391385.717248:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391385.717288:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354944 00000100:00100000:3.0:1788391385.717298:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354944 00000100:00100000:3.0:1788391385.717358:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1788391385.717368:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094354944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391385.717438:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094354944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391385.717445:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:0.0:1788391385.717460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1788391385.717480:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391385.717583:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354560 00000100:00100000:0.0:1788391385.717587:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354560 00000100:00100000:0.0:1788391385.717622:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:0.0:1788391385.717631:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094354560:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391385.717653:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391385.717678:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094354560:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391385.717687:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:3.0:1788391385.717920:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354816 00000100:00100000:3.0:1788391385.717925:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354816 00000100:00100000:3.0:1788391385.717980:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:3.0:1788391385.717988:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094354816:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391385.718031:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094354816:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391385.718038:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00080000:3.0:1788391385.718053:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391385.718335:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391385.719106:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094354688 00000100:00100000:1.0:1788391385.719113:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094354688 00000100:00100000:1.0:1788391385.719157:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355072 00000100:00100000:1.0:1788391385.719161:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355072 00000100:00100000:1.0:1788391385.719191:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:3.0:1788391385.719201:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1788391385.719203:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094354688:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391385.719219:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094355072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391385.719254:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094354688:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391385.719262:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:3.0:1788391385.719307:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094355072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391385.719316:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00080000:3.0:1788391385.719340:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788391385.871652:0:51499:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391385.871661:0:51499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391385.874779:0:51499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391385.874794:0:51499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391386.061164:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391387.085079:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391387.314123:0:51550:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391387.314134:0:51550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391387.314639:0:51550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391387.314648:0:51550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391388.109270:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391388.735938:0:51601:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391388.735948:0:51601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391388.736668:0:51601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391388.736678:0:51601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391389.133309:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391389.133331:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103524608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391389.133400:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391389.133462:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524608 00000100:00100000:2.0:1788391389.133472:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524608 00010000:00010000:0.0:1788391389.133533:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391389.133537:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788391389.133546:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103524608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391389.133577:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00080000:1.0:1788391389.133630:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391389.133636:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103524608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391389.133645:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788391389.133778:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103524608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391389.134073:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103525120:0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134095:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391389.134127:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391389.134133:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103524992:0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391389.134175:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525120 00000100:00100000:2.0:1788391389.134178:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525120 00000100:00100000:2.0:1788391389.134203:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524992 00000100:00100000:2.0:1788391389.134206:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524992 00000100:00100000:2.0:1788391389.134221:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788391389.134227:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103525120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134261:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103525120:12345-0@lo:400:kworker.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391389.134268:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788391389.134280:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788391389.134285:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103524992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134314:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103524992:12345-0@lo:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391389.134321:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788391389.134354:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103524992:0@lo:400:kworker.0 00000100:00100000:3.0:1788391389.134368:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103525120:0@lo:400:kworker.0 00000100:00080000:1.0:1788391389.134403:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391389.134407:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103524736:0@lo:400:kworker.0 00000100:00100000:3.0:1788391389.134436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391389.134454:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103524864:0@lo:400:kworker.0 00000100:00100000:3.0:1788391389.134468:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103525248:0@lo:400:kworker.0 00000100:00100000:1.0:1788391389.134486:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524736 00000100:00100000:1.0:1788391389.134490:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524736 00000100:00100000:0.0:1788391389.134495:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391389.134503:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391389.134521:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788391389.134528:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103524736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134551:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103524864 00000100:00100000:0.0:1788391389.134551:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525248 00000100:00100000:2.0:1788391389.134558:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103524864 00000100:00100000:0.0:1788391389.134559:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525248 00000100:00100000:1.0:1788391389.134566:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103524736:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391389.134570:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103524736:0@lo:400:kworker.0 00000100:00100000:1.0:1788391389.134574:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:3.0:1788391389.134598:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391389.134601:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391389.134613:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788391389.134629:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788391389.134630:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103524864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391389.134644:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103525248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391389.134685:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103524864:12345-0@lo:400:kworker.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391389.134694:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788391389.134703:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103525248:12345-0@lo:400:kworker.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391389.134712:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788391389.134733:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103524864:0@lo:400:kworker.0 00000100:00100000:3.0:1788391389.134745:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103525248:0@lo:400:kworker.0 00010000:00010000:2.0:1788391390.157926:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391390.159515:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391390.159539:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103525376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391390.159612:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391390.159646:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525376 00000100:00100000:1.0:1788391390.159654:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525376 00000100:00100000:1.0:1788391390.159718:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788391390.159740:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103525376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391390.159779:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391390.159832:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103525376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391390.159840:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788391390.159904:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103525376:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788391390.184473:0:51652:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391390.184481:0:51652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391390.185246:0:51652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391390.185255:0:51652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391390.838756:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391390.838799:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391390.838827:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355328 00000100:00100000:1.0:1788391390.838838:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355328 00000100:00100000:3.0:1788391390.838845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391390.838869:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355584 00000100:00080000:2.0:1788391390.838871:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391390.838876:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355584 00000100:00100000:3.0:1788391390.838895:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391390.838916:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355200 00000100:00100000:1.0:1788391390.838921:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:2.0:1788391390.838924:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355200 00000100:00100000:0.0:1788391390.838928:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355456 00000100:00100000:0.0:1788391390.838932:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355456 00000100:00100000:1.0:1788391390.838939:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094355328:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391390.838942:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391390.838954:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1788391390.838990:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094355584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391390.839004:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:2.0:1788391390.839012:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1788391390.839017:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094355456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391390.839024:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094355200:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391390.839043:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094355584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391390.839048:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:3.0:1788391390.839061:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094355456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391390.839069:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1788391390.839095:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355712 00000100:00100000:3.0:1788391390.839099:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355712 00000100:00100000:3.0:1788391390.839146:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:3.0:1788391390.839155:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094355712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391390.839340:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094355200:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 311us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391390.839343:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094355328:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 409us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391390.839349:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094355712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 192us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391390.839358:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:1.0:1788391390.839364:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:3.0:1788391390.839373:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00080000:2.0:1788391390.839400:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391390.839405:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391390.839408:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788391391.181599:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391391.501204:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391391.501212:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391391.501762:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391391.501771:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1788391391.604388:0:51704:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391391.604398:0:51704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391391.604861:0:51704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391391.604870:0:51704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391392.205118:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391393.039492:0:51755:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391393.039502:0:51755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391393.041866:0:51755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391393.041883:0:51755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391393.229192:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391394.255936:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103525504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788391394.255999:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391394.256023:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391394.256102:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103526016:0@lo:400:kworker.0 00000100:00100000:3.0:1788391394.256134:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103525632:0@lo:400:kworker.0 00000100:00100000:0.0:1788391394.256134:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391394.256177:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525504 00000100:00100000:3.0:1788391394.256178:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391394.256186:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525504 00000100:00100000:3.0:1788391394.256208:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103526144:0@lo:400:kworker.0 00000100:00100000:3.0:1788391394.256238:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391394.256253:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788391394.256268:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103525504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391394.256273:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526016 00000100:00100000:3.0:1788391394.256278:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526016 00000100:00100000:3.0:1788391394.256308:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526144 00000100:00100000:3.0:1788391394.256312:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526144 00002000:00000024:0.0:1788391394.256316:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391394.256341:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788391394.256350:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103526016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391394.256383:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103525504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391394.256392:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788391394.256397:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103526016:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391394.256405:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788391394.256423:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788391394.256433:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103526144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391394.256449:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391394.256455:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391394.256476:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103526144:12345-0@lo:400:kworker.0 Request processed in 45us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391394.256483:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788391394.256519:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103526144:0@lo:400:kworker.0 00000100:00100000:0.0:1788391394.256548:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788391394.256562:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103525504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391394.257832:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103525760:0@lo:400:kworker.0 00000100:00100000:1.0:1788391394.257883:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391394.257918:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391394.257926:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103525888:0@lo:400:kworker.0 00000100:00100000:1.0:1788391394.257956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391394.258028:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525632 00000100:00100000:1.0:1788391394.258033:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525632 00000100:00100000:1.0:1788391394.258076:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788391394.258085:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103525632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391394.258131:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103525632:12345-0@lo:400:kworker.0 Request processed in 48us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391394.258134:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525888 00000100:00100000:0.0:1788391394.258139:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525888 00000100:00100000:1.0:1788391394.258143:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788391394.258175:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788391394.258185:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391394.258217:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103525632:0@lo:400:kworker.0 00000100:00100000:0.0:1788391394.258229:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103525888:12345-0@lo:400:kworker.0 Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391394.258237:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788391394.258250:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103525888:0@lo:400:kworker.0 00000100:00100000:2.0:1788391394.258384:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103525760 00000100:00100000:2.0:1788391394.258389:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103525760 00000100:00080000:0.0:1788391394.258426:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391394.258437:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788391394.258445:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391394.258485:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103525760:12345-0@lo:400:kworker.0 Request processed in 41us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391394.258494:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788391394.258508:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103525760:0@lo:400:kworker.0 00000040:00080000:2.0:1788391394.435570:0:51806:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391394.435581:0:51806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391394.436441:0:51806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391394.436453:0:51806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391395.278179:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103526272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391395.278236:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391395.278267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391395.278322:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526272 00000100:00100000:0.0:1788391395.278330:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526272 00000100:00100000:0.0:1788391395.278375:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788391395.278383:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103526272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391395.278413:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391395.278457:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103526272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391395.278475:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788391395.278515:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103526272:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788391395.896398:0:51857:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391395.896408:0:51857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391395.897134:0:51857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391395.897144:0:51857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391395.958742:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391395.958780:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391395.958814:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391395.958839:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391395.958865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391395.958893:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356224 00000100:00100000:0.0:1788391395.958901:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356224 00000100:00100000:0.0:1788391395.958946:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356096 00000100:00100000:0.0:1788391395.958948:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356096 00000100:00100000:0.0:1788391395.958996:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:0.0:1788391395.959005:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094356224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391395.959058:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094356224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391395.959063:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:0.0:1788391395.959078:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1788391395.959085:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094356096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391395.959108:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094356096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391395.959114:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:0.0:1788391395.959134:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355968 00000100:00100000:0.0:1788391395.959137:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355968 00000100:00100000:0.0:1788391395.959154:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356352 00000100:00100000:0.0:1788391395.959155:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356352 00000100:00100000:0.0:1788391395.959167:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:0.0:1788391395.959171:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094355968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391395.959190:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094355968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391395.959195:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:0.0:1788391395.959204:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:0.0:1788391395.959208:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094356352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391395.959220:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094356352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 13us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391395.959223:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00080000:0.0:1788391395.959233:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391395.959236:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391395.959237:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391395.959444:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094355840 00000100:00100000:3.0:1788391395.959449:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094355840 00000100:00100000:3.0:1788391395.959494:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:3.0:1788391395.959502:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094355840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391395.959535:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094355840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391395.959542:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00010000:00010000:3.0:1788391396.301225:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391397.325875:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391397.369126:0:51908:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391397.369134:0:51908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391397.370141:0:51908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391397.370153:0:51908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391398.349142:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391398.870484:0:51960:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391398.870494:0:51960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391398.874822:0:51960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391398.874836:0:51960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391399.373134:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391399.373137:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58bc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103526400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391399.373211:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391399.373365:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526400 00000100:00100000:0.0:1788391399.373374:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526400 00000100:00080000:2.0:1788391399.373432:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391399.373504:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788391399.373508:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391399.373516:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103526400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391399.373552:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391399.373569:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103526656:0@lo:400:kworker.0 00000100:00100000:3.0:1788391399.373604:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391399.373613:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103526400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391399.373632:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788391399.373641:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103526528:0@lo:400:kworker.0 00000100:00100000:2.0:1788391399.373649:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526656 00000100:00100000:2.0:1788391399.373653:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526656 00000100:00100000:3.0:1788391399.373672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391399.373701:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58bc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103526400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391399.373708:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788391399.373716:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103526656:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391399.373735:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391399.373745:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526528 00000100:00100000:0.0:1788391399.373751:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526528 00000100:00100000:2.0:1788391399.373760:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103526656:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391399.373767:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788391399.373786:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103526656:0@lo:400:kworker.0 00000100:00100000:0.0:1788391399.373789:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788391399.373801:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103526528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391399.373851:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103526528:12345-0@lo:400:kworker.0 Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391399.373861:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788391399.373924:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103526528:0@lo:400:kworker.0 00000100:00100000:0.0:1788391399.374211:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103526784:0@lo:400:kworker.0 00000100:00100000:0.0:1788391399.374242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391399.374338:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103526912:0@lo:400:kworker.0 00000100:00100000:1.0:1788391399.374341:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788391399.374378:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391399.374576:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526784 00000100:00100000:3.0:1788391399.374580:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526784 00000100:00100000:3.0:1788391399.374609:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103526912 00000100:00100000:3.0:1788391399.374611:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103526912 00000100:00100000:1.0:1788391399.374616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391399.374642:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527040 00000100:00100000:2.0:1788391399.374649:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527040 00000100:00100000:3.0:1788391399.374654:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788391399.374663:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391399.374679:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788391399.374691:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103526912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391399.374698:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788391399.374702:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103526784:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391399.374708:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788391399.374712:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103527040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788391399.374723:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391399.374742:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103526784:0@lo:400:kworker.0 00000100:00100000:1.0:1788391399.374748:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103526912:12345-0@lo:400:kworker.0 Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391399.374757:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788391399.374773:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103527040:12345-0@lo:400:kworker.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391399.374782:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788391399.374785:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788391399.374800:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103526912:0@lo:400:kworker.0 00000040:00080000:3.0:1788391400.272888:0:52011:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391400.272896:0:52011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391400.273629:0:52011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391400.273637:0:52011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391400.397258:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103527168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391400.397315:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391400.397429:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527168 00000100:00100000:2.0:1788391400.397435:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527168 00000100:00100000:2.0:1788391400.397494:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788391400.397501:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103527168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391400.397528:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391400.397570:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103527168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391400.397575:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788391400.397657:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103527168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391400.397776:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391401.076790:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391401.076860:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356480 00000100:00100000:1.0:1788391401.076871:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356480 00000100:00100000:1.0:1788391401.076921:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:1.0:1788391401.076931:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094356480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391401.077041:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094356480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391401.077049:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:0.0:1788391401.077760:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391401.077795:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391401.077818:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356608 00000100:00100000:3.0:1788391401.077825:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356608 00000100:00100000:0.0:1788391401.077875:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:2.0:1788391401.077924:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391401.078155:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391401.078164:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:3.0:1788391401.078180:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094356608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391401.078194:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356864 00000100:00100000:1.0:1788391401.078199:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356864 00000100:00100000:1.0:1788391401.078248:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356736 00000100:00100000:1.0:1788391401.078252:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356736 00000100:00100000:3.0:1788391401.078254:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094356608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391401.078278:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:2.0:1788391401.078289:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094356992 00000100:00100000:1.0:1788391401.078290:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58bc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094356864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391401.078295:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094356992 00000100:00100000:1.0:1788391401.078326:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58bc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094356864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391401.078332:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:1.0:1788391401.078340:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:2.0:1788391401.078346:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094356992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391401.078361:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:1.0:1788391401.078371:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094356736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391401.078381:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094356992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391401.078388:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:1.0:1788391401.078405:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094356736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (528us total) trans 0 rc 0/0 00000100:00080000:2.0:1788391401.078410:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391401.078414:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00080000:2.0:1788391401.078415:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391401.078420:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391401.078872:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00010000:00010000:3.0:1788391401.422911:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391401.742752:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391401.742760:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391401.743593:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391401.743616:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788391401.746561:0:52063:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391401.746566:0:52063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391401.747585:0:52063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391401.747597:0:52063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391402.445218:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391403.193147:0:52114:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391403.193156:0:52114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391403.193748:0:52114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391403.193755:0:52114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391403.469627:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391404.493111:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103527552:0@lo:400:kworker.0 00000100:00100000:3.0:1788391404.493125:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103527296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391404.493142:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103527680:0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.493177:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391404.493189:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391404.493209:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391404.493231:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103527808:0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.493237:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788391404.493254:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527552 00000100:00100000:1.0:1788391404.493263:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527552 00000100:00100000:3.0:1788391404.493270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391404.493277:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527680 00000100:00100000:0.0:1788391404.493281:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527680 00000100:00100000:3.0:1788391404.493309:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788391404.493331:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788391404.493333:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103527424:0@lo:400:kworker.0 00000100:00100000:1.0:1788391404.493344:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103527552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391404.493371:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391404.493399:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103527552:12345-0@lo:400:kworker.0 Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391404.493405:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103527936:0@lo:400:kworker.0 00000100:00100000:1.0:1788391404.493410:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788391404.493431:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788391404.493436:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391404.493441:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103527680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391404.493475:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527296 00000100:00100000:1.0:1788391404.493481:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103527680:12345-0@lo:400:kworker.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391404.493486:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788391404.493494:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527296 00000100:00100000:3.0:1788391404.493527:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788391404.493534:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103527296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391404.493560:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00080000:0.0:1788391404.493611:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391404.493616:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391404.493629:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103527296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391404.493638:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788391404.493667:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527808 00000100:00100000:3.0:1788391404.493671:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527808 00000100:00100000:3.0:1788391404.493700:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527936 00000100:00100000:3.0:1788391404.493704:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527936 00000100:00100000:3.0:1788391404.493737:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788391404.493745:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103527808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.493804:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103527680:0@lo:400:kworker.0 00000100:00100000:3.0:1788391404.493818:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103527808:12345-0@lo:400:kworker.0 Request processed in 72us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391404.493826:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1788391404.493829:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391404.493844:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788391404.493854:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103527936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.493869:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103527424 00000100:00100000:0.0:1788391404.493874:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103527424 00000100:00100000:3.0:1788391404.493891:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103527936:12345-0@lo:400:kworker.0 Request processed in 38us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391404.493901:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788391404.493906:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788391404.493914:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.493982:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103527424:12345-0@lo:400:kworker.0 Request processed in 45us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391404.493991:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788391404.494003:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103527424:0@lo:400:kworker.0 00000100:00100000:3.0:1788391404.494023:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103527936:0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.494034:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391404.494044:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103527296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391404.494059:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103527808:0@lo:400:kworker.0 00000100:00100000:0.0:1788391404.494073:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103527552:0@lo:400:kworker.0 00000100:00100000:2.0:1788391404.494086:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528064 00000100:00100000:2.0:1788391404.494093:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528064 00000100:00100000:2.0:1788391404.494140:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788391404.494148:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103528064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788391404.494157:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391404.494200:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d586480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103528064:12345-0@lo:400:kworker.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391404.494207:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788391404.494280:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103528064:0@lo:400:kworker.0 00010000:00010000:1.0:1788391404.494370:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391404.565565:0:52165:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391404.565583:0:52165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391404.566268:0:52165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391404.566280:0:52165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391405.517236:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391405.517260:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103528192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391405.517337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391405.517383:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391405.517858:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528192 00000100:00100000:2.0:1788391405.517879:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528192 00000100:00100000:2.0:1788391405.517935:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788391405.517948:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103528192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391405.518022:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391405.518072:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103528192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391405.518078:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788391405.518112:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103528192:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788391405.996774:0:52217:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391405.996782:0:52217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391405.997234:0:52217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391405.997241:0:52217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391406.197193:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391406.197274:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391406.197300:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391406.197328:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391406.197345:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391406.197464:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357120 00000100:00100000:1.0:1788391406.197474:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357120 00000100:00100000:1.0:1788391406.197574:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:1.0:1788391406.197586:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094357120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391406.197603:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357376 00000100:00100000:3.0:1788391406.197609:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357632 00000100:00100000:0.0:1788391406.197610:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357376 00000100:00100000:3.0:1788391406.197617:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357632 00000100:00100000:1.0:1788391406.197656:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094357120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391406.197662:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:3.0:1788391406.197721:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357248 00000100:00100000:3.0:1788391406.197724:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357248 00000100:00080000:2.0:1788391406.197935:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391406.197940:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391406.197948:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1788391406.197950:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357504 00000100:00100000:0.0:1788391406.197955:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357504 00000100:00100000:2.0:1788391406.197956:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:2.0:1788391406.197998:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094357248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391406.198005:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094357632:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391406.198026:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094357248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391406.198031:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1788391406.198052:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094357632:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391406.198060:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1788391406.200021:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:0.0:1788391406.200142:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094357376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391406.200181:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:3.0:1788391406.200192:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094357504:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391406.200208:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094357376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391406.200218:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1788391406.200229:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094357504:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391406.200238:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00080000:3.0:1788391406.200277:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788391406.541247:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391407.435323:0:52268:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391407.435341:0:52268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391407.436042:0:52268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391407.436053:0:52268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391407.567755:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391408.589109:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391408.881237:0:52319:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391408.881247:0:52319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391408.881744:0:52319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391408.881753:0:52319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391409.613410:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103528320:0@lo:400:kworker.0 00000100:00100000:1.0:1788391409.613414:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103528576:0@lo:400:kworker.0 00000100:00100000:0.0:1788391409.613664:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788391409.613779:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103528448:0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.615425:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391409.615515:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103528832:0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.615572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391409.615636:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528320 00000100:00100000:3.0:1788391409.615645:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528320 00000100:00100000:3.0:1788391409.615699:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788391409.615709:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.615787:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103528320:12345-0@lo:400:kworker.0 Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391409.615795:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788391409.615830:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528832 00000100:00100000:3.0:1788391409.615834:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528832 00000100:00100000:3.0:1788391409.615872:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788391409.615879:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103528832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.616088:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103528832:12345-0@lo:400:kworker.0 Request processed in 206us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391409.616098:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1788391409.616144:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391409.616195:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103528320:0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.616211:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788391409.618012:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391409.618032:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391409.618090:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528576 00000100:00100000:1.0:1788391409.618098:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528576 00000100:00100000:0.0:1788391409.618154:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391409.618171:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d68fc5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391409.618184:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788391409.618198:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391409.618225:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391409.618262:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103528576:12345-0@lo:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391409.618271:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1788391409.618292:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391409.618323:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103528576:0@lo:400:kworker.0 00000100:00100000:0.0:1788391409.618355:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529088 00000100:00100000:0.0:1788391409.618363:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529088 00000100:00100000:0.0:1788391409.618416:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788391409.618427:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103529088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391409.618500:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391409.618536:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391409.618605:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528448 00000100:00100000:1.0:1788391409.618611:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528448 00000100:00100000:3.0:1788391409.618637:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528704 00000100:00100000:3.0:1788391409.618644:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528704 00000100:00100000:1.0:1788391409.618658:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788391409.618674:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.618699:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788391409.618710:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391409.618741:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103528960:0@lo:400:kworker.0 00000100:00100000:3.0:1788391409.618857:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103528704:12345-0@lo:400:kworker.0 Request processed in 148us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391409.618867:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788391409.618885:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391409.619145:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5866a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103529088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 717us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391409.619155:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788391409.619173:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103528448:12345-0@lo:400:kworker.0 Request processed in 501us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391409.619186:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1788391409.619218:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391409.619220:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d68fc5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391409.619301:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788391409.619456:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103528960 00000100:00100000:2.0:1788391409.619464:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103528960 00010000:00010000:3.0:1788391409.619475:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391409.619516:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103528448:0@lo:400:kworker.0 00000100:00100000:2.0:1788391409.619583:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788391409.619595:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391409.619648:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103528960:12345-0@lo:400:kworker.0 Request processed in 57us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391409.619653:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788391409.619696:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d69225e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103528960:0@lo:400:kworker.0 00000100:00080000:1.0:1788391409.621145:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788391410.327548:0:52370:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391410.327558:0:52370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391410.328043:0:52370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391410.328052:0:52370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391410.637242:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391410.637806:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391410.637865:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391410.637916:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529216 00000100:00100000:3.0:1788391410.637924:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529216 00000100:00100000:3.0:1788391410.638055:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788391410.638064:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103529216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391410.638092:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391410.638125:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103529216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391410.638129:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788391410.638189:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391411.317256:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391411.317346:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391411.317369:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391411.317384:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357760 00000100:00100000:1.0:1788391411.317394:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357760 00000100:00100000:2.0:1788391411.317402:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391411.317442:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788391411.317446:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391411.317454:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094357760:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391411.317496:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358016 00000100:00100000:0.0:1788391411.317502:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358016 00000100:00100000:1.0:1788391411.317506:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094357760:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391411.317539:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:0.0:1788391411.317566:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358144 00000100:00100000:0.0:1788391411.317571:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358144 00000100:00100000:1.0:1788391411.317575:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1788391411.317656:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094358016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391411.317695:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094358016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391411.317792:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094357888 00000100:00100000:3.0:1788391411.317797:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094357888 00000100:00100000:3.0:1788391411.317825:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358272 00000100:00100000:3.0:1788391411.317828:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358272 00000100:00100000:3.0:1788391411.317848:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:3.0:1788391411.317857:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094357888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391411.317901:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094357888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391411.317907:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:3.0:1788391411.317920:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:3.0:1788391411.317925:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094358272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391411.317945:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094358272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391411.317948:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00080000:3.0:1788391411.318056:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391411.318060:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391411.318061:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391411.318088:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:0.0:1788391411.318102:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1788391411.318113:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094358144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391411.318148:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094358144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391411.318156:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00010000:00010000:3.0:1788391411.661620:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391411.768260:0:52421:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391411.768267:0:52421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391411.769660:0:52421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391411.769672:0:52421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:3.0:1788391411.982502:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391411.982524:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391411.983035:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391411.983045:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391412.685748:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391413.264482:0:52473:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391413.264492:0:52473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391413.265243:0:52473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391413.265252:0:52473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391413.709369:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391414.713325:0:52524:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391414.713334:0:52524:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391414.716449:0:52524:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391414.716468:0:52524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391414.733495:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391414.733508:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391414.733529:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103529344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391414.733617:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391414.733710:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529344 00000100:00100000:2.0:1788391414.733718:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529344 00000100:00100000:2.0:1788391414.733776:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788391414.733786:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103529344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391414.733817:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391414.733859:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103529344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391414.733866:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788391414.733907:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103529344:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788391414.733924:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391414.734766:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103529472:0@lo:400:kworker.0 00000100:00100000:0.0:1788391414.734808:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391414.734829:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103529600:0@lo:400:kworker.0 00000100:00100000:0.0:1788391414.734855:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529472 00000100:00100000:0.0:1788391414.734861:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529472 00000100:00100000:1.0:1788391414.734866:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391414.734902:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788391414.734911:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103529472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391414.734954:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103529472:12345-0@lo:400:kworker.0 Request processed in 45us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391414.735005:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788391414.735049:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103529472:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735296:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391414.735302:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103529728:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391414.735372:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529600 00000100:00100000:0.0:1788391414.735375:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529728 00000100:00100000:1.0:1788391414.735377:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529600 00000100:00100000:0.0:1788391414.735387:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529728 00000100:00100000:1.0:1788391414.735419:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788391414.735426:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391414.735432:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788391414.735442:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103529728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735464:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103529600:12345-0@lo:400:kworker.0 Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391414.735470:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788391414.735498:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69225e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103529728:12345-0@lo:400:kworker.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00080000:1.0:1788391414.735503:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391414.735508:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788391414.735528:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103529728:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735542:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103529600:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735625:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103529856:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735654:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391414.735666:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103529984:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735682:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529856 00000100:00100000:1.0:1788391414.735687:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529856 00000100:00100000:2.0:1788391414.735698:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391414.735722:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103529984 00000100:00100000:1.0:1788391414.735725:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103529984 00000100:00100000:2.0:1788391414.735732:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788391414.735739:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735754:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788391414.735761:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103529984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391414.735775:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103529856:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391414.735781:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788391414.735791:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103529984:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391414.735797:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:1.0:1788391414.735813:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391414.735828:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103529856:0@lo:400:kworker.0 00000100:00100000:1.0:1788391414.735848:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103529984:0@lo:400:kworker.0 00000100:00100000:1.0:1788391415.757275:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103530112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391415.757462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788391415.757512:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391415.757523:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530112 00000100:00100000:0.0:1788391415.757532:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530112 00000100:00100000:0.0:1788391415.757589:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788391415.757600:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103530112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391415.757635:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391415.757690:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58cb18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103530112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391415.757697:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788391415.757753:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103530112:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788391416.134353:0:52575:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391416.134360:0:52575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391416.135051:0:52575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391416.135059:0:52575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391416.436878:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391416.436922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391416.436947:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358400 00000100:00100000:2.0:1788391416.437000:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358400 00000100:00100000:2.0:1788391416.437053:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:3.0:1788391416.437062:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391416.437067:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094358400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391416.437146:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d69239ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094358400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391416.437151:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358656 00000100:00100000:2.0:1788391416.437156:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:1.0:1788391416.437157:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358656 00000100:00100000:1.0:1788391416.437199:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1788391416.437205:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094358656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788391416.437212:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391416.437235:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094358656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391416.437243:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:0.0:1788391416.437310:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358912 00000100:00100000:0.0:1788391416.437314:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358912 00000100:00100000:0.0:1788391416.437351:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00100000:0.0:1788391416.437361:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094358912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391416.437385:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094358912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391416.437390:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 261 00000100:00080000:2.0:1788391416.437437:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391416.440207:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391416.440248:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391416.440274:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358528 00000100:00100000:3.0:1788391416.440285:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358528 00000100:00100000:0.0:1788391416.440309:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094358784 00000100:00100000:0.0:1788391416.440321:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094358784 00000100:00100000:3.0:1788391416.440355:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 262 00000100:00100000:0.0:1788391416.440362:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1788391416.440368:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094358528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391416.440380:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094358784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788391416.440460:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788391416.440463:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391416.440524:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094358784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391416.440533:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1788391416.440732:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094358528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 366us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391416.440740:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 262 00010000:00010000:0.0:1788391416.781742:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391417.584087:0:52626:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391417.584095:0:52626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391417.584648:0:52626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391417.584657:0:52626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391417.805365:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788391418.830104:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391418.977367:0:52677:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391418.977376:0:52677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391418.977794:0:52677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391418.977801:0:52677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391419.853240:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788391419.853263:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103530240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391419.853333:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391419.853455:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530240 00000100:00100000:2.0:1788391419.853468:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530240 00000100:00100000:2.0:1788391419.853530:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788391419.853540:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103530240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391419.853633:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391419.853687:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103530240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391419.853695:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788391419.853730:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103530624:0@lo:400:kworker.0 00000100:00100000:3.0:1788391419.853762:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.853769:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391419.853808:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391419.853827:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103530240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391419.853840:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103530880:0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.853855:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788391419.853865:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103530752:0@lo:400:kworker.0 00000100:00100000:3.0:1788391419.853867:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391419.853892:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391419.853901:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103530496:0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.853907:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391419.853936:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391419.853983:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391419.853987:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530624 00000100:00100000:2.0:1788391419.853993:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530624 00000100:00100000:3.0:1788391419.854001:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530368 00000100:00100000:3.0:1788391419.854007:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530368 00000100:00100000:2.0:1788391419.854030:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530880 00000100:00100000:2.0:1788391419.854036:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530880 00000100:00100000:1.0:1788391419.854037:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530752 00000100:00100000:1.0:1788391419.854042:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530752 00000100:00100000:3.0:1788391419.854048:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788391419.854059:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391419.854072:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788391419.854080:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103530624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.854086:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788391419.854097:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103530880:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788391419.854279:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391419.854284:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391419.854296:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788391419.854310:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103530752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391419.854516:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103530624:12345-0@lo:400:kworker.0 Request processed in 435us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391419.854519:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875263103530880:12345-0@lo:400:kworker.0 Request processed in 423us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391419.854528:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788391419.854535:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788391419.854583:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103530624:0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.854617:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103530496 00000100:00100000:2.0:1788391419.854621:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103530496 00000100:00100000:3.0:1788391419.854640:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103530368:12345-0@lo:400:kworker.0 Request processed in 583us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391419.854649:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788391419.854663:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788391419.854672:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391419.854705:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788391419.854712:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103530496:12345-0@lo:400:kworker.0 Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391419.854720:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788391419.854723:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1875263103530880:0@lo:400:kworker.0 00000100:00100000:3.0:1788391419.854748:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103530496:0@lo:400:kworker.0 00000100:00080000:1.0:1788391419.854839:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391419.854933:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103530752:12345-0@lo:400:kworker.0 Request processed in 629us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391419.854944:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788391419.854976:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103530752:0@lo:400:kworker.0 00000040:00080000:1.0:1788391420.491252:0:52729:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391420.491262:0:52729:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391420.494310:0:52729:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391420.494327:0:52729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391420.877179:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391420.877263:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391420.877353:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531008 00000100:00100000:0.0:1788391420.877363:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531008 00000100:00100000:0.0:1788391420.877420:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788391420.877441:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531008:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391420.877450:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1788391420.877476:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391420.877532:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391420.877539:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788391420.878054:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531008:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788391421.197300:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391421.197309:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391421.197748:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391421.197755:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391421.559753:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391421.559794:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391421.559826:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359040 00000100:00100000:3.0:1788391421.559832:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391421.559841:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359040 00000100:00100000:3.0:1788391421.559859:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391421.559875:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391421.559901:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359552 00000100:00100000:2.0:1788391421.559908:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359552 00000100:00100000:3.0:1788391421.559915:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359168 00000100:00100000:3.0:1788391421.559920:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359168 00000100:00100000:0.0:1788391421.559921:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:0.0:1788391421.559935:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094359040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391421.559989:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:2.0:1788391421.559997:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094359552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391421.560007:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359296 00000100:00100000:1.0:1788391421.560013:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359296 00000100:00100000:2.0:1788391421.560040:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094359552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391421.560041:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d692399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094359040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391421.560049:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:1.0:1788391421.560053:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359424 00000100:00100000:0.0:1788391421.560059:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:1.0:1788391421.560060:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359424 00000100:00100000:2.0:1788391421.560072:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:2.0:1788391421.560082:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094359168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391421.560100:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:2.0:1788391421.560113:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094359168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391421.560114:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094359296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391421.560129:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 267 00000100:00100000:1.0:1788391421.560159:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094359296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391421.560169:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:2.0:1788391421.560183:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00080000:3.0:1788391421.560185:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391421.560192:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391421.560196:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094359424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:3.0:1788391421.560198:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391421.560274:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094359424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391421.560281:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00010000:00010000:2.0:1788391421.901119:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391421.903319:0:52780:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391421.903324:0:52780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391421.905814:0:52780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391421.905829:0:52780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391422.927478:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391423.341885:0:52831:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391423.341897:0:52831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391423.342436:0:52831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391423.342446:0:52831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391423.949133:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391424.741378:0:52882:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391424.741386:0:52882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391424.742210:0:52882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391424.742221:0:52882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391424.973449:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391424.973749:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531520:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.973802:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391424.973924:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103531136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391424.973955:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391424.974031:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103531264:0@lo:400:kworker.0 00000100:00100000:3.0:1788391424.974077:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391424.974462:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788391424.974470:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531392:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.974496:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391424.974520:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103531904:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.974544:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391424.974581:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531520 00000100:00100000:1.0:1788391424.974588:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531520 00000100:00100000:1.0:1788391424.974648:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531392 00000100:00100000:0.0:1788391424.974649:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531904 00000100:00100000:1.0:1788391424.974651:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531392 00000100:00100000:0.0:1788391424.974652:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531904 00000100:00100000:1.0:1788391424.974673:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788391424.974678:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788391424.974682:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391424.974688:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103531904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391424.974730:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103531904:12345-0@lo:400:kworker.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391424.974731:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531520:12345-0@lo:400:kworker.0 Request processed in 51us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391424.974737:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788391424.974737:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788391424.974753:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788391424.974760:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103531648:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.974762:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391424.974778:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103531904:0@lo:400:kworker.0 00000100:00100000:0.0:1788391424.974791:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531520:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.974804:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103531392:12345-0@lo:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391424.974813:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788391424.974816:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391424.974816:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103531392:0@lo:400:kworker.0 00000100:00080000:0.0:1788391424.974853:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391424.974859:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391424.974862:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391424.974863:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531136 00000100:00100000:2.0:1788391424.974869:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531136 00000100:00100000:0.0:1788391424.974879:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531264 00000100:00100000:0.0:1788391424.974884:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531264 00000100:00100000:2.0:1788391424.974902:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788391424.974912:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103531136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391424.974920:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788391424.974930:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103531264:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788391424.974939:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391424.974939:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531648 00000100:00100000:1.0:1788391424.974944:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531648 00000100:00100000:0.0:1788391424.974982:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103531264:12345-0@lo:400:kworker.0 Request processed in 54us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391424.974989:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788391424.975007:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103531136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391424.975014:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788391424.975115:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103531136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391424.975196:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103531264:0@lo:400:kworker.0 00000100:00100000:3.0:1788391424.975205:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103531776:0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.975245:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788391424.975255:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc721050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103531648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391424.975294:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc721050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103531648:12345-0@lo:400:kworker.0 Request processed in 40us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391424.975300:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788391424.975378:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103531648:0@lo:400:kworker.0 00000100:00100000:3.0:1788391424.975399:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391424.975520:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103531776 00000100:00100000:2.0:1788391424.975525:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103531776 00000100:00080000:0.0:1788391424.975574:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391424.975617:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788391424.975628:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391424.975679:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103531776:12345-0@lo:400:kworker.0 Request processed in 53us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391424.975686:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788391424.975709:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103531776:0@lo:400:kworker.0 00010000:00010000:3.0:1788391425.997116:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391425.998199:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103532032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391425.998282:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391425.998829:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532032 00000100:00100000:2.0:1788391425.998838:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532032 00000100:00100000:2.0:1788391425.998893:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788391425.998903:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103532032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391425.998938:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391425.999020:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103532032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391425.999027:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788391425.999442:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103532032:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788391426.169767:0:52933:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391426.169775:0:52933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391426.170219:0:52933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391426.170228:0:52933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391426.676952:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391426.677273:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391426.677297:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391426.677311:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391426.677327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391426.677361:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359936 00000100:00100000:1.0:1788391426.677369:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359936 00000100:00100000:1.0:1788391426.677422:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360064 00000100:00100000:1.0:1788391426.677424:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360064 00000100:00100000:1.0:1788391426.677437:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:1.0:1788391426.677443:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094359936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391426.677496:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094359936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391426.677501:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:1.0:1788391426.677511:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1788391426.677515:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094360064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391426.677528:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094360064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 13us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391426.677531:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00080000:1.0:1788391426.677541:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391426.677544:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391426.677692:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359680 00000100:00100000:2.0:1788391426.677695:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359680 00000100:00100000:2.0:1788391426.677723:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:2.0:1788391426.677728:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094359680:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391426.677752:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094359680:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391426.677756:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1788391426.678127:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094359808 00000100:00100000:0.0:1788391426.678131:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094359808 00000100:00100000:0.0:1788391426.678199:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360192 00000100:00100000:0.0:1788391426.678202:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360192 00000100:00100000:3.0:1788391426.678283:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00100000:3.0:1788391426.678289:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094359808:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391426.678317:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094359808:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391426.678322:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 271 00000100:00080000:1.0:1788391426.678418:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391426.678574:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 272 00000100:00100000:0.0:1788391426.678583:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094360192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391426.678624:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094360192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391426.678634:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 272 00010000:00010000:3.0:1788391427.022528:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391427.597442:0:52985:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391427.597451:0:52985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391427.598163:0:52985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391427.598173:0:52985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391428.045223:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391429.064701:0:53036:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391429.064711:0:53036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391429.065466:0:53036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391429.065476:0:53036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391429.070642:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391430.093173:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391430.093272:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103532160:0@lo:400:kworker.0 00000100:00100000:2.0:1788391430.093299:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103532544:0@lo:400:kworker.0 00000100:00100000:2.0:1788391430.093356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391430.093417:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103532416:0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.093452:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391430.093477:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391430.093498:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532544 00000100:00100000:3.0:1788391430.093507:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532544 00000100:00100000:0.0:1788391430.093512:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103532288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391430.093542:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391430.093564:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532416 00000100:00100000:3.0:1788391430.093569:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532416 00000100:00100000:0.0:1788391430.093586:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788391430.093603:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103532544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.093609:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788391430.093620:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103532416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.093667:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103532416:12345-0@lo:400:kworker.0 Request processed in 50us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391430.093673:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1788391430.093694:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391430.093697:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391430.093731:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103532416:0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.093766:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532288 00000100:00100000:3.0:1788391430.093769:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532288 00000100:00100000:3.0:1788391430.093793:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788391430.093799:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103532288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391430.093827:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391430.093861:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875263103532288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391430.093866:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788391430.093883:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532160 00000100:00100000:3.0:1788391430.093886:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532160 00000100:00100000:3.0:1788391430.093908:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788391430.093915:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103532160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.093941:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103532160:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391430.093947:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788391430.094149:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103532544:12345-0@lo:400:kworker.0 Request processed in 553us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391430.094157:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788391430.094180:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103532672:0@lo:400:kworker.0 00000100:00100000:0.0:1788391430.094187:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103532800:0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.094302:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103532928:0@lo:400:kworker.0 00000100:00100000:1.0:1788391430.094349:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391430.094473:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532672 00000100:00100000:0.0:1788391430.094479:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532672 00000100:00100000:3.0:1788391430.094483:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391430.094513:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532928 00000100:00100000:0.0:1788391430.094518:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532928 00000100:00100000:3.0:1788391430.094535:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788391430.094545:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391430.094555:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788391430.094566:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103532928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391430.094583:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103532672:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391430.094590:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788391430.094616:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103532928:12345-0@lo:400:kworker.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00080000:3.0:1788391430.094623:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391430.094627:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788391430.094651:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103532928:0@lo:400:kworker.0 00000100:00100000:0.0:1788391430.094658:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391430.094688:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103532160:0@lo:400:kworker.0 00000100:00100000:0.0:1788391430.094703:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103532288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391430.094724:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103532800 00000100:00100000:0.0:1788391430.094727:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103532800 00000100:00100000:0.0:1788391430.094749:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788391430.094756:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391430.094787:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103532800:12345-0@lo:400:kworker.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391430.094793:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788391430.094816:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103532800:0@lo:400:kworker.0 00000100:00080000:3.0:1788391430.094868:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391430.095017:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103532672:0@lo:400:kworker.0 00000100:00100000:2.0:1788391430.095082:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103532544:0@lo:400:kworker.0 00000040:00080000:0.0:1788391430.513816:0:53087:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391430.513826:0:53087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391430.514496:0:53087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391430.514505:0:53087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391431.118263:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391431.118454:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103533056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391431.118523:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391431.118866:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533056 00000100:00100000:2.0:1788391431.118874:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533056 00000100:00100000:2.0:1788391431.118926:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788391431.118945:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103533056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391431.119080:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391431.119652:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103533056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391431.119703:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391431.123153:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103533056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4208us (4619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391431.123168:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000040:00080000:3.0:1788391431.441848:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391431.441872:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391431.442457:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391431.442467:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391431.799544:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391431.799577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391431.799604:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391431.799624:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391431.799647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391431.799676:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360576 00000100:00100000:2.0:1788391431.799684:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360576 00000100:00100000:2.0:1788391431.799736:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360704 00000100:00100000:2.0:1788391431.799740:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360704 00000100:00100000:2.0:1788391431.799761:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:2.0:1788391431.799771:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094360576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391431.799885:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360320 00000100:00100000:1.0:1788391431.799890:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360320 00000100:00100000:1.0:1788391431.799915:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:1.0:1788391431.799922:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094360320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391431.799988:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094360320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391431.799996:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:2.0:1788391431.800313:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094360576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 543us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391431.800321:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:2.0:1788391431.800348:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1788391431.800355:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094360704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391431.800383:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2357:x1875263094360704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391431.800389:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1788391431.800409:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360832 00000100:00100000:2.0:1788391431.800413:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360832 00000100:00100000:2.0:1788391431.800482:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360448 00000100:00100000:2.0:1788391431.800486:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360448 00000100:00080000:3.0:1788391431.801592:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391431.801600:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391431.801603:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391431.802064:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:1.0:1788391431.802077:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094360832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391431.802135:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094360832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 61us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391431.802143:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:1.0:1788391431.802163:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:1.0:1788391431.802170:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094360448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391431.802195:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2357:x1875263094360448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391431.802207:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 277 00000040:00080000:3.0:1788391432.000513:0:53138:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391432.000522:0:53138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391432.001908:0:53138:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391432.001918:0:53138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391432.141231:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788391433.165131:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391433.479026:0:53189:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391433.479034:0:53189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391433.479425:0:53189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391433.479433:0:53189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391434.189164:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391434.868929:0:53241:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391434.868937:0:53241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391434.869492:0:53241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391434.869501:0:53241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391435.213104:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391435.213141:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103533312:0@lo:400:kworker.0 00000100:00100000:1.0:1788391435.213141:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103533184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391435.213251:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103533440:0@lo:400:kworker.0 00000100:00100000:1.0:1788391435.213331:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391435.213345:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103533568:0@lo:400:kworker.0 00000100:00100000:0.0:1788391435.213383:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391435.213404:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103533696:0@lo:400:kworker.0 00000100:00100000:0.0:1788391435.213425:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533568 00000100:00100000:0.0:1788391435.213433:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533568 00000100:00100000:1.0:1788391435.213451:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391435.213489:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533696 00000100:00100000:1.0:1788391435.213493:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533696 00000100:00100000:0.0:1788391435.213502:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788391435.213519:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103533568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391435.213527:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788391435.213536:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103533696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391435.213589:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103533696:12345-0@lo:400:kworker.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391435.213595:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103533568:12345-0@lo:400:kworker.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391435.213601:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788391435.213606:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788391435.213653:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103533696:0@lo:400:kworker.0 00000100:00100000:0.0:1788391435.213662:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103533568:0@lo:400:kworker.0 00000100:00080000:1.0:1788391435.213705:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391435.213720:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533184 00000100:00100000:1.0:1788391435.213724:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533184 00000100:00100000:1.0:1788391435.213756:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788391435.213763:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103533184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391435.213789:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:1.0:1788391435.213827:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103533184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391435.213833:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788391435.213861:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103533184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391435.215040:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391435.215094:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103533824:0@lo:400:kworker.0 00000100:00100000:0.0:1788391435.215095:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533312 00000100:00100000:0.0:1788391435.215103:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533312 00000100:00100000:2.0:1788391435.215134:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391435.215145:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788391435.215155:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391435.215181:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533824 00000100:00100000:2.0:1788391435.215186:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533824 00000100:00100000:0.0:1788391435.215203:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103533312:12345-0@lo:400:kworker.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391435.215212:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788391435.215228:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788391435.215237:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103533824:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788391435.215257:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391435.215275:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103533824:12345-0@lo:400:kworker.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391435.215283:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788391435.215324:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103533824:0@lo:400:kworker.0 00000100:00100000:2.0:1788391435.215334:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103533312:0@lo:400:kworker.0 00000100:00100000:3.0:1788391435.215372:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391435.215402:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103533952:0@lo:400:kworker.0 00000100:00100000:3.0:1788391435.215425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391435.215503:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533952 00000100:00100000:0.0:1788391435.215508:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533952 00000100:00100000:0.0:1788391435.215576:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788391435.215583:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103533952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391435.215617:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103533952:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391435.215622:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788391435.215647:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103533952:0@lo:400:kworker.0 00000100:00080000:3.0:1788391435.215735:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391435.216037:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103533440 00000100:00100000:2.0:1788391435.216042:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103533440 00000100:00080000:3.0:1788391435.216084:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391435.216088:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788391435.216097:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103533440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391435.216144:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103533440:12345-0@lo:400:kworker.0 Request processed in 49us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391435.216149:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788391435.216181:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103533440:0@lo:400:kworker.0 00010000:00010000:3.0:1788391436.237526:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391436.238078:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391436.238101:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103534080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391436.238200:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391436.238315:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534080 00000100:00100000:2.0:1788391436.238322:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534080 00000100:00100000:2.0:1788391436.238388:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788391436.238398:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103534080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391436.238436:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391436.238484:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103534080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391436.238491:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788391436.238545:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103534080:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788391436.281838:0:53292:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391436.281849:0:53292:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391436.282441:0:53292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391436.282450:0:53292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788391436.918426:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391436.918471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391436.918506:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1788391436.918549:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391436.918567:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094360960 00000100:00100000:1.0:1788391436.918578:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094360960 00000100:00100000:0.0:1788391436.918589:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361472 00000100:00100000:0.0:1788391436.918596:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361472 00000100:00100000:2.0:1788391436.918619:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391436.918644:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361216 00000100:00100000:0.0:1788391436.918647:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361088 00000100:00100000:3.0:1788391436.918650:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361216 00000100:00100000:1.0:1788391436.918652:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:0.0:1788391436.918654:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361088 00000100:00080000:2.0:1788391436.918661:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391436.918669:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094360960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788391436.918676:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391436.918697:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361344 00000100:00100000:0.0:1788391436.918702:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:3.0:1788391436.918704:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361344 00000100:00100000:2.0:1788391436.918705:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1788391436.918713:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094361472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391436.918716:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094361216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391436.918743:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094360960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391436.918750:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:2.0:1788391436.918755:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094361216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391436.918755:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094361472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391436.918756:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:3.0:1788391436.918766:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094361344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391436.918771:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1788391436.918771:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:0.0:1788391436.918792:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 282 00000100:00100000:0.0:1788391436.918801:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094361088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1788391436.918805:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788391436.918809:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094361344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391436.918822:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:0.0:1788391436.918833:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094361088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391436.918840:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 282 00010000:00010000:2.0:1788391437.261534:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391437.710880:0:53343:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391437.710890:0:53343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391437.711415:0:53343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391437.711423:0:53343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391438.285196:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391439.142640:0:53394:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391439.142648:0:53394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391439.143212:0:53394:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391439.143221:0:53394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391439.309107:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788391440.333143:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788391440.333164:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103534208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391440.333270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391440.333362:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534208 00000100:00100000:0.0:1788391440.333370:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534208 00000100:00100000:0.0:1788391440.333436:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788391440.333447:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103534208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788391440.333488:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00080000:3.0:1788391440.333530:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391440.333531:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103534208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391440.333540:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788391440.333583:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103534208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391440.333734:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788391440.333753:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103534592:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.333767:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391440.333792:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391440.333798:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788391440.333818:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391440.333828:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391440.333829:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103534720:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.333847:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391440.333854:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103534464:0@lo:400:kworker.0 00000100:00100000:1.0:1788391440.333860:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391440.333881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391440.333895:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534592 00000100:00100000:1.0:1788391440.333899:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534592 00000100:00100000:3.0:1788391440.333912:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534336 00000100:00100000:3.0:1788391440.333917:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534336 00000100:00100000:1.0:1788391440.333933:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534848 00000100:00100000:1.0:1788391440.333938:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534848 00000100:00100000:3.0:1788391440.333947:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788391440.333953:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103534336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391440.333988:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534720 00000100:00100000:1.0:1788391440.333992:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534720 00000100:00100000:3.0:1788391440.334000:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103534336:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391440.334006:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788391440.334013:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788391440.334022:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103534592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334035:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788391440.334042:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103534848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391440.334068:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103534592:12345-0@lo:400:kworker.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391440.334074:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103534848:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391440.334081:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788391440.334091:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788391440.334110:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788391440.334115:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334135:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875263103534720:12345-0@lo:400:kworker.0 Request processed in 20us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391440.334139:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788391440.334147:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1875263103534720:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334156:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534464 00000100:00100000:3.0:1788391440.334160:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534464 00000100:00100000:1.0:1788391440.334163:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103534592:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334184:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788391440.334189:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103534464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334207:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103534464:12345-0@lo:400:kworker.0 Request processed in 19us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391440.334211:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1788391440.334228:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391440.334230:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391440.334241:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103534464:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334259:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103534848:0@lo:400:kworker.0 00000100:00100000:3.0:1788391440.334266:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103534336:0@lo:400:kworker.0 00010000:00010000:3.0:1788391440.334632:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391440.663668:0:53446:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391440.663678:0:53446:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391440.664489:0:53446:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391440.664499:0:53446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391441.357129:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391441.358085:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103534976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391441.358162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391441.358199:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103534976 00000100:00100000:2.0:1788391441.358207:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103534976 00000100:00100000:2.0:1788391441.358321:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788391441.358332:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103534976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391441.358366:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391441.358510:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103534976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391441.358516:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788391441.358571:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103534976:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788391441.677574:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391441.677587:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391441.678131:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391441.678140:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391442.038195:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391442.038231:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391442.038272:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391442.038293:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391442.038315:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391442.038340:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361856 00000100:00100000:1.0:1788391442.038349:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361856 00000100:00100000:1.0:1788391442.038399:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361984 00000100:00100000:1.0:1788391442.038402:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361984 00000100:00100000:1.0:1788391442.038424:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1788391442.038461:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094361856:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391442.038522:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2357:x1875263094361856:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391442.038529:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:1.0:1788391442.038546:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788391442.038553:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094361984:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391442.038573:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094361984:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391442.038579:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:1.0:1788391442.038594:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361728 00000100:00100000:1.0:1788391442.038597:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361728 00000100:00100000:1.0:1788391442.038617:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362112 00000100:00100000:1.0:1788391442.038620:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362112 00000100:00100000:1.0:1788391442.038639:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:1.0:1788391442.038645:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094361728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391442.038670:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094361728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391442.038676:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:1.0:1788391442.038686:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:1.0:1788391442.038692:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094362112:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391442.038709:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2357:x1875263094362112:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391442.038714:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00080000:3.0:1788391442.038862:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788391442.038867:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391442.038869:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391442.038913:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094361600 00000100:00100000:2.0:1788391442.038917:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094361600 00000100:00100000:2.0:1788391442.038944:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1788391442.038951:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094361600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391442.039010:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2357:x1875263094361600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391442.039016:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000040:00080000:3.0:1788391442.199825:0:53498:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391442.199847:0:53498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391442.200514:0:53498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391442.200524:0:53498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391442.381184:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391443.405155:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391443.675177:0:53549:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391443.675188:0:53549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391443.677524:0:53549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391443.677541:0:53549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391444.430834:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391445.247948:0:53600:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391445.247957:0:53600:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391445.248989:0:53600:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391445.248999:0:53600:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391445.455175:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391445.455252:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103535104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788391445.455264:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391445.455320:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.455835:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103535360:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.455868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.455898:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788391445.455905:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103535488:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.455951:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.456002:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535488 00000100:00100000:1.0:1788391445.456009:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535488 00000100:00100000:1.0:1788391445.456059:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788391445.456069:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456120:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875263103535488:12345-0@lo:400:kworker.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391445.456127:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788391445.456169:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875263103535488:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456189:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103535232:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456233:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.456272:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103535744:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456295:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.456312:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788391445.456317:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103535616:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456339:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391445.456362:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535232 00000100:00100000:1.0:1788391445.456366:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535232 00000100:00100000:1.0:1788391445.456392:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788391445.456398:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103535232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391445.456422:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535744 00000100:00100000:0.0:1788391445.456426:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535744 00000100:00100000:1.0:1788391445.456432:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103535232:12345-0@lo:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391445.456438:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788391445.456457:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535616 00000100:00100000:0.0:1788391445.456460:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535616 00000100:00100000:1.0:1788391445.456470:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103535232:0@lo:400:kworker.0 00000100:00100000:0.0:1788391445.456484:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788391445.456488:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788391445.456491:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103535744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456493:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103535616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391445.456557:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535360 00000100:00100000:2.0:1788391445.456561:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535360 00000100:00100000:2.0:1788391445.456591:0:43327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788391445.456598:0:43327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103535360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391445.456636:0:43327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103535360:12345-0@lo:400:kworker.0 Request processed in 38us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391445.456642:0:43327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:2.0:1788391445.456672:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788391445.456677:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391445.456705:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103535360:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.456752:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103535616:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391445.456759:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788391445.456827:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535104 00000100:00100000:3.0:1788391445.456832:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535104 00000100:00100000:3.0:1788391445.456876:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788391445.456883:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103535104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391445.456911:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00080000:2.0:1788391445.456978:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391445.459387:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103535744:12345-0@lo:400:kworker.0 Request processed in 2889us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391445.459401:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788391445.460213:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103535616:0@lo:400:kworker.0 00000100:00100000:1.0:1788391445.460235:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103535744:0@lo:400:kworker.0 00000100:00100000:3.0:1788391445.460485:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103535104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3601us (5164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391445.460492:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788391445.460548:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103535104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788391446.477227:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391446.477254:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103535872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391446.477322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391446.477391:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103535872 00000100:00100000:0.0:1788391446.477399:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103535872 00000100:00100000:0.0:1788391446.477452:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788391446.477464:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103535872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391446.477499:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788391446.477546:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103535872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391446.477553:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788391446.477829:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103535872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788391446.483797:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391446.736438:0:53651:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391446.736446:0:53651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391446.736994:0:53651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391446.737005:0:53651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391447.157763:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391447.157794:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391447.157826:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362240 00000100:00100000:1.0:1788391447.157826:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391447.157838:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362240 00000100:00100000:1.0:1788391447.157851:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391447.157876:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391447.157899:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1788391447.157900:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362752 00000100:00100000:1.0:1788391447.157904:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362752 00000100:00100000:3.0:1788391447.157913:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094362240:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391447.157934:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362368 00000100:00100000:1.0:1788391447.157937:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362368 00000100:00100000:1.0:1788391447.157954:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:1.0:1788391447.157985:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094362752:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391447.158019:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094362752:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391447.158020:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094362240:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391447.158030:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:3.0:1788391447.158035:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1788391447.158049:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:1.0:1788391447.158058:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094362368:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391447.158086:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094362368:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391447.158093:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00080000:1.0:1788391447.158109:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391447.158442:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362496 00000100:00100000:2.0:1788391447.158447:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362496 00000100:00100000:3.0:1788391447.158695:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362624 00000100:00100000:3.0:1788391447.158699:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362624 00000100:00100000:2.0:1788391447.158756:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:2.0:1788391447.158762:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094362496:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391447.158791:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094362496:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391447.158795:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00080000:0.0:1788391447.161518:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788391447.161528:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391447.161828:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:3.0:1788391447.161842:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094362624:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391447.161921:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68527b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094362624:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391447.161929:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00010000:00010000:3.0:1788391447.501181:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391448.169908:0:53702:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391448.169918:0:53702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391448.170486:0:53702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391448.170495:0:53702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788391448.525140:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391449.552732:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391449.702124:0:53754:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391449.702134:0:53754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391449.702861:0:53754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391449.702868:0:53754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391450.573249:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788391450.573285:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d685278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103536000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391450.573410:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788391450.575248:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391450.575934:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536000 00000100:00100000:2.0:1788391450.575946:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536000 00000100:00080000:1.0:1788391450.576036:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788391450.576061:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788391450.576073:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103536000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788391450.576126:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391450.576256:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103536000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391450.576263:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788391450.576401:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d685278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103536000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391450.576839:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103536128:0@lo:400:kworker.0 00000100:00100000:1.0:1788391450.576884:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391450.577004:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536128 00000100:00100000:2.0:1788391450.577009:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536128 00000100:00100000:2.0:1788391450.577039:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788391450.577046:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391450.577095:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103536256:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577209:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103536512:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391450.577295:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788391450.577301:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103536384:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391450.577347:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536512 00000100:00100000:0.0:1788391450.577350:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536512 00000100:00100000:0.0:1788391450.577383:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536384 00000100:00100000:0.0:1788391450.577387:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536384 00000100:00100000:0.0:1788391450.577413:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788391450.577414:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391450.577426:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103536512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391450.577470:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391450.577475:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103536512:12345-0@lo:400:kworker.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391450.577482:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103536640:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577486:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788391450.577507:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788391450.577519:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391450.577521:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391450.577560:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875263103536384:12345-0@lo:400:kworker.0 Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391450.577563:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536256 00000100:00100000:3.0:1788391450.577569:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536256 00000100:00100000:0.0:1788391450.577569:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788391450.577585:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536640 00000100:00100000:0.0:1788391450.577589:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536640 00000100:00100000:3.0:1788391450.577610:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788391450.577625:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103536256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577625:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788391450.577637:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103536640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391450.577670:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103536256:12345-0@lo:400:kworker.0 Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391450.577680:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1875263103536640:12345-0@lo:400:kworker.0 Request processed in 46us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391450.577690:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788391450.577703:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788391450.577723:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1875263103536640:0@lo:400:kworker.0 00000100:00100000:3.0:1788391450.577738:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103536256:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577748:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875263103536384:0@lo:400:kworker.0 00000100:00100000:0.0:1788391450.577764:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103536512:0@lo:400:kworker.0 00000100:00080000:3.0:1788391450.577797:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788391450.577801:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391450.578031:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3288:x1875263103536128:12345-0@lo:400:kworker.0 Request processed in 984us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391450.578039:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788391450.578171:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3288:1875263103536128:0@lo:400:kworker.0 00000040:00080000:3.0:1788391451.118808:0:53805:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391451.118817:0:53805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391451.121266:0:53805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391451.121279:0:53805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391451.597096:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391451.597292:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391451.597314:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103536768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788391451.597381:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391451.597442:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536768 00000100:00100000:0.0:1788391451.597450:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536768 00000100:00100000:0.0:1788391451.597510:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788391451.597521:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103536768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788391451.597558:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391451.597666:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d5853d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103536768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391451.597803:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103536768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391451.597813:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000040:00080000:3.0:1788391451.917236:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391451.917245:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391451.917764:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391451.917773:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391452.276819:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391452.276849:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391452.276881:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391452.276899:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363008 00000100:00100000:1.0:1788391452.276906:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391452.276909:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363008 00000100:00100000:1.0:1788391452.276927:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391452.276952:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363392 00000100:00100000:1.0:1788391452.276956:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363392 00000100:00100000:0.0:1788391452.277000:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:0.0:1788391452.277016:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094363008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391452.277038:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:1.0:1788391452.277048:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094363392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391452.277102:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d685279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2359:x1875263094363008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391452.277103:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094363392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391452.277116:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363264 00000100:00100000:0.0:1788391452.277116:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:2.0:1788391452.277122:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363264 00000100:00100000:1.0:1788391452.277126:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:3.0:1788391452.277135:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094362880 00000100:00100000:3.0:1788391452.277153:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094362880 00000100:00100000:2.0:1788391452.277181:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363136 00000100:00100000:2.0:1788391452.277188:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363136 00000100:00100000:3.0:1788391452.277197:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:1.0:1788391452.277204:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:3.0:1788391452.277209:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094362880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391452.277217:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094363264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391452.277238:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:2.0:1788391452.277252:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094363136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391452.277257:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094362880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391452.277269:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:1.0:1788391452.277272:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2359:x1875263094363264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 54us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391452.277283:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:2.0:1788391452.277305:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d587647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094363136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391452.277317:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00080000:1.0:1788391452.277318:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391452.277324:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391452.277328:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788391452.546532:0:53856:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391452.546541:0:53856:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391452.549322:0:53856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391452.549340:0:53856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391452.622068:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391453.645283:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391453.978333:0:53907:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391453.978345:0:53907:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391453.979103:0:53907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391453.979113:0:53907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788391454.669348:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391455.419613:0:53958:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391455.419623:0:53958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391455.420262:0:53958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391455.420312:0:53958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391455.693180:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103536896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391455.694940:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391455.695164:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103536896 00000100:00100000:1.0:1788391455.695174:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103536896 00000100:00100000:1.0:1788391455.695237:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788391455.695248:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103536896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391455.695282:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00080000:3.0:1788391455.695334:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391455.695347:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103536896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391455.695354:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788391455.695393:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103536896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788391455.696247:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391455.696584:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103537152:0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.696632:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391455.696665:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788391455.696672:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103537280:0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.696699:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391455.696730:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537152 00000100:00100000:1.0:1788391455.696736:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537152 00000100:00100000:1.0:1788391455.696780:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788391455.696788:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103537152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.696831:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103537152:12345-0@lo:400:kworker.0 Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391455.696837:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1788391455.696854:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788391455.696874:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103537152:0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.696901:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537280 00000100:00100000:1.0:1788391455.696904:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537280 00000100:00100000:1.0:1788391455.696927:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788391455.696932:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103537280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.696980:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103537280:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391455.696985:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788391455.697010:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103537280:0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697098:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697142:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391455.697174:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103537536:0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697196:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391455.697215:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788391455.697220:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103537408:0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391455.697263:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537536 00000100:00100000:2.0:1788391455.697267:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537536 00000100:00100000:2.0:1788391455.697295:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537408 00000100:00100000:2.0:1788391455.697298:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537408 00000100:00100000:2.0:1788391455.697319:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788391455.697325:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103537536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697356:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875263103537536:12345-0@lo:400:kworker.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391455.697361:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788391455.697373:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788391455.697378:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103537408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697400:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875263103537408:12345-0@lo:400:kworker.0 Request processed in 22us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391455.697405:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1788391455.697424:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391455.697440:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1875263103537408:0@lo:400:kworker.0 00000100:00100000:2.0:1788391455.697449:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1875263103537536:0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.697649:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537024 00000100:00100000:1.0:1788391455.697653:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537024 00000100:00100000:1.0:1788391455.697687:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788391455.697695:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103537024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391455.697734:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3287:x1875263103537024:12345-0@lo:400:kworker.0 Request processed in 40us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391455.697740:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788391455.697813:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3287:1875263103537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788391456.718420:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788391456.718444:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103537664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788391456.718513:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391456.718793:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537664 00000100:00100000:1.0:1788391456.718803:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537664 00010000:00010000:2.0:1788391456.718807:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391456.718865:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788391456.718877:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103537664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391456.718912:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391456.718973:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103537664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391456.718981:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788391456.719027:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d6bc68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103537664:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788391456.929050:0:54010:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391456.929059:0:54010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391456.929725:0:54010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391456.929734:0:54010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788391457.397814:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391457.397865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391457.397883:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363648 00000100:00100000:0.0:1788391457.397894:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363648 00000100:00100000:1.0:1788391457.397899:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391457.397941:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391457.397991:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363520 00000100:00100000:3.0:1788391457.397997:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363520 00000100:00100000:0.0:1788391457.397999:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:0.0:1788391457.398012:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094363648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391457.398022:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391457.398048:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:3.0:1788391457.398057:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094363520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391457.398057:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363776 00000100:00100000:1.0:1788391457.398064:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363776 00000100:00100000:3.0:1788391457.398090:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d68f419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2359:x1875263094363520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391457.398106:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094363648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391457.398109:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:0.0:1788391457.398112:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:0.0:1788391457.398125:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364032 00000100:00100000:0.0:1788391457.398127:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364032 00000100:00100000:0.0:1788391457.398155:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:0.0:1788391457.398171:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094364032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391457.398199:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2359:x1875263094364032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391457.398205:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00080000:0.0:1788391457.398233:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391457.398237:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788391457.398258:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094363904 00000100:00100000:1.0:1788391457.398263:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094363904 00000100:00100000:2.0:1788391457.398377:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391457.398384:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094363776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391457.398419:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6bc68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2359:x1875263094363776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391457.398426:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:2.0:1788391457.398442:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:2.0:1788391457.398449:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094363904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391457.398475:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094363904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391457.398481:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00080000:3.0:1788391457.398979:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788391457.741492:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391458.415240:0:54061:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391458.415252:0:54061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391458.415788:0:54061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391458.415796:0:54061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391458.765246:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391459.789089:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391459.914574:0:54112:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391459.914586:0:54112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391459.915205:0:54112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391459.915214:0:54112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391460.813128:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391460.813180:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.813206:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103538176:0@lo:400:kworker.0 00000100:00100000:0.0:1788391460.813218:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103537792:0@lo:400:kworker.0 00000100:00100000:2.0:1788391460.813251:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391460.813866:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391460.813952:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.814012:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538176 00000100:00100000:3.0:1788391460.814020:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538176 00000100:00100000:3.0:1788391460.814077:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788391460.814087:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.814142:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103538176:12345-0@lo:400:kworker.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391460.814150:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788391460.814193:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103538176:0@lo:400:kworker.0 00000100:00100000:1.0:1788391460.814253:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537920 00000100:00100000:1.0:1788391460.814257:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537920 00000100:00100000:1.0:1788391460.814303:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788391460.814310:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103537920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391460.814345:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103537920:12345-0@lo:400:kworker.0 Request processed in 36us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391460.814351:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1788391460.814631:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788391460.814656:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391460.814657:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391460.814684:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.814692:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103538560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391460.814707:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103538432:0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.814736:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391460.814744:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103538304:0@lo:400:kworker.0 00000100:00100000:2.0:1788391460.814746:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391460.814779:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538560 00000100:00100000:3.0:1788391460.814786:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538560 00000100:00100000:0.0:1788391460.814786:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391460.814806:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538432 00000100:00100000:2.0:1788391460.814812:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538432 00000100:00100000:0.0:1788391460.814830:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538304 00000100:00100000:3.0:1788391460.814835:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788391460.814836:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538304 00000100:00100000:3.0:1788391460.814847:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103538560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788391460.814853:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788391460.814865:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58d2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103538432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391460.814875:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00002000:00000024:3.0:1788391460.814877:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:0.0:1788391460.814886:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103538304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391460.814929:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103537792 00000100:00100000:1.0:1788391460.814933:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103537792 00000100:00100000:1.0:1788391460.814974:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788391460.814982:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103537792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391460.815142:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58d2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103538432:12345-0@lo:400:kworker.0 Request processed in 279us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391460.815149:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788391460.815177:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103538432:0@lo:400:kworker.0 00000100:00080000:2.0:1788391460.815205:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788391460.815208:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391460.815247:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103538304:12345-0@lo:400:kworker.0 Request processed in 363us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391460.815255:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788391460.815281:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103538304:0@lo:400:kworker.0 00000100:00100000:0.0:1788391460.815305:0:43328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538048 00000100:00100000:0.0:1788391460.815308:0:43328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538048 00000100:00100000:0.0:1788391460.815343:0:43328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788391460.815350:0:43328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103538048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788391460.815491:0:43328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875263103538048:12345-0@lo:400:kworker.0 Request processed in 141us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391460.815498:0:43328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788391460.815525:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103538048:0@lo:400:kworker.0 00000100:00100000:1.0:1788391460.815677:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103537792:12345-0@lo:400:kworker.0 Request processed in 696us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391460.815684:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788391460.815741:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58ad32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788391460.816521:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103538560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1676us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391460.816530:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788391460.816626:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103538560:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788391461.133236:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391461.133248:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391461.133821:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391461.133831:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1788391461.424912:0:54163:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391461.424920:0:54163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391461.425444:0:54163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391461.425453:0:54163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391461.837346:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391461.837371:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103538688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391461.837455:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391461.838163:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538688 00000100:00100000:2.0:1788391461.838173:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538688 00000100:00100000:2.0:1788391461.838277:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788391461.838288:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103538688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788391461.838338:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788391461.838406:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103538688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391461.838417:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788391461.838502:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103538688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788391461.842685:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788391462.519063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391462.519098:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391462.519169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391462.519190:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364160 00000100:00100000:1.0:1788391462.519196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391462.519203:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364160 00000100:00100000:1.0:1788391462.519220:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391462.519260:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:3.0:1788391462.519271:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094364160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391462.519341:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094364160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 71us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391462.519349:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:3.0:1788391462.519384:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364672 00000100:00100000:3.0:1788391462.519389:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364672 00000100:00100000:3.0:1788391462.519426:0:43348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364288 00000100:00100000:3.0:1788391462.519430:0:43348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364288 00000100:00100000:3.0:1788391462.519455:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:3.0:1788391462.519462:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094364672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391462.519505:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094364672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391462.519511:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 306 00000100:00100000:3.0:1788391462.519525:0:43348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00100000:3.0:1788391462.519532:0:43348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094364288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391462.519561:0:43348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094364288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391462.519568:0:43348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00080000:3.0:1788391462.519691:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788391462.522364:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364416 00000100:00100000:0.0:1788391462.522375:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364416 00000100:00100000:0.0:1788391462.522425:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364544 00000100:00100000:0.0:1788391462.522428:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364544 00000100:00100000:0.0:1788391462.522452:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1788391462.522461:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094364416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391462.522518:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094364416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (3420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391462.522525:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1788391462.522539:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1788391462.522545:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094364544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391462.522561:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094364544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391462.522567:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00080000:3.0:1788391462.522766:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391462.522827:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788391462.862223:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788391462.926911:0:54215:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788391462.926922:0:54215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788391462.928797:0:54215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788391462.928814:0:54215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391463.885225:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391464.397653:0:54266:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391464.397662:0:54266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391464.402491:0:54266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391464.402503:0:54266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788391464.909261:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788391465.933093:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391465.934141:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103538816:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.934208:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391465.934251:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103539328:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.934275:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391465.934297:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788391465.934301:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103539200:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.934320:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391465.934344:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103538944:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.934365:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391465.934379:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103539456:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.934394:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391465.934534:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539328 00000100:00100000:3.0:1788391465.934541:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539328 00000100:00100000:3.0:1788391465.934588:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539200 00000100:00100000:3.0:1788391465.934592:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539200 00000100:00100000:3.0:1788391465.934607:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539456 00000100:00100000:3.0:1788391465.934610:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539456 00000100:00100000:3.0:1788391465.934627:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788391465.934636:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.934690:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1875263103539328:12345-0@lo:400:kworker.0 Request processed in 54us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.934696:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788391465.934713:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788391465.934718:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.934744:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1875263103539200:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.934750:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788391465.934762:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788391465.934768:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103539456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.934794:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103539456:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.934799:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788391465.934815:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538816 00000100:00100000:3.0:1788391465.934818:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538816 00000100:00100000:3.0:1788391465.934841:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788391465.934847:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103538816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.934876:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3289:x1875263103538816:12345-0@lo:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.934881:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788391465.934907:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103539072:0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.934930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391465.934949:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103539584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391465.934992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788391465.935029:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788391465.935050:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103538944 00000100:00100000:3.0:1788391465.935054:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103538944 00000100:00100000:3.0:1788391465.935083:0:43698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539072 00000100:00100000:3.0:1788391465.935086:0:43698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539072 00000100:00100000:3.0:1788391465.935107:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788391465.935114:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103538944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.935146:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103538944:12345-0@lo:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.935152:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788391465.935164:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788391465.935169:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103539072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.935199:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103539072:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.935205:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788391465.935222:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539584 00000100:00100000:3.0:1788391465.935226:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539584 00000100:00100000:3.0:1788391465.935247:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788391465.935252:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103539584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788391465.935275:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:3.0:1788391465.935304:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875263103539584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391465.935310:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788391465.935332:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788391465.935335:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788391465.935358:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103539072:0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.935372:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1875263103539584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391465.935445:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1875263103539200:0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.935454:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3289:1875263103538816:0@lo:400:kworker.0 00000100:00100000:3.0:1788391465.935462:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1875263103539328:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.935582:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103539456:0@lo:400:kworker.0 00000100:00100000:2.0:1788391465.935598:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58d2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103538944:0@lo:400:kworker.0 00000040:00080000:3.0:1788391465.958816:0:54317:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391465.958825:0:54317:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391465.959549:0:54317:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391465.959558:0:54317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788391466.957280:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788391466.957305:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103539712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391466.957372:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391466.957482:0:43330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539712 00000100:00100000:1.0:1788391466.957490:0:43330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539712 00000100:00100000:1.0:1788391466.957547:0:43330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788391466.957557:0:43330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103539712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788391466.957590:0:43330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788391466.957639:0:43330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1875263103539712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391466.957646:0:43330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788391466.957699:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1875263103539712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788391466.959232:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391467.576554:0:54368:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391467.576562:0:54368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391467.577129:0:54368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391467.577140:0:54368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391467.638798:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391467.638839:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391467.638886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391467.638921:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391467.638949:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391467.638989:0:42637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364800 00000100:00100000:3.0:1788391467.638997:0:42637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364800 00000100:00100000:1.0:1788391467.639019:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365184 00000100:00100000:1.0:1788391467.639025:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365184 00000100:00100000:3.0:1788391467.639062:0:42637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:3.0:1788391467.639073:0:42637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094364800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391467.639087:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365056 00000100:00100000:1.0:1788391467.639092:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365056 00000100:00100000:1.0:1788391467.639123:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:1.0:1788391467.639132:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094365184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391467.639140:0:42637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12917691-423e-4064-ad89-5d05a8181e9d+13:2358:x1875263094364800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391467.639147:0:42637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:1.0:1788391467.639174:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2358:x1875263094365184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391467.639184:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:3.0:1788391467.639191:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094365056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1788391467.639215:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2358:x1875263094365056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391467.639240:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094364928 00000100:00100000:0.0:1788391467.639246:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094364928 00000100:00100000:0.0:1788391467.639277:0:42646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365312 00000100:00100000:0.0:1788391467.639280:0:42646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365312 00000100:00100000:0.0:1788391467.639306:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:0.0:1788391467.639313:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094364928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391467.639354:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2358:x1875263094364928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 42us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391467.639360:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:0.0:1788391467.639371:0:42646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:0.0:1788391467.639375:0:42646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094365312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391467.639391:0:42646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2358:x1875263094365312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391467.639394:0:42646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00080000:0.0:1788391467.639542:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788391467.639548:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788391467.639550:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788391467.640055:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:3.0:1788391467.640063:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00010000:00010000:2.0:1788391467.981312:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391469.007055:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788391469.090085:0:54419:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788391469.090093:0:54419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788391469.090847:0:54419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788391469.090856:0:54419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391470.029741:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788391470.526179:0:54471:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391470.526188:0:54471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391470.526710:0:54471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391470.526719:0:54471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788391471.053202:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391471.053221:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788391471.053292:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391471.053293:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103539968:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.053341:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391471.053345:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103540224:0@lo:400:kworker.0 00000100:00100000:3.0:1788391471.053372:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391471.053379:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103540480:0@lo:400:kworker.0 00010000:00010000:0.0:1788391471.053390:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788391471.053391:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788391471.053399:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103540352:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.053412:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391471.053426:0:42639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539968 00000100:00100000:3.0:1788391471.053433:0:43327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540224 00000100:00100000:0.0:1788391471.053435:0:42639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539968 00000100:00100000:3.0:1788391471.053437:0:43327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540224 00000100:00100000:2.0:1788391471.053445:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788391471.053453:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103540096:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.053481:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788391471.053496:0:42639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788391471.053507:0:42639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103539968:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788391471.053556:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788391471.053558:0:42639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2d257ec-6d90-4f1c-863a-372d5df14bf2+19:3286:x1875263103539968:12345-0@lo:400:kworker.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391471.053567:0:42639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788391471.053573:0:43329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103539840 00000100:00100000:1.0:1788391471.053577:0:43329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103539840 00000100:00100000:1.0:1788391471.053610:0:43329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788391471.053624:0:43329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103539840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788391471.053650:0:43329:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3713007616 avail 3710910464 00000100:00100000:2.0:1788391471.053661:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103540608:0@lo:400:kworker.0 00000100:00100000:1.0:1788391471.053685:0:43329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875263103539840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391471.053690:0:43329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788391471.053695:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788391471.053719:0:44885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540096 00000100:00100000:1.0:1788391471.053723:0:44885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540096 00000100:00100000:2.0:1788391471.053727:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2d257ec-6d90-4f1c-863a-372d5df14bf2:3286:1875263103539968:0@lo:400:kworker.0 00000100:00100000:1.0:1788391471.053745:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788391471.053752:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58a940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391471.053774:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58a940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103540224:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391471.053777:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788391471.053785:0:44885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788391471.053800:0:44885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103540096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054006:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540480 00000100:00100000:2.0:1788391471.054011:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540480 00000100:00100000:2.0:1788391471.054044:0:42644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540608 00000100:00100000:1.0:1788391471.054045:0:44885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1875263103540096:12345-0@lo:400:kworker.0 Request processed in 242us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391471.054048:0:42644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540608 00000100:00100000:1.0:1788391471.054057:0:44885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788391471.054077:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00080000:1.0:1788391471.054079:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788391471.054085:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788391471.054089:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103540480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391471.054120:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1875263103540096:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054128:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875263103540480:12345-0@lo:400:kworker.0 Request processed in 41us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391471.054135:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788391471.054142:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1875263103540480:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054153:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788391471.054162:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103540608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054205:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875263103540608:12345-0@lo:400:kworker.0 Request processed in 44us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391471.054216:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788391471.054219:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1875263103540608:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788391471.054271:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103540224:0@lo:400:kworker.0 00000100:00100000:2.0:1788391471.054288:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58a941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788391471.054310:0:42645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540352 00000100:00100000:1.0:1788391471.054316:0:42645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540352 00000100:00100000:1.0:1788391471.054347:0:42645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788391471.054354:0:42645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103540352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788391471.054398:0:42645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875263103540352:12345-0@lo:400:kworker.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391471.054405:0:42645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788391471.054415:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58b28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875263103540352:0@lo:400:kworker.0 00000040:00080000:1.0:1788391471.373198:0:42679:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391471.373209:0:42679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391471.373706:0:42679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391471.374000:0:42679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788391471.971286:0:54522:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788391471.971294:0:54522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788391471.972047:0:54522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788391471.972056:0:54522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391472.077105:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788391472.077344:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103540736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788391472.077425:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788391472.077463:0:51461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263103540736 00000100:00100000:3.0:1788391472.077471:0:51461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263103540736 00000100:00100000:3.0:1788391472.077522:0:51461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788391472.077531:0:51461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103540736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788391472.077562:0:51461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788391472.077659:0:51461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6c1d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875263103540736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391472.077667:0:51461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788391472.077763:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95d58c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1875263103540736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788391472.757148:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391472.757189:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391472.757276:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1788391472.757301:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1788391472.757334:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365952 00000100:00100000:0.0:1788391472.757335:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1788391472.757343:0:42638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365440 00000100:00100000:1.0:1788391472.757346:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365952 00000100:00100000:3.0:1788391472.757349:0:42638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365440 00000100:00100000:1.0:1788391472.757407:0:50077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365568 00000100:00100000:3.0:1788391472.757412:0:42638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:1.0:1788391472.757413:0:50077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365568 00000100:00100000:0.0:1788391472.757415:0:42644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 316 00000100:00100000:3.0:1788391472.757432:0:42638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094365440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391472.757434:0:42644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094365952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391472.757452:0:50077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 317 00000100:00100000:1.0:1788391472.757461:0:50077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094365568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1788391472.757507:0:42644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52ce7de6-d362-4c91-9bea-438b5645df6d+5:2356:x1875263094365952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788391472.757508:0:42638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d6b513c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12917691-423e-4064-ad89-5d05a8181e9d+13:2356:x1875263094365440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788391472.757520:0:42644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 316 00000100:00100000:3.0:1788391472.757525:0:42638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:2.0:1788391472.757583:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365696 00000100:00100000:2.0:1788391472.757589:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365696 00000100:00100000:1.0:1788391472.757596:0:50077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a67cef5d-639a-4d25-af65-3d93a762bd9f+56:2356:x1875263094365568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391472.757603:0:50077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 317 00000100:00100000:2.0:1788391472.757629:0:43326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875263094365824 00000100:00100000:2.0:1788391472.757633:0:43326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875263094365824 00000100:00080000:1.0:1788391472.757646:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788391472.757652:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788391472.757654:0:42640:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788391472.757666:0:43326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:2.0:1788391472.757676:0:43326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094365696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1788391472.757680:0:43698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:1.0:1788391472.757692:0:43698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094365824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1788391472.757713:0:43326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d5853d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a67cef5d-639a-4d25-af65-3d93a762bd9f+10:2356:x1875263094365696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788391472.757721:0:43326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:1.0:1788391472.757729:0:43698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95d58b179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a67cef5d-639a-4d25-af65-3d93a762bd9f+13:2356:x1875263094365824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788391472.757738:0:43698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00010000:00010000:0.0:1788391473.104947:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788391473.439312:0:54573:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788391473.439319:0:54573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788391473.439768:0:54573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788391473.439827:0:54573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788391474.125125:0:42632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788391475.150558:0:42633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788391475.173787:0:54623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_13a: @@@@@@ FAIL: request on 0x2000032e1:0x3b:0x0 is not SUCCEED on mds1 Debug log: 74843 lines, 74843 kept, 0 dropped, 0 bad.